API tools faq
paste
Advertisement
NMamaev

Untitled

NMamaev
Jun 26th, 2023
478
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Bash 48.03 KB | None | 0 0
raw download clone embed print report
  1. [root@f26be476e307 log]# grep 8fa56c5b446ed62569ebd8e44f8585cd *.log*
  2. connect_storages.log:2023-06-27 04:02:22.775 [pid=3529] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] INFO Try connect to http://input:1500/vm/v3/node/7 with headers {'Host': 'instance-1', 'internal-auth': 'on'}
  3. connect_storages.log:2023-06-27 04:02:22.776 [pid=3529] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG Starting new HTTP connection (1): input:1500
  4. connect_storages.log:2023-06-27 04:02:22.779 [pid=3529] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG http://input:1500 "GET /vm/v3/node/7 HTTP/1.1" 200 1569
  5. node_nwfilter.log:2023-06-27 04:02:21.260 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] INFO node nwfilter configure
  6. node_nwfilter.log:2023-06-27 04:02:21.454 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter inout-drop-ports
  7. node_nwfilter.log:2023-06-27 04:02:21.481 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter inout-drop-ports
  8. node_nwfilter.log:2023-06-27 04:02:21.508 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter allow-incoming-ipv6
  9. node_nwfilter.log:2023-06-27 04:02:21.534 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter allow-incoming-ipv6
  10. node_nwfilter.log:2023-06-27 04:02:21.560 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter clean-traffic
  11. node_nwfilter.log:2023-06-27 04:02:21.587 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter clean-traffic
  12. node_nwfilter.log:2023-06-27 04:02:21.613 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter clean-traffic-v6-only
  13. node_nwfilter.log:2023-06-27 04:02:21.639 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter clean-traffic-v6-only
  14. node_nwfilter.log:2023-06-27 04:02:21.667 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter clean-traffic-with-v6
  15. node_nwfilter.log:2023-06-27 04:02:21.693 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter clean-traffic-with-v6
  16. node_nwfilter.log:2023-06-27 04:02:21.719 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter no-ipv6-spoofing
  17. node_nwfilter.log:2023-06-27 04:02:21.746 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter no-ipv6-spoofing
  18. node_nwfilter.log:2023-06-27 04:02:21.773 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-in-limit
  19. node_nwfilter.log:2023-06-27 04:02:21.799 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-in-limit
  20. node_nwfilter.log:2023-06-27 04:02:21.826 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-out-limit
  21. node_nwfilter.log:2023-06-27 04:02:21.852 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-out-limit
  22. node_nwfilter.log:2023-06-27 04:02:21.878 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-inout-limit
  23. node_nwfilter.log:2023-06-27 04:02:21.905 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-inout-limit
  24. node_nwfilter.log:2023-06-27 04:02:21.931 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-in-limit-clean-traffic
  25. node_nwfilter.log:2023-06-27 04:02:21.957 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-in-limit-clean-traffic
  26. node_nwfilter.log:2023-06-27 04:02:21.983 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-in-limit-clean-traffic-v6-only
  27. node_nwfilter.log:2023-06-27 04:02:22.010 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-in-limit-clean-traffic-v6-only
  28. node_nwfilter.log:2023-06-27 04:02:22.036 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-in-limit-clean-traffic-with-v6
  29. node_nwfilter.log:2023-06-27 04:02:22.062 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-in-limit-clean-traffic-with-v6
  30. node_nwfilter.log:2023-06-27 04:02:22.089 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-out-limit-clean-traffic
  31. node_nwfilter.log:2023-06-27 04:02:22.114 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-out-limit-clean-traffic
  32. node_nwfilter.log:2023-06-27 04:02:22.141 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-out-limit-clean-traffic-v6-only
  33. node_nwfilter.log:2023-06-27 04:02:22.167 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-out-limit-clean-traffic-v6-only
  34. node_nwfilter.log:2023-06-27 04:02:22.194 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-out-limit-clean-traffic-with-v6
  35. node_nwfilter.log:2023-06-27 04:02:22.220 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-out-limit-clean-traffic-with-v6
  36. node_nwfilter.log:2023-06-27 04:02:22.247 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-inout-limit-clean-traffic
  37. node_nwfilter.log:2023-06-27 04:02:22.273 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-inout-limit-clean-traffic
  38. node_nwfilter.log:2023-06-27 04:02:22.300 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-inout-limit-clean-traffic-v6-only
  39. node_nwfilter.log:2023-06-27 04:02:22.326 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-inout-limit-clean-traffic-v6-only
  40. node_nwfilter.log:2023-06-27 04:02:22.352 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG processing filter tcp-inout-limit-clean-traffic-with-v6
  41. node_nwfilter.log:2023-06-27 04:02:22.378 [pid=3520] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] DEBUG define filter tcp-inout-limit-clean-traffic-with-v6
  42. vm_1_reader.log:2023-06-27 04:03:17.507 [pid=227] [#6f630a87ed1e8da76353371fe58bbbe6/10.60.4.173/@admin@example.com] Response body '{"last_notify":226089,"task":{"account":{"email":"admin@example.com","id":3,"ip":"172.18.0.26"},"date_create":"2023-06-27 04:00:25.000000","date_end":"2023-06-27 04:02:22.000000","date_start":"2023-06-27 04:00:25.000000","message_params":{"ip_addr":"172.31.36.36","name":"2ifnode"},"name":"node_create","output":"Unhandled exception: Action failed with error:","param":["--action","node_create","--virt-type","kvm","--log-path","/var/log/node_create/node_7.log","--params","{\"autorun_scripts\":[],\"changed\":[],\"cluster_id\":2,\"datacenter_type\":\"common\",\"deleted\":[],\"gateway\":null,\"id\":7,\"iface_list\":[{\"id\":11,\"name\":\"eth0\",\"nm_ruled\":null,\"state\":\"enabled\",\"type\":\"eth\"},{\"id\":12,\"name\":\"eth1\",\"nm_ruled\":null,\"state\":\"enabled\",\"type\":\"eth\"},{\"id\":10,\"name\":\"vmbr0\",\"nm_ruled\":null,\"state\":\"enabled\",\"type\":\"bridge\"},{\"id\":11,\"name\":\"vmbr1\",\"nm_ruled\":null,\"state\":\"enabled\",\"type\":\"bridge\"}],\"image_storage_path\":\"/image\",\"interfaces\":[{\"name\":\"eth0\",\"network_switch\":\"vmbr0\"},{\"name\":\"eth1\",\"network_switch\":\"vmbr1\"}],\"ip\":\"172.31.36.36\",\"network_autosetup_disabled\":false,\"new\":[],\"nm_ruled\":false,\"node_addr_v6\":null,\"node_interface_name\":\"vmbr0\",\"os_major_version\":\"8\",\"os_name\":\"almalinux\",\"os_storage_path\":\"/share\",\"os_version\":\"AlmaLinux 8.8\",\"proxy_enabled\":false,\"spice_enabled\":true,\"ssh_port\":22,\"ssh_user\":\"root\",\"timeout\":300,\"timezone\":\"UTC\"}"],"request_id":"8fa56c5b446ed62569ebd8e44f8585cd","status":"failed"}}'
  43. vm_1_reader.log:2023-06-27 04:03:20.710 [pid=227] [#bc7d83fb6c0bffe538105577722bb0b9/10.60.4.173/@admin@example.com] Response body '{"last_notify":226089,"task":{"account":{"email":"admin@example.com","id":3,"ip":"172.18.0.26"},"date_create":"2023-06-27 04:00:25.000000","date_end":"2023-06-27 04:02:22.000000","date_start":"2023-06-27 04:02:22.000000","message_params":{"name":"2ifnode"},"name":"connect_storages","output":"Unhandled exception: Traceback (most recent call last):\n  File \"/opt/ispsystem/vm/scripts/kvm/connect_storages.py\", line 165, in <module>\n    main()\n  File \"/opt/ispsystem/vm/scripts/kvm/connect_storages.py\", line 118, in main\n    node_utils.check_node_state(params['node_id'])\n  File \"/usr/local/lib/python3.9/site-packages/common/node.py\", line 170, in check_node_state\n    raise RuntimeError(f'Node {node_id} is not active')\nRuntimeError: Node 7 is not active","param":["--action","connect_storages","--virt-type","kvm","--params","{\"cluster_id\":2,\"node_id\":7,\"node_ip\":\"172.31.36.36\",\"node_ssh_port\":22,\"storages\":[{\"id\":2,\"type\":\"file\"}]}"],"request_id":"8fa56c5b446ed62569ebd8e44f8585cd","status":"failed"}}'
  44. vm_1_reader.log:2023-06-27 04:03:23.102 [pid=227] [#f4be73ade62e8cf4643795c0592bf104/10.60.4.173/@admin@example.com] Response body '{"last_notify":226127,"task":{"account":{"email":"admin@example.com","id":3,"ip":"172.18.0.26"},"date_create":"2023-06-27 04:00:25.000000","date_end":"2023-06-27 04:02:22.000000","date_start":"2023-06-27 04:00:25.000000","message_params":{"ip_addr":"172.31.36.36","name":"2ifnode"},"name":"node_create","output":"Unhandled exception: Action failed with error:","param":["--action","node_create","--virt-type","kvm","--log-path","/var/log/node_create/node_7.log","--params","{\"autorun_scripts\":[],\"changed\":[],\"cluster_id\":2,\"datacenter_type\":\"common\",\"deleted\":[],\"gateway\":null,\"id\":7,\"iface_list\":[{\"id\":11,\"name\":\"eth0\",\"nm_ruled\":null,\"state\":\"enabled\",\"type\":\"eth\"},{\"id\":12,\"name\":\"eth1\",\"nm_ruled\":null,\"state\":\"enabled\",\"type\":\"eth\"},{\"id\":10,\"name\":\"vmbr0\",\"nm_ruled\":null,\"state\":\"enabled\",\"type\":\"bridge\"},{\"id\":11,\"name\":\"vmbr1\",\"nm_ruled\":null,\"state\":\"enabled\",\"type\":\"bridge\"}],\"image_storage_path\":\"/image\",\"interfaces\":[{\"name\":\"eth0\",\"network_switch\":\"vmbr0\"},{\"name\":\"eth1\",\"network_switch\":\"vmbr1\"}],\"ip\":\"172.31.36.36\",\"network_autosetup_disabled\":false,\"new\":[],\"nm_ruled\":false,\"node_addr_v6\":null,\"node_interface_name\":\"vmbr0\",\"os_major_version\":\"8\",\"os_name\":\"almalinux\",\"os_storage_path\":\"/share\",\"os_version\":\"AlmaLinux 8.8\",\"proxy_enabled\":false,\"spice_enabled\":true,\"ssh_port\":22,\"ssh_user\":\"root\",\"timeout\":300,\"timezone\":\"UTC\"}"],"request_id":"8fa56c5b446ed62569ebd8e44f8585cd","status":"failed"}}'
  45. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] request method: POST url: /node version: HTTP/1.0
  46. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] Handler 'node' choosen
  47. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] Got header: [connection]close
  48. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] Got header: [content-length]372
  49. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] Got header: [es-extra-tags]batch.5c93133f-0a60-b9cc-a84c-297e8010c6cd
  50. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] Got header: [host]instance-1
  51. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] Got header: [instance-id]1
  52. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] Got header: [internal-auth]eyJlbWFpbF9jb25maXJtZWQiOnRydWUsImV4cGlyZXNfYXQiOiIyMDIzLTA3LTA2IDExOjM4OjQ2IiwiaW5zdGFuY2Vfb3duZXIiOnRydWUsImxhbmciOiJydSIsImxhc3Rfbm90aWZ5IjoyMjUzODMsIm93bmVyX2VtYWlsIjoiYWRtaW5AZXhhbXBsZS5jb20iLCJvd25lcl9pZCI6Mywicm9sZXMiOlsiQGFkbWluIl0sInNlc19pZCI6MSwic2Vzc2lvbiI6IkUyRDk0MkRGQkE5NTk4OEEzOTg5QkVBMyIsInN1X2luc3RhbmNlIjpmYWxzZSwidHJ1c3RlZV9lbWFpbCI6ImFkbWluQGV4YW1wbGUuY29tIiwidHJ1c3RlZV9pZCI6MywieHNyZl90b2tlbiI6IkUyRDk0MkRGQkE5NTk4OEEzOTg5QkVBMyJ9
  53. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] Got header: [x-forwarded-for]172.18.0.26
  54. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] Got header: [x-remote-ip]172.18.0.26
  55. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] Got header: [x-request-id]8fa56c5b446ed62569ebd8e44f8585cd
  56. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26] Got header: [x-xsrf-token]E2D942DFBA95988A3989BEA3
  57. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] RequestBody: {"cluster":2,"comment":"","host_filter":[],"host_limit":-1,"host_max":null,"interfaces":[{"cluster_interface":0,"node_interface":"vmbr0"},{"cluster_interface":1,"node_interface":"vmbr1"}],"ip":"172.31.36.36","lvm_vg_rename":false,"name":"2ifnode","network_autosetup_disabled":false,"overselling":1,"password":"*","ssh_port":22,"ssh_user":"root","vcpu_limit":-1}
  58. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] End of POST request
  59. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Invoke POST request callback
  60. vm_1_writer.log:2023-06-27 04:00:22.903 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] WriterAsyncProcess
  61. vm_1_writer.log:2023-06-27 04:00:22.904 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT value,name,id FROM vm_bill_options WHERE name='license'' duration=163
  62. vm_1_writer.log:2023-06-27 04:00:22.905 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT vm5_data,spice_enabled,node_os_family,vxlan_mode,node_network_gateway,node_network_timeout,ha_error,ha_cluster_id,ha_agent_version,ha_checking_host,ha_enabled,net_bandwidth_mbitps,dns_servers,host_per_node_limit,proxy_enabled,domain_change_allowed,manage_disk_enabled,iso_enabled,cpu_overselling,overselling,qemu_version,domain_template,image_storage_path,os_storage_path,interface_count,imported_from,host_filter,host_distribution_policy,datacenter_type,virtualization_type,time_zone,comment,name,id FROM vm_cluster WHERE id='2'' duration=225
  63. vm_1_writer.log:2023-06-27 04:00:22.905 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT vm_storage2cluster.id AS id FROM vm_storage2cluster WHERE (vm_storage2cluster.cluster='2')' duration=128
  64. vm_1_writer.log:2023-06-27 04:00:22.905 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Fork. New Process PID: 2321
  65. vm_1_writer.log:2023-06-27 04:00:22.905 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2321. Execute command: 'ssh-keygen -R 172.31.36.36'
  66. vm_1_writer.log:2023-06-27 04:00:22.907 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2321. Finished successefully with status 0
  67. vm_1_writer.log:2023-06-27 04:00:22.907 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2321. Output:
  68. vm_1_writer.log:2023-06-27 04:00:22.907 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2321. Error:
  69. vm_1_writer.log:2023-06-27 04:00:22.907 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Fork. New Process PID: 2322
  70. vm_1_writer.log:2023-06-27 04:00:22.908 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2322. Execute command: '/usr/bin/sshpass -e -- ssh-copy-id -p 22 -o StrictHostKeyChecking=no -o ConnectTimeout=15 -i /opt/ispsystem/vm/etc/.ssh/vmmgr.1.pub root@172.31.36.36'
  71. vm_1_writer.log:2023-06-27 04:00:23.678 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2322. Finished successefully with status 0
  72. vm_1_writer.log:2023-06-27 04:00:23.678 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2322. Output:
  73. vm_1_writer.log:2023-06-27 04:00:23.678 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2322. Error:
  74. vm_1_writer.log:2023-06-27 04:00:23.678 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Fork. New Process PID: 2367
  75. vm_1_writer.log:2023-06-27 04:00:23.678 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2367. Execute command: 'scripts/kvm/node_info.py --private-key /opt/ispsystem/vm/etc/.ssh/vmmgr.1 --host 172.31.36.36 --port 22 --user root'
  76. vm_1_writer.log:2023-06-27 04:00:25.333 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2367. Finished successefully with status 0
  77. vm_1_writer.log:2023-06-27 04:00:25.333 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2367. Output: {"os": {"version": "AlmaLinux 8.8", "name": "almalinux", "major_version": "8"}, "kvm_support": true, "kvm_enabled": true, "cpu_core_count": 4, "mem_mib": 3665, "hostname": "nmamaev.lvm.node.2.vm6-de-dev.com", "iface": "vmbr0"}
  78. vm_1_writer.log:2023-06-27 04:00:25.333 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 2367. Error:
  79. vm_1_writer.log:2023-06-27 04:00:25.333 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Node Info: 0
  80. vm_1_writer.log:2023-06-27 04:00:25.333 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Node Info: {"cpu_core_count":4,"hostname":"nmamaev.lvm.node.2.vm6-de-dev.com","iface":"vmbr0","kvm_enabled":true,"kvm_support":true,"mem_mib":3665,"os":{"major_version":"8","name":"almalinux","version":"AlmaLinux 8.8"}}
  81. vm_1_writer.log:2023-06-27 04:00:25.333 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT name FROM vm_node WHERE hostname='nmamaev.lvm.node.2.vm6-de-dev.com' AND cluster='2' LIMIT 1' duration=370
  82. vm_1_writer.log:2023-06-27 04:00:25.334 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] InternalCall service: checker path: get_info
  83. vm_1_writer.log:2023-06-27 04:00:25.781 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got node_network: [
  84. vm_1_writer.log:2023-06-27 04:00:25.781 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] CheckLicense
  85. vm_1_writer.log:2023-06-27 04:00:25.782 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT id, cpu_number, additional_data FROM vm_node' duration=288
  86. vm_1_writer.log:2023-06-27 04:00:25.783 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT COUNT(id) FROM vm_node WHERE cluster = '2'' duration=156
  87. vm_1_writer.log:2023-06-27 04:00:25.783 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT id FROM vm_node WHERE name = '2ifnode' LIMIT 1' duration=105
  88. vm_1_writer.log:2023-06-27 04:00:25.783 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT id FROM vm_node WHERE ip_addr = '172.31.36.36' LIMIT 1' duration=122
  89. vm_1_writer.log:2023-06-27 04:00:25.785 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_node (id,name,comment,cluster,ram_mib,max_vcpu_number,cpu_number,ip_addr,vnc_addr,ssh_port,state,mon_install_date,os_version,overselling,hostname,host_filter) VALUES(7,'2ifnode','',2,3665,4,4,'172.31.36.36','172.31.36.36',22,'prepare_node','2023-06-27 04:00:25','AlmaLinux 8.8',1.000000,'nmamaev.lvm.node.2.vm6-de-dev.com','[]')' duration=1666
  90. vm_1_writer.log:2023-06-27 04:00:25.785 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT MAX(create_time) FROM vm_node_history WHERE event_type='field:state' AND ref='7'' duration=132
  91. vm_1_writer.log:2023-06-27 04:00:25.786 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_node_history (id,event_type,event_info,request_user,request_owner,request_ip,request_id,ref) VALUES (19,'field:state','{\"new_value\":\"prepare_node\",\"old_value\":null}','admin@example.com','---','172.18.0.26','8fa56c5b446ed62569ebd8e44f8585cd',7)' duration=118
  92. vm_1_writer.log:2023-06-27 04:00:25.786 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Adding interface: eth0
  93. vm_1_writer.log:2023-06-27 04:00:25.786 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_node_interfaces (id,name,node,state) VALUES(11,'eth0',7,'enabled')' duration=101
  94. vm_1_writer.log:2023-06-27 04:00:25.786 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Adding interface: eth1
  95. vm_1_writer.log:2023-06-27 04:00:25.786 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_node_interfaces (id,name,node,state) VALUES(12,'eth1',7,'enabled')' duration=105
  96. vm_1_writer.log:2023-06-27 04:00:25.786 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Adding interface: vmbr0
  97. vm_1_writer.log:2023-06-27 04:00:25.788 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_node_bridge (id,name,node,ipv4,gateway_v4,state) VALUES(10,'vmbr0',7,'172.31.36.36/23','172.31.36.1','enabled')' duration=1146
  98. vm_1_writer.log:2023-06-27 04:00:25.788 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Adding interface: vmbr1
  99. vm_1_writer.log:2023-06-27 04:00:25.788 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_node_bridge (id,name,node,ipv4,state) VALUES(11,'vmbr1',7,'192.168.112.2/24','enabled')' duration=181
  100. vm_1_writer.log:2023-06-27 04:00:25.788 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Adding relation for: eth0
  101. vm_1_writer.log:2023-06-27 04:00:25.788 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Adding relation for: eth1
  102. vm_1_writer.log:2023-06-27 04:00:25.788 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Adding relation for: vmbr0
  103. vm_1_writer.log:2023-06-27 04:00:25.789 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT nm_ruled,date_create,take_slave_ip,slave_ip,old_values,mode,state,gateway_v6,gateway_v4,ipv6,ipv4,node,name,id FROM vm_node_bond WHERE name='eth0' AND node='7'' duration=190
  104. vm_1_writer.log:2023-06-27 04:00:25.789 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] New iface2bridge
  105. vm_1_writer.log:2023-06-27 04:00:25.789 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT COUNT(*) FROM vm_iface2bond2bridge JOIN vm_node_bridge ON vm_node_bridge.vlan IS NULL AND vm_node_bridge.id = vm_iface2bond2bridge.bridge WHERE (vm_iface2bond2bridge.iface = '11')' duration=187
  106. vm_1_writer.log:2023-06-27 04:00:25.789 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_iface2bond2bridge (id,iface,bridge) VALUES(12,11,10)' duration=107
  107. vm_1_writer.log:2023-06-27 04:00:25.789 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Adding relation for: vmbr1
  108. vm_1_writer.log:2023-06-27 04:00:25.789 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT nm_ruled,date_create,take_slave_ip,slave_ip,old_values,mode,state,gateway_v6,gateway_v4,ipv6,ipv4,node,name,id FROM vm_node_bond WHERE name='eth1' AND node='7'' duration=122
  109. vm_1_writer.log:2023-06-27 04:00:25.789 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] New iface2bridge
  110. vm_1_writer.log:2023-06-27 04:00:25.789 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT COUNT(*) FROM vm_iface2bond2bridge JOIN vm_node_bridge ON vm_node_bridge.vlan IS NULL AND vm_node_bridge.id = vm_iface2bond2bridge.bridge WHERE (vm_iface2bond2bridge.iface = '12')' duration=146
  111. vm_1_writer.log:2023-06-27 04:00:25.790 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_iface2bond2bridge (id,iface,bridge) VALUES(13,12,11)' duration=119
  112. vm_1_writer.log:2023-06-27 04:00:25.790 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT nm_ruled,date_create,old_values,take_slave_ip,vlan,is_main_network,is_default,state,gateway_v6,gateway_v4,ipv6,ipv4,node,name,id FROM vm_node_bridge WHERE vm_node_bridge.is_default AND vm_node_bridge.is_main_network='1' AND vm_node_bridge.node='7'' duration=203
  113. vm_1_writer.log:2023-06-27 04:00:25.790 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='UPDATE vm_node_bridge SET is_default='1',take_slave_ip='1' WHERE id=10' duration=620
  114. vm_1_writer.log:2023-06-27 04:00:25.791 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT nm_ruled,date_create,old_values,take_slave_ip,vlan,is_main_network,is_default,state,gateway_v6,gateway_v4,ipv6,ipv4,node,name,id FROM vm_node_bridge WHERE vm_node_bridge.is_default AND vm_node_bridge.is_main_network='0' AND vm_node_bridge.node='7'' duration=168
  115. vm_1_writer.log:2023-06-27 04:00:25.791 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='UPDATE vm_node_bridge SET is_default='1',is_main_network='0',take_slave_ip='1' WHERE id=11' duration=131
  116. vm_1_writer.log:2023-06-27 04:00:25.792 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='UPDATE vm_node SET network_settings_lock='1' WHERE id=7' duration=1157
  117. vm_1_writer.log:2023-06-27 04:00:25.792 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT vm_node_interfaces.name AS name, vm_node_bridge.name AS network_switch  FROM vm_node_interfaces INNER JOIN vm_iface2bond2bridge ON vm_iface2bond2bridge.iface=vm_node_interfaces.id INNER JOIN vm_node_bridge ON vm_node_bridge.id=vm_iface2bond2bridge.bridge WHERE vm_node_interfaces.node='7' AND vm_node_bridge.name IS NOT NULL' duration=165
  118. vm_1_writer.log:2023-06-27 04:00:25.792 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT id, name, state FROM vm_node_interfaces WHERE node='7'' duration=142
  119. vm_1_writer.log:2023-06-27 04:00:25.793 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT id, name, state FROM vm_node_bond WHERE node='7'' duration=115
  120. vm_1_writer.log:2023-06-27 04:00:25.793 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT id, name, state FROM vm_node_bridge WHERE node='7'' duration=116
  121. vm_1_writer.log:2023-06-27 04:00:25.793 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT id, name, state FROM vm_node_interfaces WHERE node='7'' duration=112
  122. vm_1_writer.log:2023-06-27 04:00:25.793 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT id, name, state FROM vm_node_bond WHERE node='7'' duration=105
  123. vm_1_writer.log:2023-06-27 04:00:25.793 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT id, name, state FROM vm_node_bridge WHERE node='7'' duration=110
  124. vm_1_writer.log:2023-06-27 04:00:25.793 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT s.name, s.script, s.type, s.priority FROM vm_node_script s LEFT JOIN vm_node_script2cluster n_s2c ON n_s2c.script=s.id WHERE n_s2c.cluster='2'' duration=171
  125. vm_1_writer.log:2023-06-27 04:00:25.794 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT value,name,id FROM vm_settings WHERE name='task_timeout'' duration=146
  126. vm_1_writer.log:2023-06-27 04:00:25.794 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT value,name,id FROM vm_settings WHERE name='consul_task_ttl_in_sec'' duration=140
  127. vm_1_writer.log:2023-06-27 04:00:25.798 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT ha_cluster_id,ha_id,password_hidden,defer_reason,request_info,node,main_table_id,main_table,output,date_end,date_start,date_create,status,message_params,param,name,consul_id,id FROM vm_task_log WHERE consul_id='45' AND name='node_create'' duration=460
  128. vm_1_writer.log:2023-06-27 04:00:25.799 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_task_log (id,consul_id,name,param,message_params,status,main_table,main_table_id,node,request_info) VALUES(23,45,'node_create','[\"--action\",\"node_create\",\"--virt-type\",\"kvm\",\"--log-path\",\"/var/log/node_create/node_7.log\",\"--params\",\"{\\\"autorun_scripts\\\":[],\\\"changed\\\":[],\\\"cluster_id\\\":2,\\\"datacenter_type\\\":\\\"common\\\",\\\"deleted\\\":[],\\\"gateway\\\":null,\\\"id\\\":7,\\\"iface_list\\\":[{\\\"id\\\":11,\\\"name\\\":\\\"eth0\\\",\\\"nm_ruled\\\":null,\\\"state\\\":\\\"enabled\\\",\\\"type\\\":\\\"eth\\\"},{\\\"id\\\":12,\\\"name\\\":\\\"eth1\\\",\\\"nm_ruled\\\":null,\\\"state\\\":\\\"enabled\\\",\\\"type\\\":\\\"eth\\\"},{\\\"id\\\":10,\\\"name\\\":\\\"vmbr0\\\",\\\"nm_ruled\\\":null,\\\"state\\\":\\\"enabled\\\",\\\"type\\\":\\\"bridge\\\"},{\\\"id\\\":11,\\\"name\\\":\\\"vmbr1\\\",\\\"nm_ruled\\\":null,\\\"state\\\":\\\"enabled\\\",\\\"type\\\":\\\"bridge\\\"}],\\\"image_storage_path\\\":\\\"/image\\\",\\\"interfaces\\\":[{\\\"name\\\":\\\"eth0\\\",\\\"network_switch\\\":\\\"vmbr0\\\"},{\\\"name\\\":\\\"eth1\\\",\\\"network_switch\\\":\\\"vmbr1\\\"}],\\\"ip\\\":\\\"172.31.36.36\\\",\\\"network_autosetup_disabled\\\":false,\\\"new\\\":[],\\\"nm_ruled\\\":false,\\\"node_addr_v6\\\":null,\\\"node_interface_name\\\":\\\"vmbr0\\\",\\\"os_major_version\\\":\\\"8\\\",\\\"os_name\\\":\\\"almalinux\\\",\\\"os_storage_path\\\":\\\"/share\\\",\\\"os_version\\\":\\\"AlmaLinux 8.8\\\",\\\"proxy_enabled\\\":false,\\\"spice_enabled\\\":true,\\\"ssh_port\\\":22,\\\"ssh_user\\\":\\\"root\\\",\\\"timeout\\\":300,\\\"timezone\\\":\\\"UTC\\\"}\"]','{\"ip_addr\":\"172.31.36.36\",\"name\":\"2ifnode\"}','created','vm_node',7,7,'{\"callback_counter\":19,\"first_start\":60264054619087,\"need_log\":true,\"request\":{\"extra_tags\":[\"batch.5c93133f-0a60-b9cc-a84c-297e8010c6cd\"],\"id\":\"8fa56c5b446ed62569ebd8e44f8585cd\",\"ip\":\"172.18.0.26\",\"user\":{\"id\":3,\"name\":\"admin@example.com\"}},\"runtime\":2894892520}')' duration=208
  129. vm_1_writer.log:2023-06-27 04:00:25.800 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT vm_storage2cluster.storage AS storage FROM vm_storage2cluster WHERE (vm_storage2cluster.cluster='2')' duration=145
  130. vm_1_writer.log:2023-06-27 04:00:25.800 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT imported_from,vm5_data,is_network,storage_params,state,type,comment,name,id FROM vm_storage WHERE id='2'' duration=142
  131. vm_1_writer.log:2023-06-27 04:00:25.801 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT hdd_overselling,ha_params,params,pool_name,enabled,is_main,cluster,storage,id FROM vm_storage2cluster WHERE storage='2' AND cluster='2'' duration=153
  132. vm_1_writer.log:2023-06-27 04:00:25.802 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_storage2node (id,storage,node,state,hdd_overselling) VALUES(7,2,7,'creating',1.000000)' duration=748
  133. vm_1_writer.log:2023-06-27 04:00:25.802 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Create notify 'instance/1/notify/create' with content '{"notifies":["storage/2/node/7"]}'
  134. vm_1_writer.log:2023-06-27 04:00:25.802 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT value,name,id FROM vm_settings WHERE name='task_timeout'' duration=137
  135. vm_1_writer.log:2023-06-27 04:00:25.802 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT value,name,id FROM vm_settings WHERE name='consul_task_ttl_in_sec'' duration=139
  136. vm_1_writer.log:2023-06-27 04:00:25.814 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='SELECT ha_cluster_id,ha_id,password_hidden,defer_reason,request_info,node,main_table_id,main_table,output,date_end,date_start,date_create,status,message_params,param,name,consul_id,id FROM vm_task_log WHERE consul_id='46' AND name='connect_storages'' duration=186
  137. vm_1_writer.log:2023-06-27 04:00:25.815 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_task_log (id,consul_id,name,param,message_params,status,main_table,main_table_id,request_info) VALUES(24,46,'connect_storages','[\"--action\",\"connect_storages\",\"--virt-type\",\"kvm\",\"--params\",\"{\\\"cluster_id\\\":2,\\\"node_id\\\":7,\\\"node_ip\\\":\\\"172.31.36.36\\\",\\\"node_ssh_port\\\":22,\\\"storages\\\":[{\\\"id\\\":2,\\\"type\\\":\\\"file\\\"}]}\"]','{\"name\":\"2ifnode\"}','created','vm_node',7,'{\"callback_counter\":29,\"first_start\":60264054619087,\"need_log\":true,\"request\":{\"extra_tags\":[\"batch.5c93133f-0a60-b9cc-a84c-297e8010c6cd\"],\"id\":\"8fa56c5b446ed62569ebd8e44f8585cd\",\"ip\":\"172.18.0.26\",\"user\":{\"id\":3,\"name\":\"admin@example.com\"}},\"runtime\":2895784709}')' duration=197
  138. vm_1_writer.log:2023-06-27 04:00:25.816 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d801f560 query='INSERT INTO vm_node_log (id,name,node,task,request_trustee,request_owner) VALUES(8,'node_create',7,23,3,3)' duration=401
  139. vm_1_writer.log:2023-06-27 04:00:25.816 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Create notify 'instance/1/notify/create' with content '{"notifies":["node_history/8","node/7/node_history/8"]}'
  140. vm_1_writer.log:2023-06-27 04:00:25.816 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Create notify 'instance/1/notify/update' with content '{"notifies":["cluster/2"]}'
  141. vm_1_writer.log:2023-06-27 04:00:25.816 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Create notify 'instance/1/notify/create' with content '{"notifies":["node/7"]}'
  142. vm_1_writer.log:2023-06-27 04:00:25.816 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Response body '{"id":7,"storages_task":46,"task":45}'
  143. vm_1_writer.log:2023-06-27 04:01:51.921 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] request method: POST url: /node/7 version: HTTP/1.0
  144. vm_1_writer.log:2023-06-27 04:01:51.921 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Handler 'node/{node_id}' choosen
  145. vm_1_writer.log:2023-06-27 04:01:51.921 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [connection]close
  146. vm_1_writer.log:2023-06-27 04:01:51.921 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [content-length]43
  147. vm_1_writer.log:2023-06-27 04:01:51.921 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [global-attributes]{"callback_counter":6,"first_start":60269088746572,"request":{"id":"8fa56c5b446ed62569ebd8e44f8585cd","ip":"172.18.0.26","user":{"name":"admin@example.com"}},"runtime":2113496226}
  148. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [host]instance-1
  149. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [instance-id]1
  150. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [internal-auth]eyJyb2xlcyI6WyJAaW50ZXJuYWwiXX0=
  151. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [x-forwarded-for]172.18.0.26
  152. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [x-remote-ip]172.18.0.26
  153. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [x-request-id]b76eaafb8ba0bc8a95faf085e30366d8
  154. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] RequestBody: {"values":{"state":"setup_virtualization"}}
  155. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] End of POST request
  156. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Invoke POST request callback
  157. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] WriterAsyncProcess
  158. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] LimitAssert
  159. vm_1_writer.log:2023-06-27 04:01:51.922 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d003c410 query='SELECT nm_ruled,additional_data,vm5_data,update_dc_networks_failed,network_error,network_settings_lock,ha_error,ha_disable_failed,ha_state,host_filter,host_limit,selinux_enforcing,hostname,overselling,lxd_version,qemu_version,libvirt_version,uptime,kernel_version,os_version,metrics_timestamp,mon_install_date,mon_installed,host_creation_blocked,property,disk_params,gray_ips,problems,spice_error,bird_error,lxd_error,libvirt_error,frr_error,connection_error,state,ssh_user,ssh_port,vnc_addr,ip_addr_v6,ip_addr,socket_number,vcpu_limit,cpu_number,max_vcpu_number,ram_mib,cluster,comment,name,id FROM vm_node WHERE id='7'' duration=386
  160. vm_1_writer.log:2023-06-27 04:01:51.923 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d003c410 query='SELECT vm5_data,spice_enabled,node_os_family,vxlan_mode,node_network_gateway,node_network_timeout,ha_error,ha_cluster_id,ha_agent_version,ha_checking_host,ha_enabled,net_bandwidth_mbitps,dns_servers,host_per_node_limit,proxy_enabled,domain_change_allowed,manage_disk_enabled,iso_enabled,cpu_overselling,overselling,qemu_version,domain_template,image_storage_path,os_storage_path,interface_count,imported_from,host_filter,host_distribution_policy,datacenter_type,virtualization_type,time_zone,comment,name,id FROM vm_cluster WHERE id='2'' duration=243
  161. vm_1_writer.log:2023-06-27 04:01:51.924 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d003c410 query='UPDATE vm_node SET state='setup_virtualization' WHERE id=7' duration=1456
  162. vm_1_writer.log:2023-06-27 04:01:51.924 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d003c410 query='SELECT MAX(create_time) FROM vm_node_history WHERE event_type='field:state' AND ref='7'' duration=151
  163. vm_1_writer.log:2023-06-27 04:01:51.925 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d003c410 query='INSERT INTO vm_node_history (id,prev_time,event_type,event_info,request_user,request_owner,request_ip,request_id,ref) VALUES (20,'2023-06-27 04:00:25','field:state','{\"new_value\":\"setup_virtualization\",\"old_value\":\"setup_virtualization\"}','admin@example.com','---','172.18.0.26','8fa56c5b446ed62569ebd8e44f8585cd',7)' duration=301
  164. vm_1_writer.log:2023-06-27 04:01:51.926 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Create notify 'instance/1/notify/update' with content '{"notifies":["node/7"]}'
  165. vm_1_writer.log:2023-06-27 04:01:51.926 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Response body '{"id":7}'
  166. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] request method: POST url: /node/7 version: HTTP/1.0
  167. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Handler 'node/{node_id}' choosen
  168. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [connection]close
  169. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [content-length]30
  170. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [global-attributes]{"callback_counter":12,"first_start":60269088746572,"request":{"id":"8fa56c5b446ed62569ebd8e44f8585cd","ip":"172.18.0.26","user":{"name":"admin@example.com"}},"runtime":86102788784}
  171. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [host]instance-1
  172. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [instance-id]1
  173. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [internal-auth]eyJyb2xlcyI6WyJAaW50ZXJuYWwiXX0=
  174. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [x-forwarded-for]172.18.0.26
  175. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [x-remote-ip]172.18.0.26
  176. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got header: [x-request-id]673dcc1ee3931c5b8dc0e0b4021a4fe3
  177. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] RequestBody: {"values":{"state":"crashed"}}
  178. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] End of POST request
  179. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Invoke POST request callback
  180. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] WriterAsyncProcess
  181. vm_1_writer.log:2023-06-27 04:02:22.455 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] LimitAssert
  182. vm_1_writer.log:2023-06-27 04:02:22.456 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d8002410 query='SELECT nm_ruled,additional_data,vm5_data,update_dc_networks_failed,network_error,network_settings_lock,ha_error,ha_disable_failed,ha_state,host_filter,host_limit,selinux_enforcing,hostname,overselling,lxd_version,qemu_version,libvirt_version,uptime,kernel_version,os_version,metrics_timestamp,mon_install_date,mon_installed,host_creation_blocked,property,disk_params,gray_ips,problems,spice_error,bird_error,lxd_error,libvirt_error,frr_error,connection_error,state,ssh_user,ssh_port,vnc_addr,ip_addr_v6,ip_addr,socket_number,vcpu_limit,cpu_number,max_vcpu_number,ram_mib,cluster,comment,name,id FROM vm_node WHERE id='7'' duration=466
  183. vm_1_writer.log:2023-06-27 04:02:22.456 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d8002410 query='SELECT vm5_data,spice_enabled,node_os_family,vxlan_mode,node_network_gateway,node_network_timeout,ha_error,ha_cluster_id,ha_agent_version,ha_checking_host,ha_enabled,net_bandwidth_mbitps,dns_servers,host_per_node_limit,proxy_enabled,domain_change_allowed,manage_disk_enabled,iso_enabled,cpu_overselling,overselling,qemu_version,domain_template,image_storage_path,os_storage_path,interface_count,imported_from,host_filter,host_distribution_policy,datacenter_type,virtualization_type,time_zone,comment,name,id FROM vm_cluster WHERE id='2'' duration=244
  184. vm_1_writer.log:2023-06-27 04:02:22.458 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d8002410 query='UPDATE vm_node SET state='crashed' WHERE id=7' duration=1743
  185. vm_1_writer.log:2023-06-27 04:02:22.458 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d8002410 query='SELECT MAX(create_time) FROM vm_node_history WHERE event_type='field:state' AND ref='7'' duration=165
  186. vm_1_writer.log:2023-06-27 04:02:22.458 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] db: id=0x7f22d8002410 query='INSERT INTO vm_node_history (id,prev_time,event_type,event_info,request_user,request_owner,request_ip,request_id,ref) VALUES (21,'2023-06-27 04:01:51','field:state','{\"new_value\":\"crashed\",\"old_value\":\"crashed\"}','admin@example.com','---','172.18.0.26','8fa56c5b446ed62569ebd8e44f8585cd',7)' duration=160
  187. vm_1_writer.log:2023-06-27 04:02:22.460 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Create notify 'instance/1/notify/update' with content '{"notifies":["node/7"]}'
  188. vm_1_writer.log:2023-06-27 04:02:22.460 [pid=2141] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Response body '{"id":7}'
  189. vmctl.log:2023-06-27 04:02:22.550 [pid=3527] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Got action connect_storages with params
  190. vmctl.log:2023-06-27 04:02:22.550 [pid=3527] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Using VmctlMode::VMCTL virt-type kvm
  191. vmctl.log:2023-06-27 04:02:22.551 [pid=3527] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Stdin params: {"before_execute":{"last_notify":225865},"stdin":{}}
  192. vmctl.log:2023-06-27 04:02:22.551 [pid=3527] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Executing action connect_storages with params
  193. vmctl.log:2023-06-27 04:02:22.551 [pid=3527] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Fork. New Process PID: 3529
  194. vmctl.log:2023-06-27 04:02:22.551 [pid=3527] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 3529. Execute command: 'scripts/kvm/connect_storages.py'
  195. vmctl.log:2023-06-27 04:02:22.826 [pid=3527] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 3529. Failed with status 256
  196. vmctl.log:2023-06-27 04:02:22.826 [pid=3527] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 3529. Output:
  197. vmctl.log:2023-06-27 04:02:22.826 [pid=3527] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] PID: 3529. Error: Traceback (most recent call last):
  198. vmctl.log:2023-06-27 04:02:22.826 [pid=3527] [#8fa56c5b446ed62569ebd8e44f8585cd/172.18.0.26/@admin@example.com] Unhandled exception: Traceback (most recent call last):
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!