![如何调试实例创建期间的超时错误?](https://linux22.com/image/778168/%E5%A6%82%E4%BD%95%E8%B0%83%E8%AF%95%E5%AE%9E%E4%BE%8B%E5%88%9B%E5%BB%BA%E6%9C%9F%E9%97%B4%E7%9A%84%E8%B6%85%E6%97%B6%E9%94%99%E8%AF%AF%EF%BC%9F.png)
我使用 kolla ansible 创建了一个小型 OpenStack 云,它由 3 个节点组成,所有节点都包含相同的服务。我可以使用 Cirros 玩具映像毫无问题地启动实例,也可以使用官方的 debian 云映像,但是启动我自己创建的 Windows 10 映像却不起作用。
首先介绍一下我尝试过的图像的几个细节:
$ openstack image list --long
+-----------+-------------+------------------+-------------+--------+------------+-----------+
| Name | Disk Format | Container Format | Size | Status | Visibility | Protected |
+-----------+-------------+------------------+-------------+--------+------------+-----------+
| Win10Pro | qcow2 | bare | 12238913536 | active | shared | False |
| cirros | qcow2 | bare | 16338944 | active | public | False |
| debian-11 | qcow2 | bare | 253231104 | active | public | False |
+-----------+-------------+------------------+-------------+--------+------------+-----------+
我的直觉是,这与大小有关(Windows 超过 10GB 时就非常大了),因为 API 调用很慢。大多数调用需要 1 秒以上,例如openstack server list
,需要 1.5 到 2 秒。机器之间的 ping 时间对我来说似乎还好,大约为 0.4 毫秒。
那么我该如何最好地调试它呢?
这是启动 Windows 实例时出现的错误:
'code': 500, 'created': '2022-06-25T06:21:06Z', 'message': 'Build of instance 3d0498e2-ddde-4bcf-ab54-7881360fe9f7 aborted:
("Connection broken: TimeoutError(110, \'Connection timed out\')", TimeoutError(110, \'Connection timed out\'))', 'details': 'Traceback (most recent call last):
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 2746, in _build_resources
self._shutdown_instance(context, instance,
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 3005, in _shutdown_instance
self._try_deallocate_network(context, instance, requested_networks)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 2922, in _try_deallocate_network
self._set_instance_obj_error_state(instance)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__
self.force_reraise()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
raise self.value
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 2917, in _try_deallocate_network
_deallocate_network_with_retries()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_service/loopingcall.py", line 436, in func
return evt.wait()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/eventlet/event.py", line 125, in wait
result = hub.switch()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
return self.greenlet.switch()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_service/loopingcall.py", line 150, in _run_loop
result = func(*self.args, **self.kw)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_service/loopingcall.py", line 407, in _func
result = f(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 2906, in _deallocate_network_with_retries
self._deallocate_network(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 2150, in _deallocate_network
self.network_api.deallocate_for_instance(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1811, in deallocate_for_instance
self._delete_ports(neutron, instance, ports, raise_if_fail=True)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1785, in _delete_ports
raise exceptions[0]
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1775, in _delete_ports
neutron.delete_port(port)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 197, in wrapper
ret = obj(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 831, in delete_port
return self.delete(self.port_path % (port))
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 197, in wrapper
ret = obj(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 352, in delete
return self.retry_request("DELETE", action, body=body,
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 197, in wrapper
ret = obj(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 333, in retry_request
return self.do_request(method, action, body=body,
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 197, in wrapper
ret = obj(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 297, in do_request
self._handle_fault_response(status_code, replybody, resp)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 197, in wrapper
ret = obj(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response
exception_handler_v20(status_code, error_body)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20
raise client_exc(message=error_message,
neutronclient.common.exceptions.NeutronClientException: <html><body><h1>504 Gateway Time-out</h1>
The server didn\'t respond in time.
</body></html>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 2312, in _do_build_and_run_instance
self._build_and_run_instance(context, instance, image,
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 2521, in _build_and_run_instance
compute_utils.notify_about_instance_create(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__
self.force_reraise()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
raise self.value
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 2494, in _build_and_run_instance
LOG.info(\'Took %0.2f seconds to spawn the instance on \'
File "/usr/lib/python3.9/contextlib.py", line 135, in __exit__
self.gen.throw(type, value, traceback)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 2754, in _build_resources
raise exception.BuildAbortException(
nova.exception.BuildAbortException: Build of instance 3d0498e2-ddde-4bcf-ab54-7881360fe9f7 aborted: ("Connection broken: TimeoutError(110, \'Connection timed out\')", TimeoutError(110, \'Connection timed out\'))
'}