OpenStack Mitaka + CentOS7 Unit openstack-cinder-volume.service entered failed state. ImportError: No module named keystonemiddleware.auth_token.__init__
Fix by installation of python-kyestone on the cinder server.
Scenario:
As per the Mitaka installation guide on CentOS7 Controller and the cinder had been separate servers. After the cinder configuration parts on the controller as well as the cinder servers, the cinder service-list on the controller shows only the cinder scheduler running on controller and the cinder-volume running on the cinder server is not seen.
[root@controller1 ~]# cinder service-list
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
| Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
| cinder-scheduler | controller1.example.com | nova | enabled | up | 2016-07-10T22:05:35.000000 | - |
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
[root@controller1 ~]#
Also the openstack-cinder-volume service on the cinder server keeps restarting by own with the following messages on the /var/log/messages on the cinder server.
ul 10 18:18:57 bstore1 cinder-volume: File "/usr/lib/python2.7/site-packages/cinder/volume/volume_types.py", line 31, in <module>
Jul 10 18:18:57 bstore1 cinder-volume: from cinder import quota
Jul 10 18:18:57 bstore1 cinder-volume: File "/usr/lib/python2.7/site-packages/cinder/quota.py", line 33, in <module>
Jul 10 18:18:57 bstore1 cinder-volume: from cinder import quota_utils
Jul 10 18:18:57 bstore1 cinder-volume: File "/usr/lib/python2.7/site-packages/cinder/quota_utils.py", line 31, in <module>
Jul 10 18:18:57 bstore1 cinder-volume: 'keystone_authtoken')
Jul 10 18:18:57 bstore1 cinder-volume: File "/usr/lib/python2.7/site-packages/oslo_config/cfg.py", line 2357, in import_opt
Jul 10 18:18:57 bstore1 cinder-volume: __import__(module_str)
Jul 10 18:18:57 bstore1 cinder-volume: ImportError: No module named keystonemiddleware.auth_token.__init__
Jul 10 18:18:58 bstore1 systemd: openstack-cinder-volume.service: main process exited, code=exited, status=1/FAILURE
Jul 10 18:18:58 bstore1 systemd: Unit openstack-cinder-volume.service entered failed state.
Jul 10 18:18:58 bstore1 systemd: openstack-cinder-volume.service failed.
Jul 10 18:18:58 bstore1 systemd: openstack-cinder-volume.service holdoff time --------------
The FIX:
The fix was to install the python-kyestone RPM to get the things working.
Installed:
python-keystone.noarch 1:9.0.2-1.el7
Dependency Installed:
PyPAM.x86_64 0:0.5.0-19.el7
python-dogpile-cache.noarch 0:0.5.7-3.el7
python-dogpile-core.noarch 0:0.4.1-2.el7
python-keystonemiddleware.noarch 0:4.4.1-1.el7
python-ldap.x86_64 0:2.4.15-2.el7
python-ldappool.noarch 0:1.0-4.el7
python-memcached.noarch 0:1.54-3.el7
python-oauthlib.noarch 0:0.7.2-5.20150520git514cad7.el7
python-pycadf.noarch 0:2.1.0-1.el7
python-pysaml2.noarch 0:3.0.2-1.el7
python-repoze-who.noarch 0:2.1-1.el7
python-zope-interface.x86_64 0:4.0.5-4.el7
python2-oslo-cache.noarch 0:1.5.0-1.el7
python2-passlib.noarch 0:1.6.5-1.el7
Complete!
This successfully started the openstack-cinder-volume service on the cinder server.
This is the /var/log/messages on the cinder server post successful start of the openstack-cinder-volume server.
Jul 10 19:08:17 bstore1 cinder-volume: 2016-07-10 19:08:17.892 5793 INFO cinder.volume.manager [req-74d43fcd-c4ec-4a37-8d27-033c2f2eb86e - - - - -] Service not found for updating active_backend_id, assuming default for driver init.
Jul 10 19:08:18 bstore1 cinder-volume: 2016-07-10 19:08:18.095 5793 INFO cinder.volume.manager [req-74d43fcd-c4ec-4a37-8d27-033c2f2eb86e - - - - -] Image-volume cache disabled for host bstore1.example.com@lvm.
Jul 10 19:08:18 bstore1 cinder-volume: 2016-07-10 19:08:18.100 5793 INFO oslo_service.service [req-74d43fcd-c4ec-4a37-8d27-033c2f2eb86e - - - - -] Starting 1 workers
Jul 10 19:08:18 bstore1 cinder-volume: 2016-07-10 19:08:18.123 5807 INFO cinder.service [-] Starting cinder-volume node (version 8.0.0)
Jul 10 19:08:18 bstore1 cinder-volume: 2016-07-10 19:08:18.149 5807 INFO cinder.volume.manager [req-41ea7a90-0c1f-4dbe-8b1e-e35db3ba11a4 - - - - -] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 10 19:08:19 bstore1 cinder-volume: 2016-07-10 19:08:19.882 5807 INFO cinder.volume.manager [req-41ea7a90-0c1f-4dbe-8b1e-e35db3ba11a4 - - - - -] Driver initialization completed successfully.
Jul 10 19:08:20 bstore1 cinder-volume: 2016-07-10 19:08:20.017 5807 INFO cinder.volume.manager [req-41ea7a90-0c1f-4dbe-8b1e-e35db3ba11a4 - - - - -] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 10 19:08:20 bstore1 cinder-volume: 2016-07-10 19:08:20.516 5807 INFO cinder.volume.manager [req-41ea7a90-0c1f-4dbe-8b1e-e35db3ba11a4 - - - - -] Driver post RPC initialization completed successfully.
Also the controller now correctly shows up the status of the both the openstack-cinder-scheduler running on the controller server (controller1.example.com for me) and the cinder server (bstore1.example.com for me).
[root@controller1 ~]# cinder service-list
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
| Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
| cinder-scheduler | controller1.example.com | nova | enabled | up | 2016-07-10T23:10:40.000000 | - |
| cinder-volume | bstore1.example.com@lvm | nova | enabled | up | 2016-07-10T23:10:40.000000 | - |
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
[root@controller1 ~]#
Fix by installation of python-kyestone on the cinder server.
Scenario:
As per the Mitaka installation guide on CentOS7 Controller and the cinder had been separate servers. After the cinder configuration parts on the controller as well as the cinder servers, the cinder service-list on the controller shows only the cinder scheduler running on controller and the cinder-volume running on the cinder server is not seen.
[root@controller1 ~]# cinder service-list
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
| Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
| cinder-scheduler | controller1.example.com | nova | enabled | up | 2016-07-10T22:05:35.000000 | - |
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
[root@controller1 ~]#
Also the openstack-cinder-volume service on the cinder server keeps restarting by own with the following messages on the /var/log/messages on the cinder server.
ul 10 18:18:57 bstore1 cinder-volume: File "/usr/lib/python2.7/site-packages/cinder/volume/volume_types.py", line 31, in <module>
Jul 10 18:18:57 bstore1 cinder-volume: from cinder import quota
Jul 10 18:18:57 bstore1 cinder-volume: File "/usr/lib/python2.7/site-packages/cinder/quota.py", line 33, in <module>
Jul 10 18:18:57 bstore1 cinder-volume: from cinder import quota_utils
Jul 10 18:18:57 bstore1 cinder-volume: File "/usr/lib/python2.7/site-packages/cinder/quota_utils.py", line 31, in <module>
Jul 10 18:18:57 bstore1 cinder-volume: 'keystone_authtoken')
Jul 10 18:18:57 bstore1 cinder-volume: File "/usr/lib/python2.7/site-packages/oslo_config/cfg.py", line 2357, in import_opt
Jul 10 18:18:57 bstore1 cinder-volume: __import__(module_str)
Jul 10 18:18:57 bstore1 cinder-volume: ImportError: No module named keystonemiddleware.auth_token.__init__
Jul 10 18:18:58 bstore1 systemd: openstack-cinder-volume.service: main process exited, code=exited, status=1/FAILURE
Jul 10 18:18:58 bstore1 systemd: Unit openstack-cinder-volume.service entered failed state.
Jul 10 18:18:58 bstore1 systemd: openstack-cinder-volume.service failed.
Jul 10 18:18:58 bstore1 systemd: openstack-cinder-volume.service holdoff time --------------
The FIX:
The fix was to install the python-kyestone RPM to get the things working.
Installed:
python-keystone.noarch 1:9.0.2-1.el7
Dependency Installed:
PyPAM.x86_64 0:0.5.0-19.el7
python-dogpile-cache.noarch 0:0.5.7-3.el7
python-dogpile-core.noarch 0:0.4.1-2.el7
python-keystonemiddleware.noarch 0:4.4.1-1.el7
python-ldap.x86_64 0:2.4.15-2.el7
python-ldappool.noarch 0:1.0-4.el7
python-memcached.noarch 0:1.54-3.el7
python-oauthlib.noarch 0:0.7.2-5.20150520git514cad7.el7
python-pycadf.noarch 0:2.1.0-1.el7
python-pysaml2.noarch 0:3.0.2-1.el7
python-repoze-who.noarch 0:2.1-1.el7
python-zope-interface.x86_64 0:4.0.5-4.el7
python2-oslo-cache.noarch 0:1.5.0-1.el7
python2-passlib.noarch 0:1.6.5-1.el7
Complete!
This successfully started the openstack-cinder-volume service on the cinder server.
This is the /var/log/messages on the cinder server post successful start of the openstack-cinder-volume server.
Jul 10 19:08:17 bstore1 cinder-volume: 2016-07-10 19:08:17.892 5793 INFO cinder.volume.manager [req-74d43fcd-c4ec-4a37-8d27-033c2f2eb86e - - - - -] Service not found for updating active_backend_id, assuming default for driver init.
Jul 10 19:08:18 bstore1 cinder-volume: 2016-07-10 19:08:18.095 5793 INFO cinder.volume.manager [req-74d43fcd-c4ec-4a37-8d27-033c2f2eb86e - - - - -] Image-volume cache disabled for host bstore1.example.com@lvm.
Jul 10 19:08:18 bstore1 cinder-volume: 2016-07-10 19:08:18.100 5793 INFO oslo_service.service [req-74d43fcd-c4ec-4a37-8d27-033c2f2eb86e - - - - -] Starting 1 workers
Jul 10 19:08:18 bstore1 cinder-volume: 2016-07-10 19:08:18.123 5807 INFO cinder.service [-] Starting cinder-volume node (version 8.0.0)
Jul 10 19:08:18 bstore1 cinder-volume: 2016-07-10 19:08:18.149 5807 INFO cinder.volume.manager [req-41ea7a90-0c1f-4dbe-8b1e-e35db3ba11a4 - - - - -] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 10 19:08:19 bstore1 cinder-volume: 2016-07-10 19:08:19.882 5807 INFO cinder.volume.manager [req-41ea7a90-0c1f-4dbe-8b1e-e35db3ba11a4 - - - - -] Driver initialization completed successfully.
Jul 10 19:08:20 bstore1 cinder-volume: 2016-07-10 19:08:20.017 5807 INFO cinder.volume.manager [req-41ea7a90-0c1f-4dbe-8b1e-e35db3ba11a4 - - - - -] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 10 19:08:20 bstore1 cinder-volume: 2016-07-10 19:08:20.516 5807 INFO cinder.volume.manager [req-41ea7a90-0c1f-4dbe-8b1e-e35db3ba11a4 - - - - -] Driver post RPC initialization completed successfully.
Also the controller now correctly shows up the status of the both the openstack-cinder-scheduler running on the controller server (controller1.example.com for me) and the cinder server (bstore1.example.com for me).
[root@controller1 ~]# cinder service-list
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
| Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
| cinder-scheduler | controller1.example.com | nova | enabled | up | 2016-07-10T23:10:40.000000 | - |
| cinder-volume | bstore1.example.com@lvm | nova | enabled | up | 2016-07-10T23:10:40.000000 | - |
+------------------+-------------------------+------+---------+-------+----------------------------+-----------------+
[root@controller1 ~]#
No comments:
Post a Comment