Project

Profile

Help

Actions
Send by e-mail Copy link

Issue #1377

closed

Two different kombu versions are shown in default vagrant environment

Added by bmbouter over 8 years ago. Updated over 3 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Assignee:
jcline@redhat.com
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Fedora 22
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

I install the vanilla vagrant as described here: https://github.com/pulp/pulp/blob/master/docs/dev-guide/contributing/dev_setup.rst

Then while in my vagrant environment, see two different versions of kombu installed. One with RPM and the other via pip. Consider this snippet:

[vagrant@dev ~]$ sudo rpm -qa | grep kombu
python-kombu-3.0.24-10.pulp.fc22.noarch
[vagrant@dev ~]$ pip freeze | grep kombu
You are using pip version 6.0.8, however version 7.1.2 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
kombu==3.0.29
[vagrant@dev ~]$ workon pulp
(pulp)[vagrant@dev pulp]$ pip freeze | grep kombu
You are using pip version 6.0.8, however version 7.1.2 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
kombu==3.0.29

I believe the 3.0.24 version from rpm is actually in use. Consider this snippet:

>>> import kombu
>>> kombu.__version__
'3.0.24'
Actions
Copy link
 #1

Updated by mhrivnak over 8 years ago

  • Triaged changed from No to Yes
Actions
Copy link
 #2

Updated by rbarlow over 8 years ago

  • Priority changed from Normal to High

I think it is not the 3.0.24 version that is in use actually, because I think the two versions have been installed into the same location, one overwriting the other. I believe this issue might be the true cause of the disappearing workers in the development environment. When I remove the python-kombu RPM, there are still lingering files from the pip install. I propose raising the priority on this, but I don't have time ATM to find out why this is happening. Check this weirdness out:

[vagrant@dev ~]$ rpm -qa | grep kombu
python-kombu-3.0.24-10.pulp.fc22.noarch
[vagrant@dev ~]$ python
Python 2.7.10 (default, Sep 24 2015, 17:50:09) 
[GCC 5.1.1 20150618 (Red Hat 5.1.1-4)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import kombu
>>> kombu.__version__
'3.0.24'
>>> kombu.__file__
'/usr/lib/python2.7/site-packages/kombu/__init__.pyc'
>>> 
[vagrant@dev ~]$ sudo pip install --uninstall kombu

Usage:   
  pip install [options] <requirement specifier> [package-index-options] ...
  pip install [options] -r <requirements file> [package-index-options] ...
  pip install [options] [-e] <vcs project url> ...
  pip install [options] [-e] <local project path> ...
  pip install [options] <archive url/path> ...

no such option: --uninstall
[vagrant@dev ~]$ sudo pip uninstall kombu
You are using pip version 6.0.8, however version 7.1.2 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Uninstalling kombu-3.0.29:
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/DESCRIPTION.rst
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/METADATA
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/RECORD
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/WHEEL
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/metadata.json
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/top_level.txt
  /usr/lib/python2.7/site-packages/kombu/__init__.py
  /usr/lib/python2.7/site-packages/kombu/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/abstract.py
  /usr/lib/python2.7/site-packages/kombu/abstract.pyc
  /usr/lib/python2.7/site-packages/kombu/async/__init__.py
  /usr/lib/python2.7/site-packages/kombu/async/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/async/debug.py
  /usr/lib/python2.7/site-packages/kombu/async/debug.pyc
  /usr/lib/python2.7/site-packages/kombu/async/hub.py
  /usr/lib/python2.7/site-packages/kombu/async/hub.pyc
  /usr/lib/python2.7/site-packages/kombu/async/semaphore.py
  /usr/lib/python2.7/site-packages/kombu/async/semaphore.pyc
  /usr/lib/python2.7/site-packages/kombu/async/timer.py
  /usr/lib/python2.7/site-packages/kombu/async/timer.pyc
  /usr/lib/python2.7/site-packages/kombu/clocks.py
  /usr/lib/python2.7/site-packages/kombu/clocks.pyc
  /usr/lib/python2.7/site-packages/kombu/common.py
  /usr/lib/python2.7/site-packages/kombu/common.pyc
  /usr/lib/python2.7/site-packages/kombu/compat.py
  /usr/lib/python2.7/site-packages/kombu/compat.pyc
  /usr/lib/python2.7/site-packages/kombu/compression.py
  /usr/lib/python2.7/site-packages/kombu/compression.pyc
  /usr/lib/python2.7/site-packages/kombu/connection.py
  /usr/lib/python2.7/site-packages/kombu/connection.pyc
  /usr/lib/python2.7/site-packages/kombu/entity.py
  /usr/lib/python2.7/site-packages/kombu/entity.pyc
  /usr/lib/python2.7/site-packages/kombu/exceptions.py
  /usr/lib/python2.7/site-packages/kombu/exceptions.pyc
  /usr/lib/python2.7/site-packages/kombu/five.py
  /usr/lib/python2.7/site-packages/kombu/five.pyc
  /usr/lib/python2.7/site-packages/kombu/log.py
  /usr/lib/python2.7/site-packages/kombu/log.pyc
  /usr/lib/python2.7/site-packages/kombu/message.py
  /usr/lib/python2.7/site-packages/kombu/message.pyc
  /usr/lib/python2.7/site-packages/kombu/messaging.py
  /usr/lib/python2.7/site-packages/kombu/messaging.pyc
  /usr/lib/python2.7/site-packages/kombu/mixins.py
  /usr/lib/python2.7/site-packages/kombu/mixins.pyc
  /usr/lib/python2.7/site-packages/kombu/pidbox.py
  /usr/lib/python2.7/site-packages/kombu/pidbox.pyc
  /usr/lib/python2.7/site-packages/kombu/pools.py
  /usr/lib/python2.7/site-packages/kombu/pools.pyc
  /usr/lib/python2.7/site-packages/kombu/serialization.py
  /usr/lib/python2.7/site-packages/kombu/serialization.pyc
  /usr/lib/python2.7/site-packages/kombu/simple.py
  /usr/lib/python2.7/site-packages/kombu/simple.pyc
  /usr/lib/python2.7/site-packages/kombu/syn.py
  /usr/lib/python2.7/site-packages/kombu/syn.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/__init__.py
  /usr/lib/python2.7/site-packages/kombu/tests/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/async/__init__.py
  /usr/lib/python2.7/site-packages/kombu/tests/async/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/async/test_hub.py
  /usr/lib/python2.7/site-packages/kombu/tests/async/test_hub.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/async/test_semaphore.py
  /usr/lib/python2.7/site-packages/kombu/tests/async/test_semaphore.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/case.py
  /usr/lib/python2.7/site-packages/kombu/tests/case.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/mocks.py
  /usr/lib/python2.7/site-packages/kombu/tests/mocks.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_clocks.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_clocks.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_common.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_common.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_compat.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_compat.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_compression.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_compression.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_connection.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_connection.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_entities.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_entities.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_log.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_log.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_messaging.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_messaging.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_mixins.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_mixins.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_pidbox.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_pidbox.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_pools.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_pools.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_serialization.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_serialization.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_simple.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_simple.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/test_syn.py
  /usr/lib/python2.7/site-packages/kombu/tests/test_syn.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/__init__.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_SQS.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_SQS.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_amqplib.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_amqplib.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_base.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_base.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_filesystem.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_filesystem.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_librabbitmq.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_librabbitmq.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_memory.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_memory.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_mongodb.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_mongodb.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_pyamqp.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_pyamqp.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_qpid.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_qpid.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_redis.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_redis.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_sqlalchemy.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_sqlalchemy.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_transport.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/test_transport.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/virtual/__init__.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/virtual/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/virtual/test_base.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/virtual/test_base.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/virtual/test_exchange.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/virtual/test_exchange.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/transport/virtual/test_scheduling.py
  /usr/lib/python2.7/site-packages/kombu/tests/transport/virtual/test_scheduling.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/utils/__init__.py
  /usr/lib/python2.7/site-packages/kombu/tests/utils/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/utils/test_amq_manager.py
  /usr/lib/python2.7/site-packages/kombu/tests/utils/test_amq_manager.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/utils/test_debug.py
  /usr/lib/python2.7/site-packages/kombu/tests/utils/test_debug.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/utils/test_encoding.py
  /usr/lib/python2.7/site-packages/kombu/tests/utils/test_encoding.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/utils/test_functional.py
  /usr/lib/python2.7/site-packages/kombu/tests/utils/test_functional.pyc
  /usr/lib/python2.7/site-packages/kombu/tests/utils/test_utils.py
  /usr/lib/python2.7/site-packages/kombu/tests/utils/test_utils.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/SLMQ.py
  /usr/lib/python2.7/site-packages/kombu/transport/SLMQ.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/SQS.py
  /usr/lib/python2.7/site-packages/kombu/transport/SQS.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/__init__.py
  /usr/lib/python2.7/site-packages/kombu/transport/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/amqplib.py
  /usr/lib/python2.7/site-packages/kombu/transport/amqplib.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/base.py
  /usr/lib/python2.7/site-packages/kombu/transport/base.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/beanstalk.py
  /usr/lib/python2.7/site-packages/kombu/transport/beanstalk.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/couchdb.py
  /usr/lib/python2.7/site-packages/kombu/transport/couchdb.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/django/__init__.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/django/management/__init__.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/management/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/django/management/commands/__init__.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/management/commands/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/django/management/commands/clean_kombu_messages.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/management/commands/clean_kombu_messages.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/django/managers.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/managers.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/django/migrations/0001_initial.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/migrations/0001_initial.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/django/migrations/__init__.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/migrations/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/django/models.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/models.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/django/south_migrations/0001_initial.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/south_migrations/0001_initial.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/django/south_migrations/__init__.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/south_migrations/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/filesystem.py
  /usr/lib/python2.7/site-packages/kombu/transport/filesystem.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/librabbitmq.py
  /usr/lib/python2.7/site-packages/kombu/transport/librabbitmq.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/memory.py
  /usr/lib/python2.7/site-packages/kombu/transport/memory.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/mongodb.py
  /usr/lib/python2.7/site-packages/kombu/transport/mongodb.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/pyamqp.py
  /usr/lib/python2.7/site-packages/kombu/transport/pyamqp.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/pyro.py
  /usr/lib/python2.7/site-packages/kombu/transport/pyro.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/qpid.py
  /usr/lib/python2.7/site-packages/kombu/transport/qpid.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/redis.py
  /usr/lib/python2.7/site-packages/kombu/transport/redis.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/sqlalchemy/__init__.py
  /usr/lib/python2.7/site-packages/kombu/transport/sqlalchemy/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/sqlalchemy/models.py
  /usr/lib/python2.7/site-packages/kombu/transport/sqlalchemy/models.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/virtual/__init__.py
  /usr/lib/python2.7/site-packages/kombu/transport/virtual/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/virtual/exchange.py
  /usr/lib/python2.7/site-packages/kombu/transport/virtual/exchange.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/virtual/scheduling.py
  /usr/lib/python2.7/site-packages/kombu/transport/virtual/scheduling.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/zmq.py
  /usr/lib/python2.7/site-packages/kombu/transport/zmq.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/zookeeper.py
  /usr/lib/python2.7/site-packages/kombu/transport/zookeeper.pyc
  /usr/lib/python2.7/site-packages/kombu/utils/__init__.py
  /usr/lib/python2.7/site-packages/kombu/utils/__init__.pyc
  /usr/lib/python2.7/site-packages/kombu/utils/amq_manager.py
  /usr/lib/python2.7/site-packages/kombu/utils/amq_manager.pyc
  /usr/lib/python2.7/site-packages/kombu/utils/compat.py
  /usr/lib/python2.7/site-packages/kombu/utils/compat.pyc
  /usr/lib/python2.7/site-packages/kombu/utils/debug.py
  /usr/lib/python2.7/site-packages/kombu/utils/debug.pyc
  /usr/lib/python2.7/site-packages/kombu/utils/encoding.py
  /usr/lib/python2.7/site-packages/kombu/utils/encoding.pyc
  /usr/lib/python2.7/site-packages/kombu/utils/eventio.py
  /usr/lib/python2.7/site-packages/kombu/utils/eventio.pyc
  /usr/lib/python2.7/site-packages/kombu/utils/functional.py
  /usr/lib/python2.7/site-packages/kombu/utils/functional.pyc
  /usr/lib/python2.7/site-packages/kombu/utils/limits.py
  /usr/lib/python2.7/site-packages/kombu/utils/limits.pyc
  /usr/lib/python2.7/site-packages/kombu/utils/text.py
  /usr/lib/python2.7/site-packages/kombu/utils/text.pyc
  /usr/lib/python2.7/site-packages/kombu/utils/url.py
  /usr/lib/python2.7/site-packages/kombu/utils/url.pyc
Proceed (y/n)? n
[vagrant@dev ~]$ sudo dnf remove kombu
No match for argument: kombu
Error: No packages marked for removal.
[vagrant@dev ~]$ sudo dnf remove python-kombu
Dependencies resolved.
=====================================================================================================================
 Package                     Arch               Version                             Repository                  Size
=====================================================================================================================
Removing:
 pyparsing                   noarch             2.0.3-1.fc22                        @fedora                    385 k
 python-amqp                 noarch             1.4.6-1.fc22                        @fedora                    391 k
 python-anyjson              noarch             0.3.3-6.fc21                        @fedora                     18 k
 python-billiard             x86_64             1:3.3.0.19-1.fc22                   @fedora                    775 k
 python-celery               noarch             3.1.11-1.fc22                       @pulp-2-stable             5.7 M
 python-kombu                noarch             1:3.0.24-10.pulp.fc22               @pulp-2-stable             2.3 M

Transaction Summary
=====================================================================================================================
Remove  6 Packages

Installed size: 9.5 M
Is this ok [y/N]: y
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Erasing     : python-celery-3.1.11-1.fc22.noarch                                                               1/6 
  Erasing     : python-kombu-1:3.0.24-10.pulp.fc22.noarch                                                        2/6 
  Erasing     : python-amqp-1.4.6-1.fc22.noarch                                                                  3/6 
  Erasing     : python-anyjson-0.3.3-6.fc21.noarch                                                               4/6 
  Erasing     : pyparsing-2.0.3-1.fc22.noarch                                                                    5/6 
  Erasing     : python-billiard-1:3.3.0.19-1.fc22.x86_64                                                         6/6 
  Verifying   : python-billiard-1:3.3.0.19-1.fc22.x86_64                                                         1/6 
  Verifying   : python-kombu-1:3.0.24-10.pulp.fc22.noarch                                                        2/6 
  Verifying   : python-celery-3.1.11-1.fc22.noarch                                                               3/6 
  Verifying   : pyparsing-2.0.3-1.fc22.noarch                                                                    4/6 
  Verifying   : python-amqp-1.4.6-1.fc22.noarch                                                                  5/6 
  Verifying   : python-anyjson-0.3.3-6.fc21.noarch                                                               6/6 

Removed:
  pyparsing.noarch 2.0.3-1.fc22                         python-amqp.noarch 1.4.6-1.fc22                             
  python-anyjson.noarch 0.3.3-6.fc21                    python-billiard.x86_64 1:3.3.0.19-1.fc22                    
  python-celery.noarch 3.1.11-1.fc22                    python-kombu.noarch 1:3.0.24-10.pulp.fc22                   

Complete!
[vagrant@dev ~]$ sudo pip uninstall kombu
You are using pip version 6.0.8, however version 7.1.2 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Uninstalling kombu-3.0.29:
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/DESCRIPTION.rst
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/METADATA
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/RECORD
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/WHEEL
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/metadata.json
  /usr/lib/python2.7/site-packages/kombu-3.0.29.dist-info/top_level.txt
  /usr/lib/python2.7/site-packages/kombu/transport/django/south_migrations/0001_initial.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/south_migrations/0001_initial.pyc
  /usr/lib/python2.7/site-packages/kombu/transport/django/south_migrations/__init__.py
  /usr/lib/python2.7/site-packages/kombu/transport/django/south_migrations/__init__.pyc
Proceed (y/n)? y
  Successfully uninstalled kombu-3.0.29
Actions
Copy link
 #3

Updated by rbarlow over 8 years ago

Until this is fixed, I believe a workaround is to do this:

$ sudo dnf remove python-kombu
$ sudo pip uninstall kombu
$ sudo dnf install python-kombu
$ prestart
Actions
Copy link
 #4

Updated by rbarlow over 8 years ago

After a while, my workers still went missing so I do not believe this is the cause of the missing workers in the development environment. However, I do believe that it is Very Bad™ that pip and dnf are installing different versions of kombu to the same place so I think we should leave this ticket at high priority so that doesn't bite anyone.

Actions
Copy link
 #5

Updated by rbarlow over 8 years ago

This is happening with Celery as well:

$ pip freeze | grep celery
You are using pip version 6.0.8, however version 7.1.2 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
celery==3.1.19
[vagrant@dev ~]$ rpm -q python-celery
python-celery-3.1.11-1.fc22.noarch

I believe that somehow it is Celery that is bringing in the pip version of kombu, but I still don't know why Celery is being pip installed instead of dnf installed.

Actions
Copy link
 #6

Updated by bmbouter over 8 years ago

Could it be that celery/kombu are being brought in as pip dependencies of flower?

Actions
Copy link
 #7

Updated by rbarlow over 8 years ago

Pulp wrote:

Could it be that celery/kombu are being brought in as pip dependencies
of flower?

That sounds like a strong possibility! If flower requires a different
version that the rpm is providing, I believe it would get pip installed.

It seems that there is not an rpm for flower. We should package it for
Fedora!

--
Randy Barlow
irc: bowlofeggs
phone: +1-919-890-8150

Actions
Copy link
 #8

Updated by bmbouter over 8 years ago

I've proven on my system that heartbeats effectively stop when the newer celery/kombu is pip installed over the dnf installed packages in the vagrant environment.

1) the worker-online events occur when the workers start up with duplicate packages and without
2) This creates a record in db.workers, however due to a timezone issue (separate problem) it these records are created far in the future
3) which causes them to not get noticed that heartbeats are not occurring until 65 minutes later

Fixing the timezone problem is a separate issue, but for this someone needs to either rip flower out of the vagrant install or install configure vagrant to install it such that it doesn't pip install over the dnf dependencies that pulp installs normally.

When I remove the pip installed celery, kombu, and flower, and ensure dnf installed python-celery and python-kombu then the heartbeats work as expected.

Added by Jeremy Cline over 8 years ago

Revision 8cc64c3c | View on GitHub

Remove flower from the vagrant environment.

closes #1377

Added by Jeremy Cline over 8 years ago

Revision 8cc64c3c | View on GitHub

Remove flower from the vagrant environment.

closes #1377

Actions
Copy link
 #9

Updated by jcline@redhat.com over 8 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to jcline@redhat.com
Actions
Copy link
 #11

Updated by jcline@redhat.com over 8 years ago

  • Status changed from ASSIGNED to MODIFIED
Actions
Copy link
 #12

Updated by bmbouter over 8 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE
Actions
Copy link
 #13

Updated by bmbouter about 5 years ago

  • Tags Pulp 2 added
Actions
Send by e-mail Copy link

Also available in: Atom PDF