Project

Profile

Help

Actions
Send by e-mail Copy link

Issue #1006

closed

Pulp server REST API status call causes a kombu connection exception to appear in the logs each 10s

Added by mkovacik@redhat.com almost 9 years ago. Updated about 5 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
bmbouter
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
2.6.2 Beta
Platform Release:
2.7.0
OS:
RHEL 6
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

This seems to be caused by call to pulp/server/managers/status.py:get_broker_conn_status as when I by-pass its block by directly returning {'connected': True} I can't reproduce the issue anymore.
Please note there's no exception thrown while in the connection block --- at least I'm not able to catch one explicitly.

def get_broker_conn_status():
    """     
    :returns:          message broker connection status                                               
    :rtype:            bool                                                                           
    """                                                                                               
    # not all drivers support heartbeats. For now, we need to make an                                 
    # explicit connection and then release it.                                                        
    # See https://github.com/celery/kombu/issues/432 for more detail.
    try:
        conn = celery.connection()                                                                    
        conn.connect()                                                                                
        conn.release()
        return {'connected': True}
    except:
        # if the above was not successful for any reason, return False                                
        return {'connected': False}

Reproducer screen log:

[root@ip-172-31-20-145 ~]# curl -k https://admin:admin@localhost/pulp/api/v2/status/ | python -mjson.tool
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
110   662  110   662    0     0    591      0  0:00:01  0:00:01 --:--:--   632
{
    "api_version": "2",
    "database_connection": {
        "connected": true
    },
    "known_workers": [
        {
            "last_heartbeat": "2015-05-27T16:25:36Z",
            "name": "scheduler@ip-172-31-20-145.eu-central-1.compute.internal"
        },
        {
            "last_heartbeat": "2015-05-27T16:27:04Z",
            "name": "reserved_resource_worker-0@ip-172-31-20-145.eu-central-1.compute.internal"
        },
        {
            "last_heartbeat": "2015-05-27T16:27:03Z",
            "name": "reserved_resource_worker-1@ip-172-31-20-145.eu-central-1.compute.internal"
        },
        {
            "last_heartbeat": "2015-05-27T16:27:04Z",
            "name": "resource_manager@ip-172-31-20-145.eu-central-1.compute.internal"
        }
    ],
    "messaging_connection": {
        "connected": true
    },
    "versions": {
        "platform_version": "2.6.2b2"
    }
}
[root@ip-172-31-20-145 ~]# fg
vim /usr/lib/python2.6/site-packages/pulp/server/managers/status.py

[1]+  Stopped                 vim /usr/lib/python2.6/site-packages/pulp/server/managers/status.py
[root@ip-172-31-20-145 ~]# service httpd restart
Stopping httpd:                                            [  OK  ]
Starting httpd:                                            [  OK  ]
[root@ip-172-31-20-145 ~]# curl -k https://admin:admin@localhost/pulp/api/v2/status/ | python -mjson.tool
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
110   662  110   662    0     0   5579      0 --:--:-- --:--:-- --:--:-- 14711
{
    "api_version": "2",
    "database_connection": {
        "connected": true
    },
    "known_workers": [
        {
            "last_heartbeat": "2015-05-27T16:27:06Z",
            "name": "scheduler@ip-172-31-20-145.eu-central-1.compute.internal"
        },
        {
            "last_heartbeat": "2015-05-27T16:27:22Z",
            "name": "reserved_resource_worker-0@ip-172-31-20-145.eu-central-1.compute.internal"
        },
        {
            "last_heartbeat": "2015-05-27T16:27:21Z",
            "name": "reserved_resource_worker-1@ip-172-31-20-145.eu-central-1.compute.internal"
        },
        {
            "last_heartbeat": "2015-05-27T16:27:22Z",
            "name": "resource_manager@ip-172-31-20-145.eu-central-1.compute.internal"
        }
    ],
    "messaging_connection": {
        "connected": true
    },
    "versions": {
        "platform_version": "2.6.2b2"
    }
}
[root@ip-172-31-20-145 ~]# sleep 20 ; tail -60 /var/log/messages
May 27 12:27:33 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self.check_closed()
May 27 12:27:33 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 586, in check_closed
May 27 12:27:33 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     raise SessionClosed()
May 27 12:27:33 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) SessionClosed: None
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) None
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) Traceback (most recent call last):
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1393, in run
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self.monitor_receivers()
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1409, in monitor_receivers
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self._session.next_receiver()
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "<string>", line 6, in next_receiver
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 674, in next_receiver
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     if self._ecwait(lambda: self.incoming, timeout):
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 51, in _ecwait
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self.check_closed()
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 586, in check_closed
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     raise SessionClosed()
May 27 12:27:43 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) SessionClosed: None
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) None
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) Traceback (most recent call last):
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1393, in run
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self.monitor_receivers()
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1409, in monitor_receivers
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self._session.next_receiver()
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "<string>", line 6, in next_receiver
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 674, in next_receiver
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     if self._ecwait(lambda: self.incoming, timeout):
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 51, in _ecwait
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self.check_closed()
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 586, in check_closed
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     raise SessionClosed()
May 27 12:27:53 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) SessionClosed: None
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) None
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) Traceback (most recent call last):
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1393, in run
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self.monitor_receivers()
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1409, in monitor_receivers
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self._session.next_receiver()
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "<string>", line 6, in next_receiver
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 674, in next_receiver
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     if self._ecwait(lambda: self.incoming, timeout):
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 51, in _ecwait
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self.check_closed()
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 586, in check_closed
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     raise SessionClosed()
May 27 12:28:03 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) SessionClosed: None
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) None
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) Traceback (most recent call last):
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1393, in run
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self.monitor_receivers()
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1409, in monitor_receivers
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self._session.next_receiver()
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "<string>", line 6, in next_receiver
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 674, in next_receiver
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     if self._ecwait(lambda: self.incoming, timeout):
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 51, in _ecwait
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     self.check_closed()
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 586, in check_closed
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288)     raise SessionClosed()
May 27 12:28:13 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11039-92288) SessionClosed: None
[root@ip-172-31-20-145 ~]# service httpd restart
Stopping httpd:                                            [  OK  ]
Starting httpd:                                            [  OK  ]
[root@ip-172-31-20-145 ~]# sleep 20 ; tail -60 /var/log/messages
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin puppet_whole_repo_profiler for types: puppet_module
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum_profiler for types: rpm,erratum
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum for types: rpm
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin puppet_install_distributor for types: puppet_module
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin rhui for types: rpm
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin docker_distributor_web for types: docker_image
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin docker_distributor_export for types: docker_image
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum_distributor for types: rpm,srpm,drpm,erratum,package_group,package_category,distribution,yum_repo_metadata_file
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin export_distributor for types: rpm,srpm,drpm,erratum,distribution,package_category,package_group
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin iso_distributor for types: iso
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin group_export_distributor for types: rpm,srpm,drpm,erratum,distribution,package_category,package_group
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin python_importer for types: python_package
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connecting: URL: tcp://localhost|SSL: ca: /etc/pki/qpid/ca/ca.crt|key: None|certificate: /etc/pki/qpid/client/client.pem|host-validation: False
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin puppet_importer for types: puppet_module
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin docker_importer for types: docker_image
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum_importer for types: distribution,drpm,erratum,package_group,package_category,rpm,srpm,yum_repo_metadata_file,package_environment
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin iso_importer for types: iso
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin puppet_whole_repo_profiler for types: puppet_module
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum_profiler for types: rpm,erratum
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum for types: rpm
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin rhui for types: rpm
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connected: tcp://localhost
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connecting: URL: tcp://localhost|SSL: ca: /etc/pki/qpid/ca/ca.crt|key: None|certificate: /etc/pki/qpid/client/client.pem|host-validation: False
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.agent.direct.services:INFO: Task reply handler, started.
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.agent.direct.services:INFO: AMQP reply handler started
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: *************************************************************
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: The Pulp server has been successfully initialized
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: *************************************************************
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connected: tcp://localhost
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connecting: URL: tcp://localhost|SSL: ca: /etc/pki/qpid/ca/ca.crt|key: None|certificate: /etc/pki/qpid/client/client.pem|host-validation: False
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connected: tcp://localhost
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.agent.direct.services:INFO: Task reply handler, started.
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.agent.direct.services:INFO: AMQP reply handler started
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: *************************************************************
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: The Pulp server has been successfully initialized
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: *************************************************************
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connecting: URL: tcp://localhost|SSL: ca: /etc/pki/qpid/ca/ca.crt|key: None|certificate: /etc/pki/qpid/client/client.pem|host-validation: False
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connected: tcp://localhost
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum_distributor for types: rpm,srpm,drpm,erratum,package_group,package_category,distribution,yum_repo_metadata_file
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin export_distributor for types: rpm,srpm,drpm,erratum,distribution,package_category,package_group
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin iso_distributor for types: iso
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin group_export_distributor for types: rpm,srpm,drpm,erratum,distribution,package_category,package_group
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin python_importer for types: python_package
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin puppet_importer for types: puppet_module
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin docker_importer for types: docker_image
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum_importer for types: distribution,drpm,erratum,package_group,package_category,rpm,srpm,yum_repo_metadata_file,package_environment
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin iso_importer for types: iso
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin puppet_whole_repo_profiler for types: puppet_module
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum_profiler for types: rpm,erratum
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum for types: rpm
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin rhui for types: rpm
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connecting: URL: tcp://localhost|SSL: ca: /etc/pki/qpid/ca/ca.crt|key: None|certificate: /etc/pki/qpid/client/client.pem|host-validation: False
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connected: tcp://localhost
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connecting: URL: tcp://localhost|SSL: ca: /etc/pki/qpid/ca/ca.crt|key: None|certificate: /etc/pki/qpid/client/client.pem|host-validation: False
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.agent.direct.services:INFO: Task reply handler, started.
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.agent.direct.services:INFO: AMQP reply handler started
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: *************************************************************
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: The Pulp server has been successfully initialized
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: *************************************************************
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connected: tcp://localhost
[root@ip-172-31-20-145 ~]# curl -k https://admin:admin@localhost/pulp/api/v2/status/ | python -mjson.tool
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
110   662  110   662    0     0   5633      0 --:--:-- --:--:-- --:--:-- 15045
{
    "api_version": "2",
    "database_connection": {
        "connected": true
    },
    "known_workers": [
        {
            "last_heartbeat": "2015-05-27T16:28:36Z",
            "name": "scheduler@ip-172-31-20-145.eu-central-1.compute.internal"
        },
        {
            "last_heartbeat": "2015-05-27T16:28:56Z",
            "name": "reserved_resource_worker-0@ip-172-31-20-145.eu-central-1.compute.internal"
        },
        {
            "last_heartbeat": "2015-05-27T16:28:55Z",
            "name": "reserved_resource_worker-1@ip-172-31-20-145.eu-central-1.compute.internal"
        },
        {
            "last_heartbeat": "2015-05-27T16:28:56Z",
            "name": "resource_manager@ip-172-31-20-145.eu-central-1.compute.internal"
        }
    ],
    "messaging_connection": {
        "connected": true
    },
    "versions": {
        "platform_version": "2.6.2b2"
    }
}
[root@ip-172-31-20-145 ~]# sleep 20 ; tail -60 /var/log/messages
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin docker_importer for types: docker_image
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum_importer for types: distribution,drpm,erratum,package_group,package_category,rpm,srpm,yum_repo_metadata_file,package_environment
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin iso_importer for types: iso
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin puppet_whole_repo_profiler for types: puppet_module
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum_profiler for types: rpm,erratum
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin yum for types: rpm
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.plugins.loader.manager:INFO: Loaded plugin rhui for types: rpm
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connecting: URL: tcp://localhost|SSL: ca: /etc/pki/qpid/ca/ca.crt|key: None|certificate: /etc/pki/qpid/client/client.pem|host-validation: False
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connected: tcp://localhost
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connecting: URL: tcp://localhost|SSL: ca: /etc/pki/qpid/ca/ca.crt|key: None|certificate: /etc/pki/qpid/client/client.pem|host-validation: False
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.agent.direct.services:INFO: Task reply handler, started.
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.agent.direct.services:INFO: AMQP reply handler started
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: *************************************************************
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: The Pulp server has been successfully initialized
May 27 12:28:26 ip-172-31-20-145 pulp: pulp.server.webservices.application:INFO: *************************************************************
May 27 12:28:26 ip-172-31-20-145 pulp: gofer.messaging.adapter.qpid.connection:INFO: connected: tcp://localhost
May 27 12:28:57 ip-172-31-20-145 pulp: pulp.server.managers.status:WARNING: >>STATUS
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism ANONYMOUS
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640) None
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640) Traceback (most recent call last):
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1393, in run
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     self.monitor_receivers()
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1409, in monitor_receivers
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     self._session.next_receiver()
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "<string>", line 6, in next_receiver
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 674, in next_receiver
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     if self._ecwait(lambda: self.incoming, timeout):
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 51, in _ecwait
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     self.check_closed()
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 586, in check_closed
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     raise SessionClosed()
May 27 12:28:57 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640) SessionClosed: None
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640) None
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640) Traceback (most recent call last):
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1393, in run
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     self.monitor_receivers()
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1409, in monitor_receivers
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     self._session.next_receiver()
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "<string>", line 6, in next_receiver
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 674, in next_receiver
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     if self._ecwait(lambda: self.incoming, timeout):
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 51, in _ecwait
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     self.check_closed()
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 586, in check_closed
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     raise SessionClosed()
May 27 12:29:07 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640) SessionClosed: None
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640) None
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640) Traceback (most recent call last):
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1393, in run
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     self.monitor_receivers()
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/kombu/transport/qpid.py", line 1409, in monitor_receivers
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     self._session.next_receiver()
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "<string>", line 6, in next_receiver
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 674, in next_receiver
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     if self._ecwait(lambda: self.incoming, timeout):
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 51, in _ecwait
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     self.check_closed()
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)   File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 586, in check_closed
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640)     raise SessionClosed()
May 27 12:29:17 ip-172-31-20-145 pulp: kombu.transport.qpid:ERROR: (11172-28640) SessionClosed: None
[root@ip-172-31-20-145 ~]#

Related issues

Related to Pulp - Issue #917: qpid errors are logged during repo sync when task notifications are enabledCLOSED - CURRENTRELEASEbmbouterActions
Actions
Send by e-mail Copy link

Also available in: Atom PDF