Pulp: Issues
https://pulp.plan.io/
https://pulp.plan.io/favicon.ico
2015-06-29T18:00:24Z
Pulp
Planio
Pulp - Issue #1095 (CLOSED - NOTABUG): publish-type event handlers called twice with a wildcard r...
https://pulp.plan.io/issues/1095
2015-06-29T18:00:24Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>A wildcard-type http event listener gets triggered 6 times in total instead of 4 until its repo sync&publish tasks finish.</p>
<p>How reproducible:<br>
Always</p>
<p>Steps to reproduce:</p>
<ul>
<li>"clone" zoo repo</li>
<li>create a <a href="http://requestb.in" class="external">requestb.in</a> event listener callee</li>
<li>create a wildcard-type pulp event listener registered to the requestb.in</li>
<li>trigger sync&publish on the repo</li>
<li>inspect the requestb.in status</li>
</ul>
<p>Actual Result:<br>
Publish event types are triggered/POSTed twice:</p>
<ul>
<li>repo.publish.start</li>
<li>repo.publish.finish</li>
</ul>
<p>Expected Result:</p>
<ul>
<li>publish event types are triggered/POSTed only once per repo publish task call</li>
</ul>
<p>See also:</p>
<ul>
<li><a href="https://github.com/RedHatQE/pulp-automation/blob/master/tests/general_tests/test_23_event_listener.py#L194" class="external">automation test case</a></li>
</ul>
<hr>
<p><em>Logs analysis</em><br>
Test case failure is caused by assertion violation of the count of performed event listener requestbin callbacks (task call reports) on <a href="https://github.com/RedHatQE/pulp-automation/blob/master/tests/general_tests/test_23_event_listener.py#L211" class="external">line nr. 211</a></p>
<p><code>[mkovacik@zrnko pulp-automation]$ nosetests -vs tests/general_tests/test_23_event_listener.py:EventListenerTest.test_06_wildcard_events</code></p>
<pre><code>test_06_wildcard_events (tests.general_tests.test_23_event_listener.EventListenerTest) ... FAIL
======================================================================
FAIL: test_06_wildcard_events (tests.general_tests.test_23_event_listener.EventListenerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/mkovacik/src/pulp-automation/tests/general_tests/test_23_event_listener.py", line 212, in test_06_wildcard_events
self.bin.request_count
AssertionError: invalid event listener request count: 6
-------------------- >> begin captured logging << --------------------
requests.packages.urllib3.util.retry: DEBUG: Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None)
requests.packages.urllib3.util.retry: DEBUG: Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None)
requests.packages.urllib3.util.retry: DEBUG: Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None)
requests.packages.urllib3.connectionpool: INFO: Starting new HTTPS connection (1): ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "POST /pulp/api/v2/repositories/ HTTP/1.1" 201 328
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('POST', '/repositories/', data='{"notes": {"_repo-type": "rpm-repo"}, "display_name": "ZOo rEPO", "description": null, "id": "EventListenerRepo"}', headers={'content-type': 'application/json'})) == <Response [201]>
pulp_auto.item: DEBUG: <class 'pulp_auto.repo.Repo'>.from_response(<Response [201]>) == Repo({u'scratchpad': {}, u'display_name': u'ZOo rEPO', u'description': None, u'last_unit_added': None, u'notes': {u'_repo-type': u'rpm-repo'}, u'last_unit_removed': None, u'content_unit_counts': {}, u'_ns': u'repos', u'_id': {u'': u'55918231cc235129ae6385f6'}, u'id': u'EventListenerRepo', u'_href': u'/pulp/api/v2/repositories/EventListenerRepo/'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "POST /pulp/api/v2/repositories/EventListenerRepo/importers/ HTTP/1.1" 202 172
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('POST', u'/repositories/EventListenerRepo/importers/', data='{"importer_type_id": "yum_importer", "importer_config": {"feed": "https://repos.fedorapeople.org/repos/pulp/pulp/demo_repos/zoo/", "proxy_port": 3128, "proxy_username": "squid", "proxy_host": "https://ip-172-31-26-58.eu-central-1.compute.internal", "ssl_validation": false, "proxy_password": "squid"}, "id": "yum_importer"}', headers={'content-type': 'application/json'})) == <Response [202]>
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/658386db-7922-4b8a-85a4-194739ec3664/ HTTP/1.1" 200 1166
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/658386db-7922-4b8a-85a4-194739ec3664/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.importer.set_importer', u'_href': u'/pulp/api/v2/tasks/658386db-7922-4b8a-85a4-194739ec3664/', u'task_id': u'658386db-7922-4b8a-85a4-194739ec3664', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:add_importer'], u'finish_time': u'2015-06-29T17:36:49Z', u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:49Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'finished', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': {u'scratchpad': None, u'_ns': u'repo_importers', u'importer_type_id': u'yum_importer', u'last_sync': None, u'scheduled_syncs': [], u'repo_id': u'EventListenerRepo', u'_id': {u'': u'55918231cc23512979c0e599'}, u'config': {u'feed': u'https://repos.fedorapeople.org/repos/pulp/pulp/demo_repos/zoo/', u'proxy_host': u'https://ip-172-31-26-58.eu-central-1.compute.internal', u'ssl_validation': False, u'proxy_password': u'squid', u'proxy_port': 3128, u'proxy_username': u'squid'}, u'id': u'yum_importer'}, u'error': None, u'_id': {u'': u'559182318e6334edd786a276'}, u'id': u'559182312d8a1208274ecee5'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/658386db-7922-4b8a-85a4-194739ec3664/ HTTP/1.1" 200 1166
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/658386db-7922-4b8a-85a4-194739ec3664/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.importer.set_importer', u'_href': u'/pulp/api/v2/tasks/658386db-7922-4b8a-85a4-194739ec3664/', u'task_id': u'658386db-7922-4b8a-85a4-194739ec3664', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:add_importer'], u'finish_time': u'2015-06-29T17:36:49Z', u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:49Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'finished', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': {u'scratchpad': None, u'_ns': u'repo_importers', u'importer_type_id': u'yum_importer', u'last_sync': None, u'scheduled_syncs': [], u'repo_id': u'EventListenerRepo', u'_id': {u'': u'55918231cc23512979c0e599'}, u'config': {u'feed': u'https://repos.fedorapeople.org/repos/pulp/pulp/demo_repos/zoo/', u'proxy_host': u'https://ip-172-31-26-58.eu-central-1.compute.internal', u'ssl_validation': False, u'proxy_password': u'squid', u'proxy_port': 3128, u'proxy_username': u'squid'}, u'id': u'yum_importer'}, u'error': None, u'_id': {u'': u'559182318e6334edd786a276'}, u'id': u'559182312d8a1208274ecee5'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/repositories/EventListenerRepo/importers/yum_importer/ HTTP/1.1" 200 478
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/repositories/EventListenerRepo/importers/yum_importer/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.repo.Importer'>.from_response(<Response [200]>) == Importer({u'scratchpad': None, u'_ns': u'repo_importers', u'importer_type_id': u'yum_importer', u'last_sync': None, u'scheduled_syncs': [], u'repo_id': u'EventListenerRepo', u'_id': {u'': u'55918231cc23512979c0e599'}, u'config': {u'feed': u'https://repos.fedorapeople.org/repos/pulp/pulp/demo_repos/zoo/', u'proxy_host': u'https://ip-172-31-26-58.eu-central-1.compute.internal', u'ssl_validation': False, u'proxy_password': u'squid', u'proxy_port': 3128, u'proxy_username': u'squid'}, u'id': u'yum_importer'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "POST /pulp/api/v2/repositories/EventListenerRepo/distributors/ HTTP/1.1" 201 442
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('POST', u'/repositories/EventListenerRepo/distributors/', data='{"distributor_id": "yum_distributor", "auto_publish": true, "distributor_config": {"http": true, "https": true, "relative_url": "/repos/pulp/pulp/demo_repos/zoo/"}, "distributor_type_id": "yum_distributor"}', headers={'content-type': 'application/json'})) == <Response [201]>
pulp_auto.item: DEBUG: <class 'pulp_auto.repo.Distributor'>.from_response(<Response [201]>) == Distributor({u'repo_id': u'EventListenerRepo', u'_href': u'/pulp/api/v2/repositories/EventListenerRepo/distributors/yum_distributor/', u'_ns': u'repo_distributors', u'last_publish': None, u'auto_publish': True, u'scheduled_publishes': [], u'distributor_type_id': u'yum_distributor', u'scratchpad': None, u'_id': {u'': u'55918233cc235129af22bf3a'}, u'config': {u'http': True, u'relative_url': u'/repos/pulp/pulp/demo_repos/zoo/', u'https': True}, u'id': u'yum_distributor'})
requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection (1): requestb.in
requests.packages.urllib3.connectionpool: DEBUG: "POST /api/v1/bins HTTP/1.1" 200 83
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "POST /pulp/api/v2/events/ HTTP/1.1" 201 310
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('POST', '/events/', data='{"notifier_config": {"url": "http://requestb.in/1cak1dg1"}, "event_types": ["repo.sync.finish", "repo.publish.finish"], "notifier_type_id": "http"}', headers={'content-type': 'application/json'})) == <Response [201]>
pulp_auto.item: DEBUG: <class 'pulp_auto.event_listener.EventListener'>.from_response(<Response [201]>) == EventListener({u'_href': u'/pulp/api/v2/events/55918234cc235129ae6385fa/', u'notifier_config': {u'url': u'http://requestb.in/1cak1dg1'}, u'_ns': u'event_listeners', u'event_types': [u'repo.sync.finish', u'repo.publish.finish'], u'_id': {u'': u'55918234cc235129ae6385fa'}, u'id': u'55918234cc235129ae6385fa', u'notifier_type_id': u'http'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "PUT /pulp/api/v2/events/55918234cc235129ae6385fa/ HTTP/1.1" 200 272
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('PUT', u'/events/55918234cc235129ae6385fa/', data='{"event_types": ["*"]}', headers={'content-type': 'application/json'})) == <Response [200]>
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/events/55918234cc235129ae6385fa/ HTTP/1.1" 200 272
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/events/55918234cc235129ae6385fa/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.event_listener.EventListener'>.from_response(<Response [200]>) == EventListener({u'_href': u'/pulp/api/v2/events/55918234cc235129ae6385fa/', u'notifier_config': {u'url': u'http://requestb.in/1cak1dg1'}, u'_ns': u'event_listeners', u'event_types': [u'*'], u'_id': {u'': u'55918234cc235129ae6385fa'}, u'id': u'55918234cc235129ae6385fa', u'notifier_type_id': u'http'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "POST /pulp/api/v2/repositories/EventListenerRepo/actions/sync/ HTTP/1.1" 202 172
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('POST', u'/repositories/EventListenerRepo/actions/sync/', data='{"override_config": {}}', headers={'content-type': 'application/json'})) == <Response [202]>
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/ HTTP/1.1" 200 1079
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.sync.sync', u'_href': u'/pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', u'task_id': u'f2ae2d5e-1621-43cc-80c8-59012d8b2138', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:sync'], u'finish_time': None, u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:52Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {u'yum_importer': {u'content': {u'size_total': 0, u'items_left': 0, u'items_total': 0, u'state': u'NOT_STARTED', u'size_left': 0, u'details': {u'rpm_total': 0, u'rpm_done': 0, u'drpm_total': 0, u'drpm_done': 0}, u'error_details': []}, u'comps': {u'state': u'NOT_STARTED'}, u'distribution': {u'items_total': 0, u'state': u'NOT_STARTED', u'error_details': [], u'items_left': 0}, u'errata': {u'state': u'NOT_STARTED'}, u'metadata': {u'state': u'IN_PROGRESS'}}}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'running', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': None, u'error': None, u'_id': {u'': u'559182348e6334edd786a277'}, u'id': u'559182342d8a1208274eceec'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/ HTTP/1.1" 200 1079
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.sync.sync', u'_href': u'/pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', u'task_id': u'f2ae2d5e-1621-43cc-80c8-59012d8b2138', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:sync'], u'finish_time': None, u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:52Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {u'yum_importer': {u'content': {u'size_total': 0, u'items_left': 0, u'items_total': 0, u'state': u'NOT_STARTED', u'size_left': 0, u'details': {u'rpm_total': 0, u'rpm_done': 0, u'drpm_total': 0, u'drpm_done': 0}, u'error_details': []}, u'comps': {u'state': u'NOT_STARTED'}, u'distribution': {u'items_total': 0, u'state': u'NOT_STARTED', u'error_details': [], u'items_left': 0}, u'errata': {u'state': u'NOT_STARTED'}, u'metadata': {u'state': u'IN_PROGRESS'}}}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'running', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': None, u'error': None, u'_id': {u'': u'559182348e6334edd786a277'}, u'id': u'559182342d8a1208274eceec'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/ HTTP/1.1" 200 1079
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.sync.sync', u'_href': u'/pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', u'task_id': u'f2ae2d5e-1621-43cc-80c8-59012d8b2138', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:sync'], u'finish_time': None, u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:52Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {u'yum_importer': {u'content': {u'size_total': 0, u'items_left': 0, u'items_total': 0, u'state': u'NOT_STARTED', u'size_left': 0, u'details': {u'rpm_total': 0, u'rpm_done': 0, u'drpm_total': 0, u'drpm_done': 0}, u'error_details': []}, u'comps': {u'state': u'NOT_STARTED'}, u'distribution': {u'items_total': 0, u'state': u'NOT_STARTED', u'error_details': [], u'items_left': 0}, u'errata': {u'state': u'NOT_STARTED'}, u'metadata': {u'state': u'IN_PROGRESS'}}}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'running', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': None, u'error': None, u'_id': {u'': u'559182348e6334edd786a277'}, u'id': u'559182342d8a1208274eceec'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/ HTTP/1.1" 200 1073
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.sync.sync', u'_href': u'/pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', u'task_id': u'f2ae2d5e-1621-43cc-80c8-59012d8b2138', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:sync'], u'finish_time': None, u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:52Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {u'yum_importer': {u'content': {u'size_total': 0, u'items_left': 0, u'items_total': 0, u'state': u'FINISHED', u'size_left': 0, u'details': {u'rpm_total': 0, u'rpm_done': 0, u'drpm_total': 0, u'drpm_done': 0}, u'error_details': []}, u'comps': {u'state': u'NOT_STARTED'}, u'distribution': {u'items_total': 0, u'state': u'IN_PROGRESS', u'error_details': [], u'items_left': 0}, u'errata': {u'state': u'NOT_STARTED'}, u'metadata': {u'state': u'FINISHED'}}}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'running', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': None, u'error': None, u'_id': {u'': u'559182348e6334edd786a277'}, u'id': u'559182342d8a1208274eceec'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/ HTTP/1.1" 200 1073
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.sync.sync', u'_href': u'/pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', u'task_id': u'f2ae2d5e-1621-43cc-80c8-59012d8b2138', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:sync'], u'finish_time': None, u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:52Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {u'yum_importer': {u'content': {u'size_total': 0, u'items_left': 0, u'items_total': 0, u'state': u'FINISHED', u'size_left': 0, u'details': {u'rpm_total': 0, u'rpm_done': 0, u'drpm_total': 0, u'drpm_done': 0}, u'error_details': []}, u'comps': {u'state': u'NOT_STARTED'}, u'distribution': {u'items_total': 0, u'state': u'IN_PROGRESS', u'error_details': [], u'items_left': 0}, u'errata': {u'state': u'NOT_STARTED'}, u'metadata': {u'state': u'FINISHED'}}}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'running', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': None, u'error': None, u'_id': {u'': u'559182348e6334edd786a277'}, u'id': u'559182342d8a1208274eceec'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/ HTTP/1.1" 200 1073
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.sync.sync', u'_href': u'/pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', u'task_id': u'f2ae2d5e-1621-43cc-80c8-59012d8b2138', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:sync'], u'finish_time': None, u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:52Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {u'yum_importer': {u'content': {u'size_total': 0, u'items_left': 0, u'items_total': 0, u'state': u'FINISHED', u'size_left': 0, u'details': {u'rpm_total': 0, u'rpm_done': 0, u'drpm_total': 0, u'drpm_done': 0}, u'error_details': []}, u'comps': {u'state': u'NOT_STARTED'}, u'distribution': {u'items_total': 0, u'state': u'IN_PROGRESS', u'error_details': [], u'items_left': 0}, u'errata': {u'state': u'NOT_STARTED'}, u'metadata': {u'state': u'FINISHED'}}}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'running', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': None, u'error': None, u'_id': {u'': u'559182348e6334edd786a277'}, u'id': u'559182342d8a1208274eceec'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/ HTTP/1.1" 200 2167
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.sync.sync', u'_href': u'/pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', u'task_id': u'f2ae2d5e-1621-43cc-80c8-59012d8b2138', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:sync'], u'finish_time': u'2015-06-29T17:36:57Z', u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:52Z', u'traceback': None, u'spawned_tasks': [{u'_href': u'/pulp/api/v2/tasks/2368809f-e72f-4a17-80b9-f51ccc3760a1/', u'task_id': u'2368809f-e72f-4a17-80b9-f51ccc3760a1'}], u'progress_report': {u'yum_importer': {u'content': {u'size_total': 0, u'items_left': 0, u'items_total': 0, u'state': u'FINISHED', u'size_left': 0, u'details': {u'rpm_total': 0, u'rpm_done': 0, u'drpm_total': 0, u'drpm_done': 0}, u'error_details': []}, u'comps': {u'state': u'FINISHED'}, u'distribution': {u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'items_left': 0}, u'errata': {u'state': u'FINISHED'}, u'metadata': {u'state': u'FINISHED'}}}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'finished', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': {u'importer_type_id': u'yum_importer', u'importer_id': u'yum_importer', u'exception': None, u'repo_id': u'EventListenerRepo', u'started': u'2015-06-29T17:36:52Z', u'_ns': u'repo_sync_results', u'completed': u'2015-06-29T17:36:57Z', u'traceback': None, u'error_message': None, u'summary': {u'content': {u'state': u'FINISHED'}, u'comps': {u'state': u'FINISHED'}, u'distribution': {u'state': u'FINISHED'}, u'errata': {u'state': u'FINISHED'}, u'metadata': {u'state': u'FINISHED'}}, u'added_count': 0, u'result': u'success', u'updated_count': 39, u'details': {u'content': {u'size_total': 0, u'items_left': 0, u'items_total': 0, u'state': u'FINISHED', u'size_left': 0, u'details': {u'rpm_total': 0, u'rpm_done': 0, u'drpm_total': 0, u'drpm_done': 0}, u'error_details': []}, u'comps': {u'state': u'FINISHED'}, u'distribution': {u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'items_left': 0}, u'errata': {u'state': u'FINISHED'}, u'metadata': {u'state': u'FINISHED'}}, u'id': u'55918239cc23512979c0e5c3', u'removed_count': 0}, u'error': None, u'_id': {u'': u'559182348e6334edd786a277'}, u'id': u'559182342d8a1208274eceec'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "POST /pulp/api/v2/repositories/EventListenerRepo/actions/publish/ HTTP/1.1" 202 172
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('POST', u'/repositories/EventListenerRepo/actions/publish/', data='{"override_config": null, "id": "yum_distributor"}', headers={'content-type': 'application/json'})) == <Response [202]>
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/ffe6f23f-d5cc-4190-9412-518c16ce732c/ HTTP/1.1" 200 7975
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/ffe6f23f-d5cc-4190-9412-518c16ce732c/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.publish.publish', u'_href': u'/pulp/api/v2/tasks/ffe6f23f-d5cc-4190-9412-518c16ce732c/', u'task_id': u'ffe6f23f-d5cc-4190-9412-518c16ce732c', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:publish'], u'finish_time': u'2015-06-29T17:36:57Z', u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:57Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {u'yum_distributor': [{u'num_success': 1, u'description': u'Copying files', u'step_type': u'save_tar', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'f67da167-f72a-43ff-93b2-8887358e10d6', u'num_processed': 1}, {u'num_success': 1, u'description': u'Initializing repo metadata', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'29d5623e-489c-4277-a581-fc5e01fedb37', u'num_processed': 1}, {u'num_success': 0, u'description': u'Publishing Distribution files', u'step_type': u'distribution', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'eecc2947-74ec-40dd-9ebd-a9ee6b8827cb', u'num_processed': 0}, {u'num_success': 0, u'description': u'Publishing RPMs', u'step_type': u'rpms', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'6a8eca32-efb2-4a9c-a269-74e50870e6ab', u'num_processed': 0}, {u'num_success': 0, u'description': u'Publishing Delta RPMs', u'step_type': u'drpms', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'ed8f6739-5346-4d5e-b080-6c28a4b143d7', u'num_processed': 0}, {u'num_success': 4, u'description': u'Publishing Errata', u'step_type': u'errata', u'items_total': 4, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'd616d57d-e9ac-4ba5-aa28-fa3f1ea23b41', u'num_processed': 4}, {u'num_success': 3, u'description': u'Publishing Comps file', u'step_type': u'comps', u'items_total': 3, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'91203ac6-fd92-40d9-81df-347781ff797e', u'num_processed': 3}, {u'num_success': 0, u'description': u'Publishing Metadata.', u'step_type': u'metadata', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'ee6b850b-f80a-4962-aa39-1290844f9be9', u'num_processed': 0}, {u'num_success': 1, u'description': u'Closing repo metadata', u'step_type': u'close_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'c0eb1a6a-40df-45ba-9d8f-6da8065f8a75', u'num_processed': 1}, {u'num_success': 0, u'description': u'Generating sqlite files', u'step_type': u'generate sqlite', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'900c5d7f-5009-46a9-bbcf-8c3b2b41bcbe', u'num_processed': 0}, {u'num_success': 1, u'description': u'Publishing files to web', u'step_type': u'publish_directory', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'9e68f613-9bcb-4a68-9dec-ca568abd5444', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'faa61002-3921-4046-971a-bdcd81ab88a8', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'e9ec5299-d712-4b29-b99c-f5448acb4d3d', u'num_processed': 1}]}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'finished', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': {u'exception': None, u'repo_id': u'EventListenerRepo', u'started': u'2015-06-29T17:36:57Z', u'_ns': u'repo_publish_results', u'completed': u'2015-06-29T17:36:57Z', u'traceback': None, u'distributor_type_id': u'yum_distributor', u'error_message': None, u'summary': {u'generate sqlite': u'SKIPPED', u'initialize_repo_metadata': u'FINISHED', u'rpms': u'FINISHED', u'close_repo_metadata': u'FINISHED', u'drpms': u'SKIPPED', u'comps': u'FINISHED', u'distribution': u'FINISHED', u'metadata': u'FINISHED', u'publish_directory': u'FINISHED', u'errata': u'FINISHED', u'save_tar': u'FINISHED'}, u'result': u'success', u'distributor_id': u'yum_distributor', u'id': u'55918239cc23512979c0e5d5', u'details': [{u'num_success': 1, u'description': u'Copying files', u'step_type': u'save_tar', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'f67da167-f72a-43ff-93b2-8887358e10d6', u'num_processed': 1}, {u'num_success': 1, u'description': u'Initializing repo metadata', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'29d5623e-489c-4277-a581-fc5e01fedb37', u'num_processed': 1}, {u'num_success': 0, u'description': u'Publishing Distribution files', u'step_type': u'distribution', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'eecc2947-74ec-40dd-9ebd-a9ee6b8827cb', u'num_processed': 0}, {u'num_success': 0, u'description': u'Publishing RPMs', u'step_type': u'rpms', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'6a8eca32-efb2-4a9c-a269-74e50870e6ab', u'num_processed': 0}, {u'num_success': 0, u'description': u'Publishing Delta RPMs', u'step_type': u'drpms', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'ed8f6739-5346-4d5e-b080-6c28a4b143d7', u'num_processed': 0}, {u'num_success': 4, u'description': u'Publishing Errata', u'step_type': u'errata', u'items_total': 4, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'd616d57d-e9ac-4ba5-aa28-fa3f1ea23b41', u'num_processed': 4}, {u'num_success': 3, u'description': u'Publishing Comps file', u'step_type': u'comps', u'items_total': 3, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'91203ac6-fd92-40d9-81df-347781ff797e', u'num_processed': 3}, {u'num_success': 0, u'description': u'Publishing Metadata.', u'step_type': u'metadata', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'ee6b850b-f80a-4962-aa39-1290844f9be9', u'num_processed': 0}, {u'num_success': 1, u'description': u'Closing repo metadata', u'step_type': u'close_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'c0eb1a6a-40df-45ba-9d8f-6da8065f8a75', u'num_processed': 1}, {u'num_success': 0, u'description': u'Generating sqlite files', u'step_type': u'generate sqlite', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'900c5d7f-5009-46a9-bbcf-8c3b2b41bcbe', u'num_processed': 0}, {u'num_success': 1, u'description': u'Publishing files to web', u'step_type': u'publish_directory', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'9e68f613-9bcb-4a68-9dec-ca568abd5444', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'faa61002-3921-4046-971a-bdcd81ab88a8', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'e9ec5299-d712-4b29-b99c-f5448acb4d3d', u'num_processed': 1}]}, u'error': None, u'_id': {u'': u'559182398e6334edd786a279'}, u'id': u'559182392d8a1208274ecefa'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/ffe6f23f-d5cc-4190-9412-518c16ce732c/ HTTP/1.1" 200 7975
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/ffe6f23f-d5cc-4190-9412-518c16ce732c/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.publish.publish', u'_href': u'/pulp/api/v2/tasks/ffe6f23f-d5cc-4190-9412-518c16ce732c/', u'task_id': u'ffe6f23f-d5cc-4190-9412-518c16ce732c', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:publish'], u'finish_time': u'2015-06-29T17:36:57Z', u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:57Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {u'yum_distributor': [{u'num_success': 1, u'description': u'Copying files', u'step_type': u'save_tar', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'f67da167-f72a-43ff-93b2-8887358e10d6', u'num_processed': 1}, {u'num_success': 1, u'description': u'Initializing repo metadata', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'29d5623e-489c-4277-a581-fc5e01fedb37', u'num_processed': 1}, {u'num_success': 0, u'description': u'Publishing Distribution files', u'step_type': u'distribution', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'eecc2947-74ec-40dd-9ebd-a9ee6b8827cb', u'num_processed': 0}, {u'num_success': 0, u'description': u'Publishing RPMs', u'step_type': u'rpms', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'6a8eca32-efb2-4a9c-a269-74e50870e6ab', u'num_processed': 0}, {u'num_success': 0, u'description': u'Publishing Delta RPMs', u'step_type': u'drpms', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'ed8f6739-5346-4d5e-b080-6c28a4b143d7', u'num_processed': 0}, {u'num_success': 4, u'description': u'Publishing Errata', u'step_type': u'errata', u'items_total': 4, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'd616d57d-e9ac-4ba5-aa28-fa3f1ea23b41', u'num_processed': 4}, {u'num_success': 3, u'description': u'Publishing Comps file', u'step_type': u'comps', u'items_total': 3, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'91203ac6-fd92-40d9-81df-347781ff797e', u'num_processed': 3}, {u'num_success': 0, u'description': u'Publishing Metadata.', u'step_type': u'metadata', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'ee6b850b-f80a-4962-aa39-1290844f9be9', u'num_processed': 0}, {u'num_success': 1, u'description': u'Closing repo metadata', u'step_type': u'close_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'c0eb1a6a-40df-45ba-9d8f-6da8065f8a75', u'num_processed': 1}, {u'num_success': 0, u'description': u'Generating sqlite files', u'step_type': u'generate sqlite', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'900c5d7f-5009-46a9-bbcf-8c3b2b41bcbe', u'num_processed': 0}, {u'num_success': 1, u'description': u'Publishing files to web', u'step_type': u'publish_directory', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'9e68f613-9bcb-4a68-9dec-ca568abd5444', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'faa61002-3921-4046-971a-bdcd81ab88a8', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'e9ec5299-d712-4b29-b99c-f5448acb4d3d', u'num_processed': 1}]}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'finished', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': {u'exception': None, u'repo_id': u'EventListenerRepo', u'started': u'2015-06-29T17:36:57Z', u'_ns': u'repo_publish_results', u'completed': u'2015-06-29T17:36:57Z', u'traceback': None, u'distributor_type_id': u'yum_distributor', u'error_message': None, u'summary': {u'generate sqlite': u'SKIPPED', u'initialize_repo_metadata': u'FINISHED', u'rpms': u'FINISHED', u'close_repo_metadata': u'FINISHED', u'drpms': u'SKIPPED', u'comps': u'FINISHED', u'distribution': u'FINISHED', u'metadata': u'FINISHED', u'publish_directory': u'FINISHED', u'errata': u'FINISHED', u'save_tar': u'FINISHED'}, u'result': u'success', u'distributor_id': u'yum_distributor', u'id': u'55918239cc23512979c0e5d5', u'details': [{u'num_success': 1, u'description': u'Copying files', u'step_type': u'save_tar', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'f67da167-f72a-43ff-93b2-8887358e10d6', u'num_processed': 1}, {u'num_success': 1, u'description': u'Initializing repo metadata', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'29d5623e-489c-4277-a581-fc5e01fedb37', u'num_processed': 1}, {u'num_success': 0, u'description': u'Publishing Distribution files', u'step_type': u'distribution', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'eecc2947-74ec-40dd-9ebd-a9ee6b8827cb', u'num_processed': 0}, {u'num_success': 0, u'description': u'Publishing RPMs', u'step_type': u'rpms', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'6a8eca32-efb2-4a9c-a269-74e50870e6ab', u'num_processed': 0}, {u'num_success': 0, u'description': u'Publishing Delta RPMs', u'step_type': u'drpms', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'ed8f6739-5346-4d5e-b080-6c28a4b143d7', u'num_processed': 0}, {u'num_success': 4, u'description': u'Publishing Errata', u'step_type': u'errata', u'items_total': 4, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'd616d57d-e9ac-4ba5-aa28-fa3f1ea23b41', u'num_processed': 4}, {u'num_success': 3, u'description': u'Publishing Comps file', u'step_type': u'comps', u'items_total': 3, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'91203ac6-fd92-40d9-81df-347781ff797e', u'num_processed': 3}, {u'num_success': 0, u'description': u'Publishing Metadata.', u'step_type': u'metadata', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'ee6b850b-f80a-4962-aa39-1290844f9be9', u'num_processed': 0}, {u'num_success': 1, u'description': u'Closing repo metadata', u'step_type': u'close_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'c0eb1a6a-40df-45ba-9d8f-6da8065f8a75', u'num_processed': 1}, {u'num_success': 0, u'description': u'Generating sqlite files', u'step_type': u'generate sqlite', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'900c5d7f-5009-46a9-bbcf-8c3b2b41bcbe', u'num_processed': 0}, {u'num_success': 1, u'description': u'Publishing files to web', u'step_type': u'publish_directory', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'9e68f613-9bcb-4a68-9dec-ca568abd5444', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'faa61002-3921-4046-971a-bdcd81ab88a8', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'e9ec5299-d712-4b29-b99c-f5448acb4d3d', u'num_processed': 1}]}, u'error': None, u'_id': {u'': u'559182398e6334edd786a279'}, u'id': u'559182392d8a1208274ecefa'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/ HTTP/1.1" 200 2167
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.sync.sync', u'_href': u'/pulp/api/v2/tasks/f2ae2d5e-1621-43cc-80c8-59012d8b2138/', u'task_id': u'f2ae2d5e-1621-43cc-80c8-59012d8b2138', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:sync'], u'finish_time': u'2015-06-29T17:36:57Z', u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:52Z', u'traceback': None, u'spawned_tasks': [{u'_href': u'/pulp/api/v2/tasks/2368809f-e72f-4a17-80b9-f51ccc3760a1/', u'task_id': u'2368809f-e72f-4a17-80b9-f51ccc3760a1'}], u'progress_report': {u'yum_importer': {u'content': {u'size_total': 0, u'items_left': 0, u'items_total': 0, u'state': u'FINISHED', u'size_left': 0, u'details': {u'rpm_total': 0, u'rpm_done': 0, u'drpm_total': 0, u'drpm_done': 0}, u'error_details': []}, u'comps': {u'state': u'FINISHED'}, u'distribution': {u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'items_left': 0}, u'errata': {u'state': u'FINISHED'}, u'metadata': {u'state': u'FINISHED'}}}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'finished', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': {u'importer_type_id': u'yum_importer', u'importer_id': u'yum_importer', u'exception': None, u'repo_id': u'EventListenerRepo', u'started': u'2015-06-29T17:36:52Z', u'_ns': u'repo_sync_results', u'completed': u'2015-06-29T17:36:57Z', u'traceback': None, u'error_message': None, u'summary': {u'content': {u'state': u'FINISHED'}, u'comps': {u'state': u'FINISHED'}, u'distribution': {u'state': u'FINISHED'}, u'errata': {u'state': u'FINISHED'}, u'metadata': {u'state': u'FINISHED'}}, u'added_count': 0, u'result': u'success', u'updated_count': 39, u'details': {u'content': {u'size_total': 0, u'items_left': 0, u'items_total': 0, u'state': u'FINISHED', u'size_left': 0, u'details': {u'rpm_total': 0, u'rpm_done': 0, u'drpm_total': 0, u'drpm_done': 0}, u'error_details': []}, u'comps': {u'state': u'FINISHED'}, u'distribution': {u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'items_left': 0}, u'errata': {u'state': u'FINISHED'}, u'metadata': {u'state': u'FINISHED'}}, u'id': u'55918239cc23512979c0e5c3', u'removed_count': 0}, u'error': None, u'_id': {u'': u'559182348e6334edd786a277'}, u'id': u'559182342d8a1208274eceec'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/2368809f-e72f-4a17-80b9-f51ccc3760a1/ HTTP/1.1" 200 7473
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/2368809f-e72f-4a17-80b9-f51ccc3760a1/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.publish.publish', u'_href': u'/pulp/api/v2/tasks/2368809f-e72f-4a17-80b9-f51ccc3760a1/', u'task_id': u'2368809f-e72f-4a17-80b9-f51ccc3760a1', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:publish'], u'finish_time': u'2015-06-29T17:36:57Z', u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:57Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {u'yum_distributor': [{u'num_success': 1, u'description': u'Initializing repo metadata', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'e8bf0661-a5f6-4706-97cd-250f03dd02a2', u'num_processed': 1}, {u'num_success': 0, u'description': u'Publishing Distribution files', u'step_type': u'distribution', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'6d6cb265-c395-4110-92bb-1934f0b57796', u'num_processed': 0}, {u'num_success': 32, u'description': u'Publishing RPMs', u'step_type': u'rpms', u'items_total': 32, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'534915d7-89a3-4e51-a9e1-0d5badd783e3', u'num_processed': 32}, {u'num_success': 0, u'description': u'Publishing Delta RPMs', u'step_type': u'drpms', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'f4d9d2bf-749e-4fea-ba21-484f1e681836', u'num_processed': 0}, {u'num_success': 4, u'description': u'Publishing Errata', u'step_type': u'errata', u'items_total': 4, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'3a2fba43-6298-4884-8ee7-c1bc6f98b10b', u'num_processed': 4}, {u'num_success': 3, u'description': u'Publishing Comps file', u'step_type': u'comps', u'items_total': 3, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'8984b15b-cd3e-4569-92b1-aa4f267eb149', u'num_processed': 3}, {u'num_success': 0, u'description': u'Publishing Metadata.', u'step_type': u'metadata', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'63a46ccb-fe30-4a73-b768-baa5ab973ee8', u'num_processed': 0}, {u'num_success': 1, u'description': u'Closing repo metadata', u'step_type': u'close_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'21a2db66-d3fe-4556-8bd1-287d8a34fab9', u'num_processed': 1}, {u'num_success': 0, u'description': u'Generating sqlite files', u'step_type': u'generate sqlite', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'0d624daf-7e44-46f8-be16-f4684ca7da82', u'num_processed': 0}, {u'num_success': 1, u'description': u'Publishing files to web', u'step_type': u'publish_directory', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'439515cc-0212-4098-a823-74022032eebf', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'4bf7881f-77df-49cd-b24c-3ce2c4b9bc9b', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'0c25f2a3-e591-4844-8b0e-68dd4e32230d', u'num_processed': 1}]}, u'queue': u'reserved_resource_worker-0@ip-172-31-24-137.dq', u'state': u'finished', u'worker_name': u'reserved_resource_worker-0@ip-172-31-24-137', u'result': {u'exception': None, u'repo_id': u'EventListenerRepo', u'started': u'2015-06-29T17:36:57Z', u'_ns': u'repo_publish_results', u'completed': u'2015-06-29T17:36:57Z', u'traceback': None, u'distributor_type_id': u'yum_distributor', u'error_message': None, u'summary': {u'generate sqlite': u'SKIPPED', u'initialize_repo_metadata': u'FINISHED', u'rpms': u'FINISHED', u'close_repo_metadata': u'FINISHED', u'drpms': u'SKIPPED', u'comps': u'FINISHED', u'distribution': u'FINISHED', u'publish_directory': u'FINISHED', u'errata': u'FINISHED', u'metadata': u'FINISHED'}, u'result': u'success', u'distributor_id': u'yum_distributor', u'id': u'55918239cc23512979c0e5cc', u'details': [{u'num_success': 1, u'description': u'Initializing repo metadata', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'e8bf0661-a5f6-4706-97cd-250f03dd02a2', u'num_processed': 1}, {u'num_success': 0, u'description': u'Publishing Distribution files', u'step_type': u'distribution', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'6d6cb265-c395-4110-92bb-1934f0b57796', u'num_processed': 0}, {u'num_success': 32, u'description': u'Publishing RPMs', u'step_type': u'rpms', u'items_total': 32, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'534915d7-89a3-4e51-a9e1-0d5badd783e3', u'num_processed': 32}, {u'num_success': 0, u'description': u'Publishing Delta RPMs', u'step_type': u'drpms', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'f4d9d2bf-749e-4fea-ba21-484f1e681836', u'num_processed': 0}, {u'num_success': 4, u'description': u'Publishing Errata', u'step_type': u'errata', u'items_total': 4, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'3a2fba43-6298-4884-8ee7-c1bc6f98b10b', u'num_processed': 4}, {u'num_success': 3, u'description': u'Publishing Comps file', u'step_type': u'comps', u'items_total': 3, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'8984b15b-cd3e-4569-92b1-aa4f267eb149', u'num_processed': 3}, {u'num_success': 0, u'description': u'Publishing Metadata.', u'step_type': u'metadata', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'63a46ccb-fe30-4a73-b768-baa5ab973ee8', u'num_processed': 0}, {u'num_success': 1, u'description': u'Closing repo metadata', u'step_type': u'close_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'21a2db66-d3fe-4556-8bd1-287d8a34fab9', u'num_processed': 1}, {u'num_success': 0, u'description': u'Generating sqlite files', u'step_type': u'generate sqlite', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'0d624daf-7e44-46f8-be16-f4684ca7da82', u'num_processed': 0}, {u'num_success': 1, u'description': u'Publishing files to web', u'step_type': u'publish_directory', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'439515cc-0212-4098-a823-74022032eebf', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'4bf7881f-77df-49cd-b24c-3ce2c4b9bc9b', u'num_processed': 1}, {u'num_success': 1, u'description': u'Writing Listings File', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'0c25f2a3-e591-4844-8b0e-68dd4e32230d', u'num_processed': 1}]}, u'error': None, u'_id': {u'': u'559182398e6334edd786a278'}, u'id': u'559182392d8a1208274ecef3'})
requests.packages.urllib3.connectionpool: INFO: Resetting dropped connection: ec2-52-28-91-118.eu-central-1.compute.amazonaws.com
py.warnings: WARNING: /usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:734: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
InsecureRequestWarning)
requests.packages.urllib3.connectionpool: DEBUG: "GET /pulp/api/v2/tasks/ffe6f23f-d5cc-4190-9412-518c16ce732c/ HTTP/1.1" 200 7975
pulp_auto.pulp: DEBUG: <pulp_auto.pulp.Pulp object at 0x7fb0e8994310>.send(Request('GET', u'/tasks/ffe6f23f-d5cc-4190-9412-518c16ce732c/', data='{}', headers={'content-type': 'application/json'})) == <Response [200]>
pulp_auto.item: DEBUG: <class 'pulp_auto.task.Task'>.from_response(<Response [200]>) == Task({u'exception': None, u'task_type': u'pulp.server.managers.repo.publish.publish', u'_href': u'/pulp/api/v2/tasks/ffe6f23f-d5cc-4190-9412-518c16ce732c/', u'task_id': u'ffe6f23f-d5cc-4190-9412-518c16ce732c', u'tags': [u'pulp:repository:EventListenerRepo', u'pulp:action:publish'], u'finish_time': u'2015-06-29T17:36:57Z', u'_ns': u'task_status', u'start_time': u'2015-06-29T17:36:57Z', u'traceback': None, u'spawned_tasks': [], u'progress_report': {u'yum_distributor': [{u'num_success': 1, u'description': u'Copying files', u'step_type': u'save_tar', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'f67da167-f72a-43ff-93b2-8887358e10d6', u'num_processed': 1}, {u'num_success': 1, u'description': u'Initializing repo metadata', u'step_type': u'initialize_repo_metadata', u'items_total': 1, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'29d5623e-489c-4277-a581-fc5e01fedb37', u'num_processed': 1}, {u'num_success': 0, u'description': u'Publishing Distribution files', u'step_type': u'distribution', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'eecc2947-74ec-40dd-9ebd-a9ee6b8827cb', u'num_processed': 0}, {u'num_success': 0, u'description': u'Publishing RPMs', u'step_type': u'rpms', u'items_total': 0, u'state': u'FINISHED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'6a8eca32-efb2-4a9c-a269-74e50870e6ab', u'num_processed': 0}, {u'num_success': 0, u'description': u'Publishing Delta RPMs', u'step_type': u'drpms', u'items_total': 1, u'state': u'SKIPPED', u'error_details': [], u'details': u'', u'num_failures': 0, u'step_id': u'ed8f6739-53
</code></pre>
RPM Support - Issue #1064 (CLOSED - WONTFIX): rpm repo group distributor requires undocumented _r...
https://pulp.plan.io/issues/1064
2015-06-18T12:52:28Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>if the <code>_repo-type</code> key isn't present in <code>repo.notes</code> of particular repo, following error can be seen when a repo group containing this repo gets published:</p>
<pre><code>Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) Task pulp.server.managers.repo.group.publish.publish[464b1afb-2d38-4777-9fb7-dd5837adcf0d] raised unexpected: KeyError('_repo-type',)
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) Traceback (most recent call last):
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) R = retval = fun(*args, **kwargs)
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 328, in __call__
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) return super(Task, self).__call__(*args, **kwargs)
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in __protected_call__
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) return self.run(*args, **kwargs)
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/group/publish.py", line 73, in publish
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) conduit, call_config)
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/group/publish.py", line 85, in _do_publish
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) report = distributor_instance.publish_group(group, conduit, call_config)
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/export_distributor/groupdistributor.py", line 110, in publish_group
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) ids.TYPE_ID_DISTRIBUTOR_GROUP_EXPORT)
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 194, in __init__
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) if repo.notes['_repo-type'] != 'rpm-repo':
Jun 18 07:58:25 ip-172-31-24-137 pulp: celery.worker.job:ERROR: (5962-96608) KeyError: '_repo-type'
</code></pre>
<p>However, the <a href="https://github.com/pulp/pulp_rpm/tree/master/docs/tech-reference" class="external">documentation</a> doesn't mention that the <code>_repo-type</code> attribute is required for group distributor.</p>
Nectar - Story #1032 (CLOSED - WONTFIX): Allow plain hostname as config.proxy_url in downloaders
https://pulp.plan.io/issues/1032
2015-06-04T21:46:55Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>Having specified plain hostname as <code>config.proxy_url</code>, following traceback can be seen in the logs:</p>
<p><code>[root@ip-172-31-24-137 ~]# less /var/log/messages</code></p>
<pre><code class="text syntaxhl" data-language="text">Jun 4 16:01:17 ip-172-31-24-137 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[0d4463ad-52a0-4591-b988-4a7e5d69d540] succeeded in 0.0369634300005s: None
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-96928) _add_proxy(session, config)
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-96928) File "/usr/lib/python2.6/site-packages/nectar/downloaders/threaded.py", line 342, in _add_proxy
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-96928) url = ':'.join((host, str(config.proxy_port)))
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-96928) TypeError: sequence item 0: expected string, NoneType found
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-95072) Unhandled Exception in Worker Thread [140192698595072]
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-95072) Traceback (most recent call last):
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-95072) File "/usr/lib/python2.6/site-packages/nectar/downloaders/threaded.py", line 92, in worker
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-95072) session = build_session(self.config)
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-95072) File "/usr/lib/python2.6/site-packages/nectar/downloaders/threaded.py", line 311, in build_session
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-95072) _add_proxy(session, config)
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-95072) File "/usr/lib/python2.6/site-packages/nectar/downloaders/threaded.py", line 342, in _add_proxy
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-95072) url = ':'.join((host, str(config.proxy_port)))
Jun 4 16:01:17 ip-172-31-24-137 pulp: nectar.downloaders.threaded:ERROR: (1999-95072) TypeError: sequence item 0: expected string, NoneType found
Jun 4 16:03:44 ip-172-31-24-137 pulp: celery.worker.control:INFO: Terminating 97b36355-e665-4b47-b998-fed15e1d9f5c (15)
</code></pre>
<p>Since particular download session proxy URLs are assembled from the <code>proxy_url</code>, <code>proxy_port</code>, <code>proxy_username</code> and <code>proxy_password</code> attributes, I suggest following semantics to maintain current API and address the issue,<br>
in case plain hostname (no protocol) was specified as <code>config.proxy_url</code>:</p>
<ul>
<li><code>session['proxies']['http'] = 'http://' + <hostname></code></li>
<li><code>session['proxies']['https'] = 'https://' + <hostname></code></li>
</ul>
<p>Version:<br>
<code>python-nectar-1.3.1-2.el6.noarch</code></p>
<p>Reproducer steps:<br>
<code>[root@ip-172-31-24-137 ~]# pulp-admin -u admin -p admin rpm repo create --repo-id zoo --feed https://repos.fedorapeople.org/repos/pulp/pulp/demo_repos/zoo/ --proxy-host squid.example.com --proxy-port 3128 --proxy-user squid --proxy-pass squid</code><br>
<code>[root@ip-172-31-24-137 ~]# pulp-admin -u admin -p admin rpm repo sync run --repo-id zoo</code></p>
Pulp - Issue #1020 (CLOSED - WONTFIX): Scheduled Tasks failure_treshold doesn't work
https://pulp.plan.io/issues/1020
2015-06-01T14:48:12Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>The scheduler's <code>failure_threshold</code> attribute doesn't work --- a Scheduled task failing more times consecutively doesn't get cancelled automatically as opposed to what the <a href="https://pulp.readthedocs.org/en/latest/dev-guide/conventions/scheduled.html#scheduled-tasks" class="external">documentation</a> specifies.</p>
<p>How reproducible: Always</p>
<p>Steps to reproduce</p>
<ul>
<li>create a scheduled unit installation with a malformed rpm unit key with a period of 1 minute</li>
<li>use the <a href="https://github.com/RedHatQE/pulp-automation/blob/master/misc/fake_consumer.py" class="external">fake automation consumer</a> to report back related installation error</li>
<li>wait 5 or more minutes</li>
<li>check the number of tasks that were spawned for the consumer installation</li>
<li>check the <code>total_run_count</code> of the scheduler object</li>
</ul>
<p>Actual result:</p>
<ul>
<li>total count of tasks spawned for the installation is higher than <code>failure_threshold</code> scheduler attribute would imply</li>
<li>
<code>consecutive_failures</code> attribute scheduler remains zero all the time</li>
</ul>
<p>Expected results</p>
<ul>
<li>Spawned tasks consecutive failing count having reached the <code>failure_threshold</code> scheduler attribute value disables the scheduler as specified in the documentation</li>
<li>
<code>consecutive_failures</code> scheduler attribute should eventually reach the <code>failure_threshold</code> attribute value</li>
<li>The Scheduler gets cancelled automatically when <code>consecutive_failures</code> reaches <code>failure_threshold</code> attribute value</li>
</ul>
<p>See also: Issue <a class="issue tracker-3 status-9 priority-6 priority-default closed" title="Story: Add ScheduleID to Tasks spawned by schedulers (CLOSED - WONTFIX)" href="https://pulp.plan.io/issues/1019">#1019</a></p>
<p><em>Reproducer screen log</em></p>
<p>The scheduled installation object<br>
<code>[root@ip-172-31-20-145 ~]# curl -k https://admin:admin@localhost/pulp/api/v2/consumers/SimpleScheduledInstall_consumer/schedules/content/install/ | python -mjson.tool</code></p>
<pre><code class="json syntaxhl" data-language="json"><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"_href"</span><span class="p">:</span><span class="w"> </span><span class="s2">"/pulp/api/v2/consumers/SimpleScheduledInstall_consumer/schedules/content/install/556c6a642bcb1c455d5ce1ef/"</span><span class="p">,</span><span class="w">
</span><span class="nl">"_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"556c6a642bcb1c455d5ce1ef"</span><span class="p">,</span><span class="w">
</span><span class="nl">"args"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="s2">"SimpleScheduledInstall_consumer"</span><span class="w">
</span><span class="p">],</span><span class="w">
</span><span class="nl">"consecutive_failures"</span><span class="p">:</span><span class="w"> </span><span class="mi">0</span><span class="p">,</span><span class="w">
</span><span class="nl">"enabled"</span><span class="p">:</span><span class="w"> </span><span class="kc">true</span><span class="p">,</span><span class="w">
</span><span class="nl">"failure_threshold"</span><span class="p">:</span><span class="w"> </span><span class="mi">3</span><span class="p">,</span><span class="w">
</span><span class="nl">"first_run"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-06-01T14:21:24Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"kwargs"</span><span class="p">:</span><span class="w"> </span><span class="p">{</span><span class="w">
</span><span class="nl">"options"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"units"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"type_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"rpm"</span><span class="p">,</span><span class="w">
</span><span class="nl">"unit_key"</span><span class="p">:</span><span class="w"> </span><span class="s2">"zebra"</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span><span class="p">},</span><span class="w">
</span><span class="nl">"last_run_at"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-06-01T14:22:02Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"last_updated"</span><span class="p">:</span><span class="w"> </span><span class="mf">1433168484.7911601</span><span class="p">,</span><span class="w">
</span><span class="nl">"next_run"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-06-01T14:22:24Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"options"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"remaining_runs"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"resource"</span><span class="p">:</span><span class="w"> </span><span class="s2">"pulp:consumer:SimpleScheduledInstall_consumer"</span><span class="p">,</span><span class="w">
</span><span class="nl">"schedule"</span><span class="p">:</span><span class="w"> </span><span class="s2">"PT1M"</span><span class="p">,</span><span class="w">
</span><span class="nl">"task"</span><span class="p">:</span><span class="w"> </span><span class="s2">"pulp.server.tasks.consumer.install_content"</span><span class="p">,</span><span class="w">
</span><span class="nl">"total_run_count"</span><span class="p">:</span><span class="w"> </span><span class="mi">1</span><span class="p">,</span><span class="w">
</span><span class="nl">"units"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"type_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"rpm"</span><span class="p">,</span><span class="w">
</span><span class="nl">"unit_key"</span><span class="p">:</span><span class="w"> </span><span class="s2">"zebra"</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span></code></pre>
<p>The scheduler having been spawning failing tasks for 5 minutes<br>
<code>[root@ip-172-31-20-145 ~]# sleep 300; curl -k https://admin:admin@localhost/pulp/api/v2/consumers/SimpleScheduledInstall_consumer/schedules/content/install/ | python -mjson.tool</code></p>
<pre><code class="json syntaxhl" data-language="json"><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"_href"</span><span class="p">:</span><span class="w"> </span><span class="s2">"/pulp/api/v2/consumers/SimpleScheduledInstall_consumer/schedules/content/install/556c6a642bcb1c455d5ce1ef/"</span><span class="p">,</span><span class="w">
</span><span class="nl">"_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"556c6a642bcb1c455d5ce1ef"</span><span class="p">,</span><span class="w">
</span><span class="nl">"args"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="s2">"SimpleScheduledInstall_consumer"</span><span class="w">
</span><span class="p">],</span><span class="w">
</span><span class="nl">"consecutive_failures"</span><span class="p">:</span><span class="w"> </span><span class="mi">0</span><span class="p">,</span><span class="w">
</span><span class="nl">"enabled"</span><span class="p">:</span><span class="w"> </span><span class="kc">true</span><span class="p">,</span><span class="w">
</span><span class="nl">"failure_threshold"</span><span class="p">:</span><span class="w"> </span><span class="mi">3</span><span class="p">,</span><span class="w">
</span><span class="nl">"first_run"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-06-01T14:21:24Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"kwargs"</span><span class="p">:</span><span class="w"> </span><span class="p">{</span><span class="w">
</span><span class="nl">"options"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"units"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"type_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"rpm"</span><span class="p">,</span><span class="w">
</span><span class="nl">"unit_key"</span><span class="p">:</span><span class="w"> </span><span class="s2">"zebra"</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span><span class="p">},</span><span class="w">
</span><span class="nl">"last_run_at"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-06-01T14:26:24Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"last_updated"</span><span class="p">:</span><span class="w"> </span><span class="mf">1433168484.7911601</span><span class="p">,</span><span class="w">
</span><span class="nl">"next_run"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-06-01T14:27:24Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"options"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"remaining_runs"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"resource"</span><span class="p">:</span><span class="w"> </span><span class="s2">"pulp:consumer:SimpleScheduledInstall_consumer"</span><span class="p">,</span><span class="w">
</span><span class="nl">"schedule"</span><span class="p">:</span><span class="w"> </span><span class="s2">"PT1M"</span><span class="p">,</span><span class="w">
</span><span class="nl">"task"</span><span class="p">:</span><span class="w"> </span><span class="s2">"pulp.server.tasks.consumer.install_content"</span><span class="p">,</span><span class="w">
</span><span class="nl">"total_run_count"</span><span class="p">:</span><span class="w"> </span><span class="mi">6</span><span class="p">,</span><span class="w">
</span><span class="nl">"units"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"type_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"rpm"</span><span class="p">,</span><span class="w">
</span><span class="nl">"unit_key"</span><span class="p">:</span><span class="w"> </span><span class="s2">"zebra"</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span></code></pre>
<p>Fetching the failing tasks from Pulp<br>
<code>[root@ip-172-31-20-145 ~]# curl -k https://admin:admin@localhost/pulp/api/v2/tasks/ | python -mjson.tool > all_tasks.json</code></p>
<p>Showing single failing task</p>
<pre><code class="json syntaxhl" data-language="json"><span class="w"> </span><span class="p">{</span><span class="w">
</span><span class="nl">"_href"</span><span class="p">:</span><span class="w"> </span><span class="s2">"/pulp/api/v2/tasks/74a5846b-3803-4651-b1ff-08499f1b2400/"</span><span class="p">,</span><span class="w">
</span><span class="nl">"_id"</span><span class="p">:</span><span class="w"> </span><span class="p">{</span><span class="w">
</span><span class="nl">"$oid"</span><span class="p">:</span><span class="w"> </span><span class="s2">"556c6bcc2bcb1c236e803949"</span><span class="w">
</span><span class="p">},</span><span class="w">
</span><span class="nl">"_ns"</span><span class="p">:</span><span class="w"> </span><span class="s2">"task_status"</span><span class="p">,</span><span class="w">
</span><span class="nl">"error"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"exception"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"finish_time"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-06-01T14:27:24Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"556c6bcc2bcb1c236e803949"</span><span class="p">,</span><span class="w">
</span><span class="nl">"progress_report"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"result"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"spawned_tasks"</span><span class="p">:</span><span class="w"> </span><span class="p">[],</span><span class="w">
</span><span class="nl">"start_time"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-06-01T14:27:24Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"state"</span><span class="p">:</span><span class="w"> </span><span class="s2">"error"</span><span class="p">,</span><span class="w">
</span><span class="nl">"tags"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="s2">"pulp:consumer:SimpleScheduledInstall_consumer"</span><span class="p">,</span><span class="w">
</span><span class="s2">"pulp:action:unit_install"</span><span class="w">
</span><span class="p">],</span><span class="w">
</span><span class="nl">"task_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"74a5846b-3803-4651-b1ff-08499f1b2400"</span><span class="p">,</span><span class="w">
</span><span class="nl">"task_type"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"traceback"</span><span class="p">:</span><span class="w"> </span><span class="s2">"Traceback (most recent call last):</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/agent.py</span><span class="se">\"</span><span class="s2">, line 137, in __call__</span><span class="se">\n</span><span class="s2"> response = self.request_to_call(self.module, request, self.PROFILE)()</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/agent.py</span><span class="se">\"</span><span class="s2">, line 118, in <lambda></span><span class="se">\n</span><span class="s2"> **dict(list(request['kws'].viewitems()) + [('PROFILE', PROFILE)])</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/handler.py</span><span class="se">\"</span><span class="s2">, line 19, in logged_wrapper</span><span class="se">\n</span><span class="s2"> ret = method(self, *args, **kvs)</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/handler.py</span><span class="se">\"</span><span class="s2">, line 47, in wrapped_method</span><span class="se">\n</span><span class="s2"> units</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/handler.py</span><span class="se">\"</span><span class="s2">, line 45, in <lambda></span><span class="se">\n</span><span class="s2"> PROFILE</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/content_handler.py</span><span class="se">\"</span><span class="s2">, line 29, in install</span><span class="se">\n</span><span class="s2"> unit_type.store(unit, PROFILE)</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/rpm_unit.py</span><span class="se">\"</span><span class="s2">, line 48, in store</span><span class="se">\n</span><span class="s2"> if Rpm.list(unit, PROFILE) == []:</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/rpm_unit.py</span><span class="se">\"</span><span class="s2">, line 36, in list</span><span class="se">\n</span><span class="s2"> nevra = Rpm.unit_to_nevra(unit)</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/rpm_unit.py</span><span class="se">\"</span><span class="s2">, line 9, in unit_to_nevra</span><span class="se">\n</span><span class="s2"> assert type(request.unit_key) is Namespace, 'unsupported unit key type: %s' % type(request.unit_key)</span><span class="se">\n</span><span class="s2">AssertionError: unsupported unit key type: <type 'unicode'></span><span class="se">\n</span><span class="s2">"</span><span class="p">,</span><span class="w">
</span><span class="nl">"worker_name"</span><span class="p">:</span><span class="w"> </span><span class="s2">"agent"</span><span class="w">
</span><span class="p">}</span><span class="w">
</span></code></pre>
<p>Counting number of failing tasks<br>
<code>[root@ip-172-31-20-145 ~]# csplit all_tasks.json '%2015-06-01T14:22:02Z%'</code></p>
<pre><code class="text syntaxhl" data-language="text">[root@ip-172-31-20-145 ~]# grep 'line 9, in unit_to_nevra' xx00 | wc -l
7
[root@ip-172-31-20-145 ~]#
</code></pre>
Pulp - Story #1019 (CLOSED - WONTFIX): Add ScheduleID to Tasks spawned by schedulers
https://pulp.plan.io/issues/1019
2015-06-01T11:36:39Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>At the moment, one can't link schedule-spawned tasks to their particular <a href="https://pulp.readthedocs.org/en/latest/dev-guide/conventions/scheduled.html#scheduled-tasks" class="external">schedule</a>.<br>
As a result, one can't tell easily whether e.g. scheduled unit install works or whether to delete/reconfigure it because of a malformed unit key.<br>
This makes it difficult for automated tests (or other API consumer) to check spawned tasks progress/status explicitly.<br>
I therefore suggest adding a link from the spawned task back to the scheduler object instance (another tag possibly).</p>
<p>Scheduled regular Unit installation object<br>
<code>[root@ip-172-31-20-145 ~]# curl -k https://admin:admin@localhost/pulp/api/v2/consumers/SimpleScheduledInstall_consumer/schedules/content/install/ | python -mjson.tool</code></p>
<pre><code class="json syntaxhl" data-language="json"><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"_href"</span><span class="p">:</span><span class="w"> </span><span class="s2">"/pulp/api/v2/consumers/SimpleScheduledInstall_consumer/schedules/content/install/556863872bcb1c2d440c0ef1/"</span><span class="p">,</span><span class="w">
</span><span class="nl">"_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"556863872bcb1c2d440c0ef1"</span><span class="p">,</span><span class="w">
</span><span class="nl">"args"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="s2">"SimpleScheduledInstall_consumer"</span><span class="w">
</span><span class="p">],</span><span class="w">
</span><span class="nl">"consecutive_failures"</span><span class="p">:</span><span class="w"> </span><span class="mi">0</span><span class="p">,</span><span class="w">
</span><span class="nl">"enabled"</span><span class="p">:</span><span class="w"> </span><span class="kc">true</span><span class="p">,</span><span class="w">
</span><span class="nl">"failure_threshold"</span><span class="p">:</span><span class="w"> </span><span class="mi">3</span><span class="p">,</span><span class="w">
</span><span class="nl">"first_run"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-05-29T13:03:03Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"kwargs"</span><span class="p">:</span><span class="w"> </span><span class="p">{</span><span class="w">
</span><span class="nl">"options"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"units"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"type_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"rpm"</span><span class="p">,</span><span class="w">
</span><span class="nl">"unit_key"</span><span class="p">:</span><span class="w"> </span><span class="s2">"pike"</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span><span class="p">},</span><span class="w">
</span><span class="nl">"last_run_at"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-05-29T14:07:03Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"last_updated"</span><span class="p">:</span><span class="w"> </span><span class="mf">1432904583.9740551</span><span class="p">,</span><span class="w">
</span><span class="nl">"next_run"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-05-29T14:08:03Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"options"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"remaining_runs"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"resource"</span><span class="p">:</span><span class="w"> </span><span class="s2">"pulp:consumer:SimpleScheduledInstall_consumer"</span><span class="p">,</span><span class="w">
</span><span class="nl">"schedule"</span><span class="p">:</span><span class="w"> </span><span class="s2">"PT1M"</span><span class="p">,</span><span class="w">
</span><span class="nl">"task"</span><span class="p">:</span><span class="w"> </span><span class="s2">"pulp.server.tasks.consumer.install_content"</span><span class="p">,</span><span class="w">
</span><span class="nl">"total_run_count"</span><span class="p">:</span><span class="w"> </span><span class="mi">65</span><span class="p">,</span><span class="w">
</span><span class="nl">"units"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"type_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"rpm"</span><span class="p">,</span><span class="w">
</span><span class="nl">"unit_key"</span><span class="p">:</span><span class="w"> </span><span class="s2">"pike"</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span></code></pre>
<p>Task spawned by the scheduler to install the unit, failing because of malformed unit key<br>
<code>curl -k https://admin:admin@localhost/pulp/api/v2/tasks/ | python -mjson.tool | less</code></p>
<pre><code class="json syntaxhl" data-language="json"><span class="w"> </span><span class="p">{</span><span class="w">
</span><span class="nl">"_href"</span><span class="p">:</span><span class="w"> </span><span class="s2">"/pulp/api/v2/tasks/9cbab540-9a1b-4636-b8f6-5928456eeac1/"</span><span class="p">,</span><span class="w">
</span><span class="nl">"_id"</span><span class="p">:</span><span class="w"> </span><span class="p">{</span><span class="w">
</span><span class="nl">"$oid"</span><span class="p">:</span><span class="w"> </span><span class="s2">"55681cb92bcb1c238ad7a30e"</span><span class="w">
</span><span class="p">},</span><span class="w">
</span><span class="nl">"_ns"</span><span class="p">:</span><span class="w"> </span><span class="s2">"task_status"</span><span class="p">,</span><span class="w">
</span><span class="nl">"error"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"exception"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"finish_time"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-05-29T08:00:57Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"55681cb92bcb1c238ad7a30e"</span><span class="p">,</span><span class="w">
</span><span class="nl">"progress_report"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"result"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"spawned_tasks"</span><span class="p">:</span><span class="w"> </span><span class="p">[],</span><span class="w">
</span><span class="nl">"start_time"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2015-05-29T08:00:57Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"state"</span><span class="p">:</span><span class="w"> </span><span class="s2">"error"</span><span class="p">,</span><span class="w">
</span><span class="nl">"tags"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="s2">"pulp:consumer:SimpleScheduledInstall_consumer"</span><span class="p">,</span><span class="w">
</span><span class="s2">"pulp:action:unit_install"</span><span class="w">
</span><span class="p">],</span><span class="w">
</span><span class="nl">"task_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"9cbab540-9a1b-4636-b8f6-5928456eeac1"</span><span class="p">,</span><span class="w">
</span><span class="nl">"task_type"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"traceback"</span><span class="p">:</span><span class="w"> </span><span class="s2">"Traceback (most recent call last):</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/agent.py</span><span class="se">\"</span><span class="s2">, line 137, in __call__</span><span class="se">\n</span><span class="s2"> response = self.request_to_call(self.module, request, self.PROFILE)()</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/agent.py</span><span class="se">\"</span><span class="s2">, line 118, in <lambda></span><span class="se">\n</span><span class="s2"> **dict(list(request['kws'].viewitems()) + [('PROFILE', PROFILE)])</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/handler.py</span><span class="se">\"</span><span class="s2">, line 19, in logged_wrapper</span><span class="se">\n</span><span class="s2"> ret = method(self, *args, **kvs)</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/handler.py</span><span class="se">\"</span><span class="s2">, line 47, in wrapped_method</span><span class="se">\n</span><span class="s2"> units</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/handler.py</span><span class="se">\"</span><span class="s2">, line 45, in <lambda></span><span class="se">\n</span><span class="s2"> PROFILE</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/content_handler.py</span><span class="se">\"</span><span class="s2">, line 29, in install</span><span class="se">\n</span><span class="s2"> unit_type.store(unit, PROFILE)</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/rpm_unit.py</span><span class="se">\"</span><span class="s2">, line 46, in store</span><span class="se">\n</span><span class="s2"> if Rpm.list(unit, PROFILE) == []:</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/rpm_unit.py</span><span class="se">\"</span><span class="s2">, line 34, in list</span><span class="se">\n</span><span class="s2"> nevra = Rpm.unit_to_nevra(unit)</span><span class="se">\n</span><span class="s2"> File </span><span class="se">\"</span><span class="s2">/home/mkovacik/src/pulp-automation/pulp_auto/handler/rpm_unit.py</span><span class="se">\"</span><span class="s2">, line 14, in unit_to_nevra</span><span class="se">\n</span><span class="s2"> 'name': request.unit_key.name,</span><span class="se">\n</span><span class="s2">AttributeError: 'unicode' object has no attribute 'name'</span><span class="se">\n</span><span class="s2">"</span><span class="p">,</span><span class="w">
</span><span class="nl">"worker_name"</span><span class="p">:</span><span class="w"> </span><span class="s2">"agent"</span><span class="w">
</span><span class="p">}</span><span class="w">
</span></code></pre>
Docker Support - Story #1005 (CLOSED - NOTABUG): pulp-admin docker repo create misses mandatory o...
https://pulp.plan.io/issues/1005
2015-05-27T14:50:20Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>At the moment it is possible to create a docker repo without specifying <code>--feed</code> on the command line.<br>
Later when synchronizing the repo, it leads to a server-side exception verifying mandatory fields presence:</p>
<pre><code>[root@ip-172-31-20-145 ~]# pulp-admin -u admin -p admin docker repo create --repo-id hello-world --upstream-name hello-world
Repository [hello-world] successfully created
[root@ip-172-31-20-145 ~]# pulp-admin -u admin -p admin docker repo sync run --repo-id hello-world
+----------------------------------------------------------------------+
Synchronizing Repository [hello-world]
+----------------------------------------------------------------------+
This command may be exited via ctrl+c without affecting the request.
Task Failed
Missing values for: ['feed']
[root@ip-172-31-20-145 ~]#
### $ cat /var/log/messages
### ------%<---------------
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.sync.sync[4276f7d5-76b9-4e2e-9e28-4ac95600d4d2]
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) Exception caught from plugin during sync for repo [hello-world]
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) Traceback (most recent call last):
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 164, in _do_sync
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) sync_report = sync_repo(transfer_repo, conduit, call_config)
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 483, in wrap_f
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) return f(*args, **kwargs)
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/importer.py", line 83, in sync_repo
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) working_dir=working_dir)
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 53, in __init__
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) self.validate(config)
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 89, in validate
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) raise MissingValue(missing)
May 27 10:20:56 ip-172-31-20-145 pulp: pulp.server.managers.repo.sync:ERROR: (2836-43136) MissingValue: Missing values for: ['feed']
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[0dee8c1f-c3d7-47ac-a783-245379df3755]
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) Task pulp.server.managers.repo.sync.sync[4276f7d5-76b9-4e2e-9e28-4ac95600d4d2] raised unexpected: MissingValue(['feed'],)
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) Traceback (most recent call last):
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) R = retval = fun(*args, **kwargs)
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 328, in __call__
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) return super(Task, self).__call__(*args, **kwargs)
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in __protected_call__
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) return self.run(*args, **kwargs)
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 110, in sync
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) call_config)
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 164, in _do_sync
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) sync_report = sync_repo(transfer_repo, conduit, call_config)
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 483, in wrap_f
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) return f(*args, **kwargs)
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/importer.py", line 83, in sync_repo
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) working_dir=working_dir)
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 53, in __init__
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) self.validate(config)
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 89, in validate
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) raise MissingValue(missing)
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:ERROR: (2735-43136) MissingValue: Missing values for: ['feed']
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[f9d11683-4c39-4397-96c8-a3e5cf0c8ba3] succeeded in 0.0382881090045s: None
May 27 10:20:56 ip-172-31-20-145 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[0dee8c1f-c3d7-47ac-a783-245379df3755] succeeded in 0.0315523919999s: None
</code></pre>
<p>Please, either introduce a <code>/etc/pulp/admin/conf.d/docker.conf</code> with a <a href="https://index.docker.io" class="external">default feed</a> or make the command line option mandatory</p>
Pulp - Story #1004 (CLOSED - WONTFIX): Add doc steps for installing additional content type support
https://pulp.plan.io/issues/1004
2015-05-27T12:01:18Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>There's no <a href="https://pulp.readthedocs.org/en/latest/user-guide/installation.html" class="external">documentation</a> how to install additional pulp content support plugins.<br>
Especially, the fact that <code>pulp-manage-db</code> should be called having installed such plugins.<br>
User might encounter stack-traces restarting pulp services that might require some debugging 1).</p>
<p>1) screen log; restarting pulp services not having run pulp-manage-db after additional content (docker) plugins were installed; attached</p>
Pulp - Issue #713 (CLOSED - WONTFIX): Event Listeners API: repo.publish.finish triggered before r...
https://pulp.plan.io/issues/713
2015-02-28T23:25:49Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>Test case screen log</p>
<p>Description of problem:<br>
The repo.publish.finish http event listener gets triggered before the repo finishes publishing.<br>
The related publish task.finish_time is always later than the request.time posted to requestb.in.</p>
<p>Version-Release number of selected component (if applicable):<br>
pulp-server-2.6.0-0.7.beta.fc21.noarch</p>
<p>How reproducible:<br>
Always</p>
<p>Steps to Reproduce:<br>
0. set up an rpm repo with feed<br>
1. create an http event listener:<br>
- reports to a bin (<a href="http://requestb.in/&lt;bin_id" class="external">http://requestb.in/&lt;bin_id</a>>)<br>
- types: ['repo.sync.finish', 'repo.publish.finish']<br>
2. update the event listener to types: ['repo.publish.finish']<br>
3. publish repo yum_distributor<br>
4. wait for spawned tasks to finish<br>
5. collect requests posted to the bin</p>
<p>Actual results:<br>
request.time < publish_task.finish_time</p>
<p>Expected results:<br>
request.time >= publish_task.finish_time</p>
<p>Additional info:<br>
Automated test case: <a href="https://github.com/RedHatQE/pulp-automation/blob/master/tests/general_tests/test_23_event_listener.py" class="external">https://github.com/RedHatQE/pulp-automation/blob/master/tests/general_tests/test_23_event_listener.py</a> ; EventListenerTest.test_05_repo_publish_finish</p>
<p>+ This bug was cloned from <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1195434" class="external">Bugzilla Bug #1195434</a> +</p>
Pulp - Issue #712 (CLOSED - WONTFIX): Event Listeners API: describe repo.publish.start triggering...
https://pulp.plan.io/issues/712
2015-02-28T23:25:43Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>Document URL:<br>
<a href="https://pulp-dev-guide.readthedocs.org/en/latest/integration/events/repo-action-events.html" class="external">https://pulp-dev-guide.readthedocs.org/en/latest/integration/events/repo-action-events.html</a></p>
<p>Section Number and Name:<br>
<a href="https://pulp-dev-guide.readthedocs.org/en/latest/integration/events/repo-action-events.html#repository-publish-started" class="external">https://pulp-dev-guide.readthedocs.org/en/latest/integration/events/repo-action-events.html#repository-publish-started</a></p>
<p>Describe the issue:<br>
Event Listeners API description of repo.publish.start-event_type misses event-trigger conditions specification w/r:<br>
- sync task.start_time<br>
- sync task.finish_time<br>
- publish task.start_time<br>
- publish task.finish_time</p>
<p>Suggestions for improvement:<br>
Explicitly state that the event fires no sooner/later than any related task starts/finishes, or that no such assumption can be made.</p>
<p>Additional information:<br>
Automation test case requiring specs: <a href="https://github.com/RedHatQE/pulp-automation/blob/master/tests/general_tests/test_23_event_listener.py" class="external">https://github.com/RedHatQE/pulp-automation/blob/master/tests/general_tests/test_23_event_listener.py</a> ;<br>
EventListenerTest.test_04_repo_publish_start</p>
<p>+ This bug was cloned from <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1195391" class="external">Bugzilla Bug #1195391</a> +</p>
Pulp - Issue #710 (CLOSED - WONTFIX): Event Listeners API: describe repo.sync.start triggering co...
https://pulp.plan.io/issues/710
2015-02-28T23:25:32Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>Document URL:<br>
<a href="https://pulp-dev-guide.readthedocs.org/en/latest/integration/events/repo-action-events.html" class="external">https://pulp-dev-guide.readthedocs.org/en/latest/integration/events/repo-action-events.html</a></p>
<p>Section Number and Name:<br>
<a href="https://pulp-dev-guide.readthedocs.org/en/latest/integration/events/repo-action-events.html#repository-synchronize-and-publish-events" class="external">https://pulp-dev-guide.readthedocs.org/en/latest/integration/events/repo-action-events.html#repository-synchronize-and-publish-events</a></p>
<p>Describe the issue:<br>
Event Listeners API description of repo.sync.start-event_type misses event-trigger conditions specification w/r related tasks.start_time</p>
<p>Suggestions for improvement:<br>
Explicitly state that the event fires no sooner/later than the related task starts, or that no such assumption can be made.</p>
<p>Additional information:<br>
Automation scenario requiring the specification: <a href="https://github.com/RedHatQE/pulp-automation/blob/master/tests/general_tests/test_23_event_listener.py" class="external">https://github.com/RedHatQE/pulp-automation/blob/master/tests/general_tests/test_23_event_listener.py</a> ; EventListenerTest.test_02_repo_sync_start</p>
<p>+ This bug was cloned from <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1195282" class="external">Bugzilla Bug #1195282</a> +</p>
Pulp - Issue #453 (CLOSED - WONTFIX): deprecation errors in /var/log/httpd/error_log
https://pulp.plan.io/issues/453
2015-02-28T22:10:38Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>Description of problem:</p>
<p>Following Trace can be seen in /var/log/httpd/error_log</p>
<p>[root@ec2-46-51-133-3 ~]# cat /var/log/httpd/error_log</p>
<ol>
<li>---%<------<br>
[Mon Jun 16 06:03:51 2014] [error] if OBJECT_ALREADY_EXISTS_STRING not in err.message:<br>
[Mon Jun 16 06:18:28 2014] [error] /usr/lib/python2.6/site-packages/kombu/transport/qpid.py:277: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6<br>
[Mon Jun 16 06:18:28 2014] [error] if self.allowed_exception_string not in error.message:<br>
[Mon Jun 16 06:18:28 2014] [error] /usr/lib/python2.6/site-packages/kombu/transport/qpid.py:777: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6<br>
[Mon Jun 16 06:18:28 2014] [error] if OBJECT_ALREADY_EXISTS_STRING not in err.message:</li>
<li>---%<------<br>
[root@ec2-46-51-133-3 ~]#</li>
</ol>
<p>Version-Release number of selected component (if applicable):<br>
pulp-server-2.4.0-0.20.beta.el6.noarch<br>
python-kombu-3.0.15-10.pulp.el6.noarch</p>
<p>How reproducible:<br>
Always</p>
<p>Steps to Reproduce:<br>
1. deploy pulp-server on a RHEL6 Server node<br>
2. pulp-admin -u admin -p admin rpm repo create --repo-id zoo --feed <a href="http://repos.fedorapeople.org/repos/pulp/pulp/demo_repos/zoo/" class="external">http://repos.fedorapeople.org/repos/pulp/pulp/demo_repos/zoo/</a><br>
3. pulp-admin -u admin -p admin rpm repo delete --repo-id zoo</p>
<p>Expected results:<br>
"DeprecationWarning: BaseException.message has been deprecated as of Python 2.6" not shown anymore in /var/log/httpd/error_log</p>
<p>+ This bug was cloned from <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1109773" class="external">Bugzilla Bug #1109773</a> +</p>
Pulp - Issue #438 (CLOSED - WONTFIX): Call flow for consumer is missing for authenticated agent a...
https://pulp.plan.io/issues/438
2015-02-28T22:08:59Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>Description of problem:<br>
A detailed description for the authenticated agent amqp scenario is missing in current docs (see #URL) w.r. consumer create call-flow</p>
<p>Expected results:<br>
New page describing in detail how to perform consumer register in order to allow consumers (custom) agent to talk with Pulp over amqp with Digest authentication.<br>
Especially, the page should describe:<br>
- the initial consumer create/POST request should contain pub_key attribute<br>
holding consumer's public key used later on for the Digest authentication<br>
- how the consumer should obtain server's public key for Digest authentication<br>
- how these key pairs should be used to compute the Digest Authentication for<br>
consumer's agent communication with Pulp broker.</p>
<p>+ This bug was cloned from <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1101639" class="external">Bugzilla Bug #1101639</a> +</p>
Pulp - Issue #431 (CLOSED - WONTFIX): A key-error for connection_errors Stack dump appears when s...
https://pulp.plan.io/issues/431
2015-02-28T22:06:26Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>Description of problem:<br>
The stack dump from "Additional Info" can be seen in logs when starting/stopping pulp workers</p>
<p>Version-Release number of selected component (if applicable):<br>
pulp-server-2.4.0-0.14.beta.fc20.noarch<br>
python-kombu-3.0.15-5.pulp.fc20.noarch</p>
<p>How reproducible:<br>
~1/2</p>
<p>Steps to Reproduce:<br>
1. systemctl stop `systemctl list-unit-files | egrep 'pulp|httpd|goferd' | cut -d\ -f1<br>
2. check /var/log messages for the stack dump<br>
2. ystemctl start `systemctl list-unit-files | egrep 'pulp|httpd|goferd' | cut -d\ -f1<br>
4. goto 1.</p>
<p>Actual results:<br>
repeating few times, the stack dump from additional info appears</p>
<p>Expected results:<br>
no stack dump in during stop workers appears when accessing the connection_errors property</p>
<p>Additional info:</p>
<ol>
<li>the stack dump<br>
May 16 13:37:10 ec2-54-220-31-64 systemd: Stopping The Apache HTTP Server...<br>
May 16 13:37:10 ec2-54-220-31-64 systemd: Stopping Pulp's Celerybeat...<br>
May 16 13:37:10 ec2-54-220-31-64 systemd: Stopping Pulp Resource Manager...<br>
May 16 13:37:10 ec2-54-220-31-64 systemd: Stopping Pulp Worker #0...<br>
May 16 13:37:10 ec2-54-220-31-64 systemd: Stopping Pulp Celery Workers...<br>
May 16 13:37:10 ec2-54-220-31-64 celery: celery beat v3.1.11 (Cipater) is starting.<br>
May 16 13:37:10 ec2-54-220-31-64 celery: <em>_ - ... _</em> -<br>
<em>May 16 13:37:10 ec2-54-220-31-64 celery: Configuration -><br>
May 16 13:37:10 ec2-54-220-31-64 celery: . broker -> qpid://<a href="mailto:guest@ec2-54-220-31-64.eu-west-1.compute.amazonaws.com" class="email">guest@ec2-54-220-31-64.eu-west-1.compute.amazonaws.com</a>:5672//<br>
May 16 13:37:10 ec2-54-220-31-64 celery: . loader -> celery.loaders.app.AppLoader<br>
May 16 13:37:10 ec2-54-220-31-64 celery: . scheduler -> pulp.server.async.scheduler.Scheduler<br>
May 16 13:37:10 ec2-54-220-31-64 celery: . logfile -> [stderr]@%INFO<br>
May 16 13:37:10 ec2-54-220-31-64 celery: . maxinterval -> now (0s)<br>
May 16 13:37:10 ec2-54-220-31-64 celery: worker: Warm shutdown (MainProcess)<br>
May 16 13:37:10 ec2-54-220-31-64 celery: worker: Warm shutdown (MainProcess)<br>
May 16 13:37:10 ec2-54-220-31-64 celery: Exception in thread Thread-2 (most likely raised during interpreter shutdown):<br>
May 16 13:37:10 ec2-54-220-31-64 celery: Traceback (most recent call last):<br>
May 16 13:37:10 ec2-54-220-31-64 celery: File "/usr/lib64/python2.7/threading.py", line 811, inbootstrap_inner<br>
May 16 13:37:10 ec2-54-220-31-64 celery: File "/usr/lib64/python2.7/threading.py", line 764, in run<br>
May 16 13:37:10 ec2-54-220-31-64 celery: File "/usr/lib/python2.7/site-packages/pulp/server/async/scheduler.py", line 92, in monitor_events<br>
May 16 13:37:10 ec2-54-220-31-64 celery: File "/usr/lib/python2.7/site-packages/kombu/connection.py", line 732, in __exit</em>_<br>
May 16 13:37:10 ec2-54-220-31-64 celery: File "/usr/lib/python2.7/site-packages/kombu/connection.py", line 334, in release<br>
May 16 13:37:10 ec2-54-220-31-64 celery: File "/usr/lib/python2.7/site-packages/kombu/connection.py", line 302, in _close<br>
May 16 13:37:10 ec2-54-220-31-64 celery: File "/usr/lib/python2.7/site-packages/kombu/connection.py", line 292, in _do_close_self<br>
May 16 13:37:10 ec2-54-220-31-64 celery: File "/usr/lib/python2.7/site-packages/kombu/connection.py", line 285, in maybe_close_channel<br>
May 16 13:37:10 ec2-54-220-31-64 celery: File "/usr/lib/python2.7/site-packages/kombu/utils/<em>_init__.py", line 320, inget</em>_<br>
May 16 13:37:10 ec2-54-220-31-64 celery: <type 'exceptions.KeyError'>: 'connection_errors'<br>
May 16 13:37:10 ec2-54-220-31-64 systemd: Stopped Pulp's Celerybeat.<br>
May 16 13:37:11 ec2-54-220-31-64 celery: <a href="mailto:reserved_resource_worker-0@ec2-54-220-31-64.eu-west-1.compute.amazonaws.com" class="email">reserved_resource_worker-0@ec2-54-220-31-64.eu-west-1.compute.amazonaws.com</a> ready.<br>
May 16 13:37:11 ec2-54-220-31-64 celery: <a href="mailto:resource_manager@ec2-54-220-31-64.eu-west-1.compute.amazonaws.com" class="email">resource_manager@ec2-54-220-31-64.eu-west-1.compute.amazonaws.com</a> ready.<br>
May 16 13:37:11 ec2-54-220-31-64 systemd: Stopped The Apache HTTP Server.<br>
May 16 13:37:12 ec2-54-220-31-64 systemd: Stopped Pulp Worker #0.</li>
</ol>
<p>+ This bug was cloned from <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1098536" class="external">Bugzilla Bug #1098536</a> +</p>
Pulp - Issue #423 (CLOSED - WONTFIX): pulp-manage-db does not exit with error code when unable to...
https://pulp.plan.io/issues/423
2015-02-28T22:05:32Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>Version-Release number of selected component (if applicable):<br>
pulp-server-2.4.0-0.10.beta.fc20.noarch</p>
<p>How reproducible:<br>
Always</p>
<p>Steps to Reproduce:<br>
1. stop qpidd<br>
2. run sudo -u apache pulp-manage-db</p>
<p>Actual results:<br>
Exit status is 0 even though connection to qpidd (broker) failed</p>
<p>Expected results:<br>
Exit status is non-zero when connection to qpid fails</p>
<p>Additional info:</p>
<ol>
<li>screen log<br>
[root@ec2-54-73-48-94 pulp_auto]# sudo -u apache pulp-manage-db<br>
Loading content types.<br>
Content types loaded.<br>
Ensuring the admin role and user are in place.<br>
Admin role and user are in place.<br>
Beginning database migrations.<br>
Applying pulp.server.db.migrations version 1<br>
Migration to pulp.server.db.migrations version 1 complete.<br>
Applying pulp.server.db.migrations version 2<br>
Migration to pulp.server.db.migrations version 2 complete.<br>
Applying pulp.server.db.migrations version 3<br>
Migration to pulp.server.db.migrations version 3 complete.<br>
Applying pulp.server.db.migrations version 4<br>
Migration to pulp.server.db.migrations version 4 complete.<br>
Applying pulp.server.db.migrations version 5<br>
Migration to pulp.server.db.migrations version 5 complete.<br>
Applying pulp.server.db.migrations version 6<br>
Migration to pulp.server.db.migrations version 6 complete.<br>
Applying pulp.server.db.migrations version 7<br>
Migration to pulp.server.db.migrations version 7 complete.<br>
Applying pulp.server.db.migrations version 8<br>
Migration to pulp.server.db.migrations version 8 complete.<br>
Applying pulp.server.db.migrations version 9<br>
Applying migration pulp.server.db.migrations.0009_qpid_queues failed. See log for details.<br>
Applying pulp_puppet.plugins.migrations version 1<br>
Migration to pulp_puppet.plugins.migrations version 1 complete.<br>
Applying pulp_puppet.plugins.migrations version 2<br>
Migration to pulp_puppet.plugins.migrations version 2 complete.<br>
Applying pulp_rpm.plugins.migrations version 1<br>
Migration to pulp_rpm.plugins.migrations version 1 complete.<br>
Applying pulp_rpm.plugins.migrations version 2<br>
Migration to pulp_rpm.plugins.migrations version 2 complete.<br>
Applying pulp_rpm.plugins.migrations version 3<br>
Migration to pulp_rpm.plugins.migrations version 3 complete.<br>
Applying pulp_rpm.plugins.migrations version 4<br>
Migration to pulp_rpm.plugins.migrations version 4 complete.<br>
Applying pulp_rpm.plugins.migrations version 5<br>
Migration to pulp_rpm.plugins.migrations version 5 complete.<br>
Applying pulp_rpm.plugins.migrations version 6<br>
Migration to pulp_rpm.plugins.migrations version 6 complete.<br>
Applying pulp_rpm.plugins.migrations version 7<br>
Migration to pulp_rpm.plugins.migrations version 7 complete.<br>
Applying pulp_rpm.plugins.migrations version 8<br>
Migration to pulp_rpm.plugins.migrations version 8 complete.<br>
Applying pulp_rpm.plugins.migrations version 9<br>
Migration to pulp_rpm.plugins.migrations version 9 complete.<br>
Applying pulp_rpm.plugins.migrations version 10<br>
Migration to pulp_rpm.plugins.migrations version 10 complete.<br>
Applying pulp_rpm.plugins.migrations version 11<br>
Migration to pulp_rpm.plugins.migrations version 11 complete.<br>
Applying pulp_rpm.plugins.migrations version 12<br>
Migration to pulp_rpm.plugins.migrations version 12 complete.<br>
Applying pulp_rpm.plugins.migrations version 13<br>
Migration to pulp_rpm.plugins.migrations version 13 complete.<br>
Applying pulp_rpm.plugins.migrations version 14<br>
Migration to pulp_rpm.plugins.migrations version 14 complete.<br>
Applying pulp_rpm.plugins.migrations version 15<br>
Migration to pulp_rpm.plugins.migrations version 15 complete.<br>
Database migrations complete.<br>
[root@ec2-54-73-48-94 pulp_auto]# echo $?<br>
0</li>
</ol>
<ol>
<li>messages<br>
[root@ec2-54-73-48-94 pulp_auto]# tail -80 /var/log/messages | head -25<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:INFO: Applying pulp.server.db.migrations version 6<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:INFO: Migration to pulp.server.db.migrations version 6 complete.<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:INFO: Applying pulp.server.db.migrations version 7<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:INFO: Migration to pulp.server.db.migrations version 7 complete.<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:INFO: Applying pulp.server.db.migrations version 8<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:INFO: Migration to pulp.server.db.migrations version 8 complete.<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:INFO: Applying pulp.server.db.migrations version 9<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: Applying migration pulp.server.db.migrations.0009_qpid_queues failed.<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: [Errno 111] Connection refused<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: Traceback (most recent call last):<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: File "/usr/lib/python2.7/site-packages/pulp/server/db/manage.py", line 86, in migrate_database<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: update_current_version=not options.test)<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: File "/usr/lib/python2.7/site-packages/pulp/server/db/migrate/models.py", line 161, in apply_migration<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: migration.migrate()<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: File "/usr/lib/python2.7/site-packages/pulp/server/db/migrations/0009_qpid_queues.py", line 67, in migrate<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: connection.attach()<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: File "<string>", line 6, in attach<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: File "/usr/lib/python2.7/site-packages/qpid/messaging/endpoints.py", line 291, in attach<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: if not self._ewait(lambda: self._transport_connected and not self._unlinked(), timeout=timeout):<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: File "/usr/lib/python2.7/site-packages/qpid/messaging/endpoints.py", line 224, in _ewait<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: self.check_error()<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: File "/usr/lib/python2.7/site-packages/qpid/messaging/endpoints.py", line 217, in check_error<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: raise e<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL: ConnectError: [Errno 111] Connection refused<br>
May 2 14:46:42 ec2-54-73-48-94 pulp: pulp.server.db.manage:CRITICAL:</li>
</ol>
<p>+ This bug was cloned from <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1093757" class="external">Bugzilla Bug #1093757</a> +</p>
Pulp - Issue #421 (CLOSED - WONTFIX): Pulp allows requests while still booting
https://pulp.plan.io/issues/421
2015-02-28T22:05:22Z
mkovacik@redhat.com
mkovacik@redhat.com
<p>Description of problem:<br>
Pulp allows requests while still booting.<br>
This leads to mixed results whenever both sync and async tasks are concerned such as create repo & associate importer.<br>
As a result, sync tasks pass OK (create repo) while async tasks fail with internal server errors etc.</p>
<p>Version-Release number of selected component (if applicable):<br>
2.4 Beta</p>
<p>How reproducible:<br>
always</p>
<p>Steps to Reproduce:<br>
1. stop pulp services and httpd<br>
2. start pulp services and httpd<br>
3. while the pulp services are booting, issue create repo & associate importer API requests</p>
<p>Actual results:<br>
Internal errors, async tasks fail</p>
<p>Expected results:<br>
Pulp doesn't accept any requests while booting<br>
Ideally, pulp gives a 503-Service-Unavailable response in return while booting</p>
<p>Additional info:<br>
Affects CI when pulp start is slowed-down by call-stats collecting [1]<br>
A workaround exists: wait ~1min till pulp settles down<br>
[1] <a href="https://github.com/RedHatQE/python-moncov" class="external">https://github.com/RedHatQE/python-moncov</a></p>
<p>+ This bug was cloned from <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1092494" class="external">Bugzilla Bug #1092494</a> +</p>