Pulp: Issueshttps://pulp.plan.io/https://pulp.plan.io/favicon.ico2021-05-19T19:45:14ZPulp
Planio CertGuard - Issue #8785 (CLOSED - DUPLICATE): CONTRIBUTING docs are out of date for how to test p...https://pulp.plan.io/issues/87852021-05-19T19:45:14Zehelms@redhat.comehelms@redhat.com
<p><strong>Ticket moved to GitHub</strong>: "pulp/pulp-certguard/144":<a href="https://github.com/pulp/pulp-certguard/issues/144" class="external">https://github.com/pulp/pulp-certguard/issues/144</a></p> CertGuard - Issue #8783 (CLOSED - CURRENTRELEASE): CA certificate does not handle a CA bundle or ...https://pulp.plan.io/issues/87832021-05-19T15:38:18Zehelms@redhat.comehelms@redhat.com
<p>If I set the value of ca_certificate (e.g. update certguard_rhsmcertguard SET ca_certificate = :'content' ;) where that content is a bundle of CA certificates, clients will receive a 403 unless the CA that signed the client certificate is the first CA in the file.</p> Pulp - Task #4554 (CLOSED - CURRENTRELEASE): Change naming of Pulp 3 services to differentiate th...https://pulp.plan.io/issues/45542019-03-20T14:09:20Zehelms@redhat.comehelms@redhat.com
<p>When Pulp 2 and Pulp 3 are ran on the same system differentiating the services is difficult which affects the ability to debug, restart the proper services and overall manage both applications during transition. Based on some pulp-dev email conversations one of two options should be taken:</p>
<p><a class="issue tracker-3 status-11 priority-6 priority-default closed child" title="Story: As a user, I can have Pulp attempt use auto_retry application wide using the 'unsafe_autoretry' p... (CLOSED - CURRENTRELEASE)" href="https://pulp.plan.io/issues/1">#1</a>: Rename Pulp 3 services to all new names to clearly differentiate</p>
<p>For example:</p>
<pre><code>a) pulp-task-manager
b) pulp-tasking-manager
c) pulp-queue-manager
d) pulp-arborist
e) arborist
f) pulp-task-runner
g) pulp-task-worker
h) pulp-async-worker
i) pulp-tasking-worker
j) pulp-seedling
</code></pre>
<p><del><a class="issue tracker-3 status-11 priority-7 priority-high2 closed" title="Story: As a user, my rpm sync finishes quickly when upstream metadata hasn't changed (CLOSED - CURRENTRELEASE)" href="https://pulp.plan.io/issues/2">#2</a>: Rename Pulp 2 services to include version</del></p>
<pre><code>-a) pulp2-resource-manager
b) pulp2-worker-
</code></pre>
<p><del>As per <a href="https://www.redhat.com/archives/pulp-dev/2019-March/msg00085.html" class="external">this thread</a>, it's decided to go with option 2 - rename pulp2 services.</del></p>
<p>As per <a href="https://www.redhat.com/archives/pulp-list/2019-June/msg00008.html" class="external">this thread</a>, it's decided to go with option 1 a rename pulp3 services to pulpcore-*</p> Pulp - Issue #4508 (CLOSED - CURRENTRELEASE): Remove '3' from Pulp installer and roleshttps://pulp.plan.io/issues/45082019-03-06T18:04:33Zehelms@redhat.comehelms@redhat.com
<p>The current installer and roles for Pulp 3 are tied to the pulp3 version disallowing flexibility for semantic versioning of Pulp and the installer going forward. I would recommend dropping the '3',e.g. `ansible-pulp` and `pulp` and `pulp-redis` for role names.</p>
<p>Further, current variables used inside the roles are not following best practices for variables being namespaced by the role name. Dropping the '3' would align these variables to best practices.</p> Pulp - Task #4495 (CLOSED - CURRENTRELEASE): Rename pulp-wsgi to be more descriptivehttps://pulp.plan.io/issues/44952019-03-04T15:59:35Zehelms@redhat.comehelms@redhat.com
<p>The rest of Pulp services describe their function while pulp-wsgi describes the interface used to serve the application. I think it would be more useful to rename this service to describe the functionality. Some ideas:</p>
<ul>
<li>pulp-core</li>
<li>pulp-api</li>
<li>pulp-api-server</li>
</ul> Pulp - Issue #3883 (CLOSED - CURRENTRELEASE): Switch default logging to consolehttps://pulp.plan.io/issues/38832018-07-25T15:22:28Zehelms@redhat.comehelms@redhat.com
<p>A proposal was submitted [1] to pulp-dev and given the traction I am filing an issue to switch from syslog to console by default for Pulp 3.</p>
<p>[1] <a href="https://www.redhat.com/archives/pulp-dev/2018-July/msg00095.html" class="external">https://www.redhat.com/archives/pulp-dev/2018-July/msg00095.html</a></p> Pulp - Issue #3879 (CLOSED - CURRENTRELEASE): Cannot opt out of settings defaults due to merging ...https://pulp.plan.io/issues/38792018-07-23T16:50:08Zehelms@redhat.comehelms@redhat.com
<a name="Issue"></a>
<h2 >Issue<a href="#Issue" class="wiki-anchor">¶</a></h2>
<p>The pointed issue is that if I want to configure pure console logging (for container environments) I cannot. The syslog handler gets configured and attempts to connect failing. If I try to set my logging configuration like the following, the syslog handler I explicitly try to exclude is added:</p>
<pre><code>logging:
formatters:
simple:
format: "pulp: %(name)s:%(levelname)s: %(message)s"
handlers:
console:
class: logging.StreamHandler
formatter: simple
loggers:
'':
handlers: ["console"]
level: INFO
</code></pre>
<p>I have had to hack around this for now via -- <a href="https://github.com/ehelms/pulp/commit/8e82d27a6294c2db139ce2ffc41002cc70309777" class="external">https://github.com/ehelms/pulp/commit/8e82d27a6294c2db139ce2ffc41002cc70309777</a></p>
<p>How can I only use my settings and not "merge" with the defaults.</p>
<a name="Solution"></a>
<h2 >Solution<a href="#Solution" class="wiki-anchor">¶</a></h2>
<p>Update the behavior to be an 'overwrite' from the top level of each. The merge could would only replace user values for default values for the keys: DATABASES, logging, ..., PROFILING</p>
<p><a href="https://github.com/pulp/pulp/blob/12919c2040b3de1a061e647f1f59e7494294d600/pulpcore/pulpcore/app/settings.py#L219-L240" class="external">https://github.com/pulp/pulp/blob/12919c2040b3de1a061e647f1f59e7494294d600/pulpcore/pulpcore/app/settings.py#L219-L240</a></p> Pulp - Issue #3507 (CLOSED - WONTFIX): Pulp streamer should be able to log to consolehttps://pulp.plan.io/issues/35072018-03-21T00:07:44Zehelms@redhat.comehelms@redhat.comPulp - Issue #2786 (CLOSED - CURRENTRELEASE): The content wsgi does not respect logging configura...https://pulp.plan.io/issues/27862017-06-01T01:30:35Zehelms@redhat.comehelms@redhat.com
<p>The ability to log to the console was added recently (<a href="https://pulp.plan.io/issues/2548" class="external">https://pulp.plan.io/issues/2548</a>) for the Pulp server. However, this logging configuration was not extended to the content wsgi application that serves up repositories which continues to log strictly to syslog.</p> Pulp - Issue #2588 (CLOSED - WONTFIX): Pulp Gets Stuck On A Particular Mirrorhttps://pulp.plan.io/issues/25882017-02-15T20:01:54Zehelms@redhat.comehelms@redhat.com
<p>This is being filed on behalf of Jason Nance who originally opened an issue against the Katello project (<a href="http://projects.theforeman.org/issues/18506" class="external">http://projects.theforeman.org/issues/18506</a>) and we have since moved it here.</p>
<p>Pulp 2.9.3, Squid 3.5.20</p>
<p>Product repository is configured as on demand, and points to a mirror list:</p>
<pre><code>http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=updates
</code></pre>
<p>Client is trying to install a package which has not previously been downloaded, but Pulp is failing to download the package. Pulp says "Skipping requests to mirror.clarkson.edu due to repeated connection failures", but then retries the same mirror again.</p>
<p>Specific to this instance, <a href="http://mirror.clarkson.edu/centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm" class="external">http://mirror.clarkson.edu/centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm</a> is unavailable (mirror.clarkson.edu is down in my area at this time).</p>
<p>If I run <code>wget 'http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=updates'</code> I get a different mirror list (nearly every time), but Pulp/Squid seems to not be refreshing its mirror list</p>
<p>Client (<code>yum install MySQL-python</code>) shows the following (10 times):</p>
<pre><code>MySQL-python-1.2.5-1.el7.x86_6 FAILED
https://sl2mmgplsat0001.ipa.lab.gen.zone/pulp/repos/tkc-holdings/pnp-production/c7stable/custom/centos/c7/MySQL-python-1.2.5-1.el7.x86_64.rpm: [Errno 14] HTTPS Error 503 - Service Unavailable
Trying other mirror.
</code></pre>
<p><code>foreman-tail</code> shows the following:</p>
<pre><code>==> /var/log/messages <==
Feb 14 13:42:09 sl2mmgplsat0001 pulp_streamer: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (21): mirror.clarkson.edu
==> /var/log/httpd/foreman-ssl_access_ssl.log <==
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:09 -0600] "GET /pulp/repos/tkc-holdings/pnp-production/c7stable/custom/centos/c7/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3"
==> /var/log/messages <==
Feb 14 13:42:15 sl2mmgplsat0001 pulp_streamer: nectar.downloaders.threaded:ERROR: Skipping requests to mirror.clarkson.edu due to repeated connection failures: HTTPConnectionPool(host='mirror.clarkson.edu', port=80): Max retries exceeded with url: /centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.HTTPConnection object at 0x4690890>, 'Connection to mirror.clarkson.edu timed out. (connect timeout=6.05)'))
Feb 14 13:42:15 sl2mmgplsat0001 pulp_streamer: [-] 127.0.0.1 - - [14/Feb/2017:19:42:15 +0000] "GET /var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
Feb 14 13:42:15 sl2mmgplsat0001 pulp_streamer: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (22): mirror.clarkson.edu
==> /var/log/httpd/foreman-ssl_access_ssl.log <==
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:09 -0600] "GET /streamer/var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4zMyJ9LCAicmVzb3VyY2UiOiAiL3N0cmVhbWVyL3Zhci9saWIvcHVscC9jb250ZW50L3VuaXRzL3JwbS9lNS9mYmJlODFiZTdlYzhhNWM4NjMyNzIwMGIyMzNlOTc1MzNlYzc1NDQwNzBjZWM1NzhiM2VhZTA1MDIzN2E0Yy9NeVNRTC1weXRob24tMS4yLjUtMS5lbDcueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzEwMTQxOX0%3D;signature=rjPNJ2oWHsEOD7h0WvE1zaCLnkg0Fd8ZLRpmZjBosv7VWgxfCVZSbBLHv_Khvgq9TDPdAYH6GLXu_ljj9vpkc_FFEtMO6PczQT9zGzMWu8Fm21vhGMDwejbVw34Z1K1ERcC53V25_WFczMwikfCYrpDnU83DMor5H60p53l1gC3zpb3pIPQI79WfccbbKveYx31W3mqBXXVSc0WoUS7HOmE3Zg-_zzX53Q24ERrwEJlkHBd0cFCqpYinok-yjniHObhfAEUNaH6BfZiJfAa1VkkIje4Jflyoh6Eta73u_VihZmGfN669svBmMP4VCiACltnSFvieQK6uAY8NwSObDQ%3D%3D HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:15 -0600] "GET /pulp/repos/tkc-holdings/pnp-production/c7stable/custom/centos/c7/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3"
==> /var/log/messages <==
Feb 14 13:42:21 sl2mmgplsat0001 pulp_streamer: nectar.downloaders.threaded:ERROR: Skipping requests to mirror.clarkson.edu due to repeated connection failures: HTTPConnectionPool(host='mirror.clarkson.edu', port=80): Max retries exceeded with url: /centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.HTTPConnection object at 0x4690890>, 'Connection to mirror.clarkson.edu timed out. (connect timeout=6.05)'))
Feb 14 13:42:21 sl2mmgplsat0001 pulp_streamer: [-] 127.0.0.1 - - [14/Feb/2017:19:42:21 +0000] "GET /var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
Feb 14 13:42:21 sl2mmgplsat0001 pulp_streamer: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (23): mirror.clarkson.edu
==> /var/log/httpd/foreman-ssl_access_ssl.log <==
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:15 -0600] "GET /streamer/var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4zMyJ9LCAicmVzb3VyY2UiOiAiL3N0cmVhbWVyL3Zhci9saWIvcHVscC9jb250ZW50L3VuaXRzL3JwbS9lNS9mYmJlODFiZTdlYzhhNWM4NjMyNzIwMGIyMzNlOTc1MzNlYzc1NDQwNzBjZWM1NzhiM2VhZTA1MDIzN2E0Yy9NeVNRTC1weXRob24tMS4yLjUtMS5lbDcueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzEwMTQyNX0%3D;signature=bzUdGI6ZutyR95p8NrTVxYJQrSMz9eqYz4Z-FCuBO-PYlkx3sYksikaygltJV-VE6_ZdQNEeg8ttsVR8EtDktX3VSNU-5X6map6eWRDN2gcj_Wkz0SuQX9Q7kLO-GsWHcf8-mzL6YUzPmOKr9YZYSlnO_VYS8sPqx_FqtTeh2Ry17Jg452Y3D0ggfWxBU-O5xo1ggbM10aLaXjWXuRDDAtqg7PH-eMpbzdnFhyWnGYIpa-6VYXu9Rz2u3J4ZBj4Cejmn1zVvXyv4fcn6x3vauwcNJMan4SZt8cJhNN6Hx2ye_ySUkJ12mnSEkaA4SWUXEeG8Hf0OCOLgsK3gPbYC2w%3D%3D HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:21 -0600] "GET /pulp/repos/tkc-holdings/pnp-production/c7stable/custom/centos/c7/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3"
==> /var/log/messages <==
Feb 14 13:42:27 sl2mmgplsat0001 pulp_streamer: nectar.downloaders.threaded:ERROR: Skipping requests to mirror.clarkson.edu due to repeated connection failures: HTTPConnectionPool(host='mirror.clarkson.edu', port=80): Max retries exceeded with url: /centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.HTTPConnection object at 0x4690e10>, 'Connection to mirror.clarkson.edu timed out. (connect timeout=6.05)'))
Feb 14 13:42:27 sl2mmgplsat0001 pulp_streamer: [-] 127.0.0.1 - - [14/Feb/2017:19:42:27 +0000] "GET /var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
Feb 14 13:42:27 sl2mmgplsat0001 pulp_streamer: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (24): mirror.clarkson.edu
==> /var/log/httpd/foreman-ssl_access_ssl.log <==
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:21 -0600] "GET /streamer/var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4zMyJ9LCAicmVzb3VyY2UiOiAiL3N0cmVhbWVyL3Zhci9saWIvcHVscC9jb250ZW50L3VuaXRzL3JwbS9lNS9mYmJlODFiZTdlYzhhNWM4NjMyNzIwMGIyMzNlOTc1MzNlYzc1NDQwNzBjZWM1NzhiM2VhZTA1MDIzN2E0Yy9NeVNRTC1weXRob24tMS4yLjUtMS5lbDcueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzEwMTQzMX0%3D;signature=tdkNdk4ZivUJ80DkFV0c0hiZodMhNmdQVe8-gbVJBVcoCRvlixFGb2DqhgTKNixnrTv1aV8bOVpJ4NWkkH15jLy6LZaQ9eXuc0GjczSNMpWUIJ_aYHnWbOnC6PN78_Xt3TwWzzD7evBQdMHTXKLCPrKZ2mhSRvQUflbm_4pe08Lf6IIW50-2owndJcfy0lUsMvGIO_pAdvyGkwi2FjlGSFJb_Tdl2qhlqrgS6uIQiQu_f7zbOt_mfZQmxFGi_sGoiCQ4k2_JEL1Xkf9qmCTItIJhkyX6tNcjnTX2hZ0HAiT7riooqFDZzZTw0zmHL1FuccjaDRlzBSShFRxmjlfUbw%3D%3D HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:27 -0600] "GET /pulp/repos/tkc-holdings/pnp-production/c7stable/custom/centos/c7/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3"
==> /var/log/messages <==
Feb 14 13:42:33 sl2mmgplsat0001 pulp_streamer: nectar.downloaders.threaded:ERROR: Skipping requests to mirror.clarkson.edu due to repeated connection failures: HTTPConnectionPool(host='mirror.clarkson.edu', port=80): Max retries exceeded with url: /centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.HTTPConnection object at 0x4690cd0>, 'Connection to mirror.clarkson.edu timed out. (connect timeout=6.05)'))
Feb 14 13:42:33 sl2mmgplsat0001 pulp_streamer: [-] 127.0.0.1 - - [14/Feb/2017:19:42:33 +0000] "GET /var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
Feb 14 13:42:34 sl2mmgplsat0001 pulp_streamer: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (25): mirror.clarkson.edu
==> /var/log/httpd/foreman-ssl_access_ssl.log <==
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:27 -0600] "GET /streamer/var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4zMyJ9LCAicmVzb3VyY2UiOiAiL3N0cmVhbWVyL3Zhci9saWIvcHVscC9jb250ZW50L3VuaXRzL3JwbS9lNS9mYmJlODFiZTdlYzhhNWM4NjMyNzIwMGIyMzNlOTc1MzNlYzc1NDQwNzBjZWM1NzhiM2VhZTA1MDIzN2E0Yy9NeVNRTC1weXRob24tMS4yLjUtMS5lbDcueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzEwMTQzN30%3D;signature=Af0pcqiwj0XDRQrfcjRh6o4h4opZ8hrbn7IsyEoBHMQis2QyX8TqzM79eg_PVPcGxf1h4eY0RsxxeFqQOrTrw7DMyTXd6R1AS9fVKX0kI7GlJlnxqs7BX5QtemFhA1U4Q7ZdO_A16DcxUQW-swlkKzVQffYFMrARIbC4DcrNebJRJYyXKep4XSQ79u8CMtwNGoO_fvnOf9JeclLdguwZI5Zuzbm-CykEGJLDNjIu3fvZQRi6fpI-B6rv3X9ercFT5kSx5xp9_oRCiGkAAa95Y9YIua2iBRgefQCnxk0tp0_4StPKgEUNyagYkED6SRl7ucqbXbEM42ka7MLQaB6EAQ%3D%3D HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:33 -0600] "GET /pulp/repos/tkc-holdings/pnp-production/c7stable/custom/centos/c7/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3"
==> /var/log/messages <==
Feb 14 13:42:40 sl2mmgplsat0001 pulp_streamer: nectar.downloaders.threaded:ERROR: Skipping requests to mirror.clarkson.edu due to repeated connection failures: HTTPConnectionPool(host='mirror.clarkson.edu', port=80): Max retries exceeded with url: /centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.HTTPConnection object at 0x4690cd0>, 'Connection to mirror.clarkson.edu timed out. (connect timeout=6.05)'))
Feb 14 13:42:40 sl2mmgplsat0001 pulp_streamer: [-] 127.0.0.1 - - [14/Feb/2017:19:42:39 +0000] "GET /var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
Feb 14 13:42:40 sl2mmgplsat0001 pulp_streamer: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (26): mirror.clarkson.edu
==> /var/log/httpd/foreman-ssl_access_ssl.log <==
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:33 -0600] "GET /streamer/var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4zMyJ9LCAicmVzb3VyY2UiOiAiL3N0cmVhbWVyL3Zhci9saWIvcHVscC9jb250ZW50L3VuaXRzL3JwbS9lNS9mYmJlODFiZTdlYzhhNWM4NjMyNzIwMGIyMzNlOTc1MzNlYzc1NDQwNzBjZWM1NzhiM2VhZTA1MDIzN2E0Yy9NeVNRTC1weXRob24tMS4yLjUtMS5lbDcueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzEwMTQ0M30%3D;signature=Ux8s1cuKeyzUVpa1spxeEVftblI9n1xC11aInsXzCeCcx9k276MM8KWMKRQUZP5XesAOQuy8PYmfGXVg0YoBFrHdcHEive6O2Ox_lD3ZkA8CcwMeBES-rkxwgQLKYCszm2_avzHJRHoVcSXp9e8Ng0__hhSDyYO6HDX3kRJe4N2BIwrFFnWn8K8fBW_v3Mx6EsiErJq8CqauGES3sRLZCrQxdsUwah_fCKe2nfSvhT__ES2P9jfAdQeUenHDdnwOVOI5AMrld6V9yujGtnRnYZbSnp0xwEngl0xfLHqRyxc9jwiVJ7eD0nSrGXEZ3wVLJ9FGqmbpPv_lBUE6zj538Q%3D%3D HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:40 -0600] "GET /pulp/repos/tkc-holdings/pnp-production/c7stable/custom/centos/c7/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3"
==> /var/log/messages <==
Feb 14 13:42:46 sl2mmgplsat0001 pulp_streamer: nectar.downloaders.threaded:ERROR: Skipping requests to mirror.clarkson.edu due to repeated connection failures: HTTPConnectionPool(host='mirror.clarkson.edu', port=80): Max retries exceeded with url: /centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.HTTPConnection object at 0x4690cd0>, 'Connection to mirror.clarkson.edu timed out. (connect timeout=6.05)'))
Feb 14 13:42:46 sl2mmgplsat0001 pulp_streamer: [-] 127.0.0.1 - - [14/Feb/2017:19:42:45 +0000] "GET /var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
Feb 14 13:42:46 sl2mmgplsat0001 pulp_streamer: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (27): mirror.clarkson.edu
==> /var/log/httpd/foreman-ssl_access_ssl.log <==
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:40 -0600] "GET /streamer/var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4zMyJ9LCAicmVzb3VyY2UiOiAiL3N0cmVhbWVyL3Zhci9saWIvcHVscC9jb250ZW50L3VuaXRzL3JwbS9lNS9mYmJlODFiZTdlYzhhNWM4NjMyNzIwMGIyMzNlOTc1MzNlYzc1NDQwNzBjZWM1NzhiM2VhZTA1MDIzN2E0Yy9NeVNRTC1weXRob24tMS4yLjUtMS5lbDcueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzEwMTQ1MH0%3D;signature=S4A8_oVGDjM1hSBdKlmXFUICm-QOhytN4meGjWI5teMxSNGxuUF99hr__uy_PINxqFpHt5Xu055SkkUHQ5zjBRnmjK1L1A54hge0eXGCSFED9LwGw9X2CRVT7LaETj79F14pWXu5C108gvXDKhfpjOiNcXx0p8piM-w5niuKXsdwQi7zTLpZ41PmamI4qwpiDZvi8TArhfQN2hGuPtCsT1au5o-cgiXda01pk04q59ivt59CjLLboM-cHPzLqZkEEgw1JM9xL3HtRRr3Bzy2Soo8W6QIipbjVjoqak3nB0QDD---Op3o98W4LzuJuPbUJH1bNVd-ovJB1mEEnZiMcw%3D%3D HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:46 -0600] "GET /pulp/repos/tkc-holdings/pnp-production/c7stable/custom/centos/c7/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3"
==> /var/log/messages <==
Feb 14 13:42:52 sl2mmgplsat0001 pulp_streamer: nectar.downloaders.threaded:ERROR: Skipping requests to mirror.clarkson.edu due to repeated connection failures: HTTPConnectionPool(host='mirror.clarkson.edu', port=80): Max retries exceeded with url: /centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.HTTPConnection object at 0x4690cd0>, 'Connection to mirror.clarkson.edu timed out. (connect timeout=6.05)'))
Feb 14 13:42:52 sl2mmgplsat0001 pulp_streamer: [-] 127.0.0.1 - - [14/Feb/2017:19:42:52 +0000] "GET /var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
Feb 14 13:42:52 sl2mmgplsat0001 pulp_streamer: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (28): mirror.clarkson.edu
==> /var/log/httpd/foreman-ssl_access_ssl.log <==
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:46 -0600] "GET /streamer/var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4zMyJ9LCAicmVzb3VyY2UiOiAiL3N0cmVhbWVyL3Zhci9saWIvcHVscC9jb250ZW50L3VuaXRzL3JwbS9lNS9mYmJlODFiZTdlYzhhNWM4NjMyNzIwMGIyMzNlOTc1MzNlYzc1NDQwNzBjZWM1NzhiM2VhZTA1MDIzN2E0Yy9NeVNRTC1weXRob24tMS4yLjUtMS5lbDcueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzEwMTQ1Nn0%3D;signature=JKLf9y6ohBUnUxcVAKZqNUxiyPyhaIpsm2aHdem2Dp9xwmhyRJbBRuhDkSedF6Ae9rMXawKTOSWofX-Fzyk9h3oOZwPwZdpvhnbmb5MLnYP45M-eE8n-FhsI5GFkZcv9TpauTJL_gzpUzKostL8fNuarL9wa_GQdbYVfTIu9SETHMFIRYxKV4Xr0P6DvDaA2v2wjaraXQja2dX8Vh9AkkJ3X0CSHvDdXpeuGe70rknuAj1d9quPpGHncewCbBXqEus2_X1TL7xpGhbZNf60R8wSMZ2Oj7162ZKG_xQJRg4l-8Am3LMPhSxJF7TCdwTxe8plHrvqisI8ofgbnpsEwlw%3D%3D HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:52 -0600] "GET /pulp/repos/tkc-holdings/pnp-production/c7stable/custom/centos/c7/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3"
==> /var/log/messages <==
Feb 14 13:42:58 sl2mmgplsat0001 pulp_streamer: nectar.downloaders.threaded:ERROR: Skipping requests to mirror.clarkson.edu due to repeated connection failures: HTTPConnectionPool(host='mirror.clarkson.edu', port=80): Max retries exceeded with url: /centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.HTTPConnection object at 0x4690cd0>, 'Connection to mirror.clarkson.edu timed out. (connect timeout=6.05)'))
Feb 14 13:42:58 sl2mmgplsat0001 pulp_streamer: [-] 127.0.0.1 - - [14/Feb/2017:19:42:58 +0000] "GET /var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
Feb 14 13:42:58 sl2mmgplsat0001 pulp_streamer: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (29): mirror.clarkson.edu
==> /var/log/httpd/foreman-ssl_access_ssl.log <==
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:52 -0600] "GET /streamer/var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4zMyJ9LCAicmVzb3VyY2UiOiAiL3N0cmVhbWVyL3Zhci9saWIvcHVscC9jb250ZW50L3VuaXRzL3JwbS9lNS9mYmJlODFiZTdlYzhhNWM4NjMyNzIwMGIyMzNlOTc1MzNlYzc1NDQwNzBjZWM1NzhiM2VhZTA1MDIzN2E0Yy9NeVNRTC1weXRob24tMS4yLjUtMS5lbDcueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzEwMTQ2Mn0%3D;signature=pbkwa8nSLs9NEcgFkkgPbLoml54upZ4tZlyCV1wFzkZXHxOmNUjfMpV_Q4FUdWkp7K20i1kmZ4ZYPsxZsWy70qNPTARZREP8lTF1KVq0epsJn0e-fmw7lgz4McVkc_1vRREDhEOP4v6rGBYDw5-t37bIIfQQpjrGaFLe6Zw8VtLxkr_SQDKhKusDqUCyqxsVmkDI_qYN6eFQRw8JtYT8nfTTNpwAhL4kO6prYXs8wQcXmUrFLEuGTV-V1hCbRKEUTaL5xtIp3hdX9c0N5E4TKITXwisYjVZlYmt1owgXKUpKvIHh4j5mFopWjFokv1RAAylSOz8oHlAn9fDasTcPyw%3D%3D HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:58 -0600] "GET /pulp/repos/tkc-holdings/pnp-production/c7stable/custom/centos/c7/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3"
==> /var/log/messages <==
Feb 14 13:43:04 sl2mmgplsat0001 pulp_streamer: nectar.downloaders.threaded:ERROR: Skipping requests to mirror.clarkson.edu due to repeated connection failures: HTTPConnectionPool(host='mirror.clarkson.edu', port=80): Max retries exceeded with url: /centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.HTTPConnection object at 0x4690cd0>, 'Connection to mirror.clarkson.edu timed out. (connect timeout=6.05)'))
Feb 14 13:43:04 sl2mmgplsat0001 pulp_streamer: [-] 127.0.0.1 - - [14/Feb/2017:19:43:04 +0000] "GET /var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
Feb 14 13:43:04 sl2mmgplsat0001 pulp_streamer: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (30): mirror.clarkson.edu
==> /var/log/httpd/foreman-ssl_access_ssl.log <==
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:42:58 -0600] "GET /streamer/var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4zMyJ9LCAicmVzb3VyY2UiOiAiL3N0cmVhbWVyL3Zhci9saWIvcHVscC9jb250ZW50L3VuaXRzL3JwbS9lNS9mYmJlODFiZTdlYzhhNWM4NjMyNzIwMGIyMzNlOTc1MzNlYzc1NDQwNzBjZWM1NzhiM2VhZTA1MDIzN2E0Yy9NeVNRTC1weXRob24tMS4yLjUtMS5lbDcueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzEwMTQ2OH0%3D;signature=LTIdtE_1BOI8k4lfB6YmUjuqQ-invKsucjBRFrc2xdMTKLBWf4zDyteI-P22DJFk6aj9tzOLY5-FYFnpWefNAW34L31ZXzMaxEIS345zl6tjiE-y36WnsMOSyI1D7lnIvOPyd8QmKUDS-gT4BI2PNCd_CwNFWH4o1eYd0KZGwiU-v8qp_CScsZSJSz_A7GCEAO7JvWS99OyQoukvm7Q3cOY_QtXnbEmyqs8_mofzJ14FN2GZUvaaAJO_u4NMyDK4iAJoHnx939vQNBy1Fa31bDeElu5mONQdJ1RjpqH8L_9qdgVt_sgRVhhjgmE30skL7YQXclUgt_vnFmVF5bhSng%3D%3D HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:43:04 -0600] "GET /pulp/repos/tkc-holdings/pnp-production/c7stable/custom/centos/c7/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3"
==> /var/log/messages <==
Feb 14 13:43:10 sl2mmgplsat0001 pulp_streamer: nectar.downloaders.threaded:ERROR: Skipping requests to mirror.clarkson.edu due to repeated connection failures: HTTPConnectionPool(host='mirror.clarkson.edu', port=80): Max retries exceeded with url: /centos/7.3.1611/os/x86_64/Packages/MySQL-python-1.2.5-1.el7.x86_64.rpm (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.HTTPConnection object at 0x4690cd0>, 'Connection to mirror.clarkson.edu timed out. (connect timeout=6.05)'))
Feb 14 13:43:10 sl2mmgplsat0001 pulp_streamer: [-] 127.0.0.1 - - [14/Feb/2017:19:43:10 +0000] "GET /var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
==> /var/log/httpd/foreman-ssl_access_ssl.log <==
172.16.246.33 - 2c9076bc5a25cd69015a3dc17f910176 [14/Feb/2017:13:43:04 -0600] "GET /streamer/var/lib/pulp/content/units/rpm/e5/fbbe81be7ec8a5c86327200b233e97533ec7544070cec578b3eae050237a4c/MySQL-python-1.2.5-1.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4zMyJ9LCAicmVzb3VyY2UiOiAiL3N0cmVhbWVyL3Zhci9saWIvcHVscC9jb250ZW50L3VuaXRzL3JwbS9lNS9mYmJlODFiZTdlYzhhNWM4NjMyNzIwMGIyMzNlOTc1MzNlYzc1NDQwNzBjZWM1NzhiM2VhZTA1MDIzN2E0Yy9NeVNRTC1weXRob24tMS4yLjUtMS5lbDcueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzEwMTQ3NH0%3D;signature=mtpT_N2hwt4gwIgzs51gVBhuikaEDXyoG3MDUPmQOs8NIeh004k1V5OWffJvec-MjKMKi2F8TC7nIiBj3KByqAgCiHiPs1t6JR2M0PYje8RxRFfAIncYVSI1SIRJsFOCNFEcwqd_d8AvWTeIDENPXeiueDRiA0u4HRCmq_ZTs5Ht_fk0s3X0uPRQdclbCLncmdPzjMzt7MItk4T-c0uSpN5-fr04qmj-6vLK6fHGOh4XkvF0WXJJLMr9jvWkSkqF0KDiAzspHrZc36AjHTOjAB6qBWWs7c-0_61fjJXZi4RkFv7lLoqnuS91s7r4Em64G9ROks_VBLttoJdJOSoUPw%3D%3D HTTP/1.1" 503 - "-" "urlgrabber/3.10 yum/3.4.3"
</code></pre> Pulp - Issue #2586 (CLOSED - NOTABUG): Pulp workers/beat/resource_manager go missinghttps://pulp.plan.io/issues/25862017-02-13T20:52:22Zehelms@redhat.comehelms@redhat.com
<p>Running on Pulp 2.10.3, I see the following error messages running this setup:</p>
<p>clone <a href="https://github.com/Katello/forklift" class="external">https://github.com/Katello/forklift</a><br>
vagrant up centos7-katello-nightly</p>
<p>If you do not see the error messages initially:</p>
<pre><code>vagrant ssh centos7-katello-nightly
cd /
/vagrant/forklift/bats/bootstrap_vagrant.sh
cd /vagrant/forklift/bats
bats fb-install-katello.bats fb-content-katello.bats
</code></pre>
<pre><code>Feb 13 20:45:22 centos7 pulp: pulp.server.async.scheduler:ERROR: There are 0 pulp_resource_manager processes running. Pulp will not operate correctly without at least one pulp_resource_mananger process running.
Feb 13 20:46:22 centos7 pulp: pulp.server.async.scheduler:ERROR: There are 0 pulp_resource_manager processes running. Pulp will not operate correctly without at least one pulp_resource_mananger process running.
Feb 13 20:47:22 centos7 pulp: pulp.server.async.scheduler:ERROR: There are 0 pulp_resource_manager processes running. Pulp will not operate correctly without at least one pulp_resource_mananger process running.
Feb 13 20:48:22 centos7 pulp: pulp.server.async.scheduler:ERROR: There are 0 pulp_resource_manager processes running. Pulp will not operate correctly without at least one pulp_resource_mananger process running.
Feb 13 20:49:22 centos7 pulp: pulp.server.async.scheduler:ERROR: There are 0 pulp_resource_manager processes running. Pulp will not operate correctly without at least one pulp_resource_mananger process running.
Feb 13 20:50:22 centos7 pulp: pulp.server.async.scheduler:ERROR: There are 0 pulp_resource_manager processes running. Pulp will not operate correctly without at least one pulp_resource_mananger process running.
</code></pre> Pulp - Issue #2487 (CLOSED - DUPLICATE): Sync failure - DocumentTooLargehttps://pulp.plan.io/issues/24872016-12-13T14:54:52Zehelms@redhat.comehelms@redhat.com
<p>Trying to sync: <a href="https://fedorapeople.org/groups/katello/releases/yum/foreman/1.13/el6/x86_64/" class="external">https://fedorapeople.org/groups/katello/releases/yum/foreman/1.13/el6/x86_64/</a></p>
<pre><code>Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) command document too large
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) Traceback (most recent call last):
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 224, in run
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) self.update_content(metadata_files, url)
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 488, in update_content
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) self.download_rpms(metadata_files, rpms_to_download, url)
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 685, in download_rpms
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) unit = self.add_rpm_unit(metadata_files, unit)
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 632, in add_rpm_unit
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) unit.save()
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) File "/usr/lib/python2.7/site-packages/mongoengine/document.py", line 324, in save
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) object_id = collection.save(doc, **write_concern)
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 2180, in save
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) check_keys, False, manipulate, write_concern)
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 709, in _update
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) codec_options=self.codec_options).copy()
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 216, in command
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) self._raise_connection_failure(error)
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 343, in _raise_connection_failure
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) raise error
Dec 13 14:43:42 bye-capsule pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: (31174-60384) DocumentTooLarge: command document too large
Dec 13 14:43:42 bye-capsule pulp: py.warnings:WARNING: (31174-60384) /usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py:804: DeprecationWarning: save is deprecated. Use insert_one or replace_one instead
Dec 13 14:43:42 bye-capsule pulp: py.warnings:WARNING: (31174-60384) sync_result_collection.save(sync_result)
Dec 13 14:43:42 bye-capsule pulp: py.warnings:WARNING: (31174-60384)
Dec 13 14:43:42 bye-capsule pulp: pulp.server.async.tasks:INFO: Task failed : [a9d888c3-8886-44b6-abf2-64141d6912d5]
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) Task pulp.server.managers.repo.sync.sync[a9d888c3-8886-44b6-abf2-64141d6912d5] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) Traceback (most recent call last):
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) R = retval = fun(*args, **kwargs)
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 488, in __call__
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) return super(Task, self).__call__(*args, **kwargs)
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 103, in __call__
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) return super(PulpTask, self).__call__(*args, **kwargs)
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) return self.run(*args, **kwargs)
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 810, in sync
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) raise pulp_exceptions.PulpExecutionException(_('Importer indicated a failed response'))
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:ERROR: (30789-60384) PulpExecutionException: Importer indicated a failed response
Dec 13 14:43:43 bye-capsule pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[83065288-0fc5-4f56-9dc0-d3089e8b5162] succeeded in 0.0121840410002s: None
Dec 13 14:44:34 bye-capsule pulp: celery.beat:INFO: Scheduler: Sending due task download_deferred_content (pulp.server.controllers.repository.queue_download_deferred)
Dec 13 14:44:34 bye-capsule pulp: celery.worker.strategy:INFO: Received task: pulp.server.controllers.repository.queue_download_deferred[659a3d93-4df1-47cd-bc69-9938359aa351]
Dec 13 14:44:34 bye-capsule pulp: celery.worker.strategy:INFO: Received task: pulp.server.controllers.repository.download_deferred[5974d77b-bfad-4b55-9b25-b3d9501f5c1c]
Dec 13 14:44:34 bye-capsule pulp: celery.worker.job:INFO: Task pulp.server.controllers.repository.queue_download_deferred[659a3d93-4df1-47cd-bc69-9938359aa351] succeeded in 0.041977586s: None
Dec 13 14:44:34 bye-capsule pulp: celery.worker.job:INFO: Task pulp.server.controllers.repository.download_deferred[5974d77b-bfad-4b55-9b25-b3d9501f5c1c] succeeded in 0.040159016s: None
</code></pre> Pulp - Story #2434 (CLOSED - WONTFIX): Add timing output to sync task stepshttps://pulp.plan.io/issues/24342016-11-21T18:26:29Zehelms@redhat.comehelms@redhat.com
<p>There are times with Pulp syncs take a long time with no clear understanding of which step(s) took abnormally long to complete. An example progress report can be seen below.</p>
<p>This is a request to add start and finish times to the individual steps (e.g. comps, purge_duplicates, errata) so that tasks can be analyzed for errant behavior. This is useful for debugging a singular sync that has gone awry as well as to bulk analyze systematic issues across a number of Pulp syncs. This could help identify issues with the underlying host and resources, Pulp itself or potential performance issues with the code for a given step.</p>
<pre><code> progress_report:
yum_importer:
content:
items_total: 0
state: FINISHED
error_details: []
details:
rpm_total: 0
rpm_done: 0
drpm_total: 0
drpm_done: 0
size_total: 0
size_left: 0
items_left: 0
comps:
state: FINISHED
purge_duplicates:
state: FINISHED
distribution:
items_total: 0
state: FINISHED
error_details: []
items_left: 0
errata:
state: FINISHED
metadata:
state: FINISHED
</code></pre> Pulp - Issue #2433 (CLOSED - WONTFIX): Re-uploading results in old file still being servedhttps://pulp.plan.io/issues/24332016-11-21T18:21:55Zehelms@redhat.comehelms@redhat.com
<p>Using the iso type of repository, a user can upload the same file multiple times. However, the 'last' one to be uploaded is the not the current one being served by the repository. The generated PULP_MANIFEST indicates the various versions of this file that have been uploaded but they appear in semi-random order. An example:</p>
<pre><code>foreman-1.13.1.1.tar.bz2,c2a1985f371a8152b96c8927511e7402d2bbf64e2acb084470ec462df97b1bcc,11582712
foreman-1.13.1.1.tar.bz2,aa7bdcc0c30e2a843a1f74672292d04231749d5b8859e41b597129826ecc8f96,29676401
foreman-1.13.1.1.tar.bz2,f217c027bde37e426ccd8912b48c2f817621b7586359317cd338d5476c2f8a58,11586229
foreman-1.13.1.1.tar.bz2,2b5fc81f743de034eb38232a3d60467b3b71e819c84729a2fdcfedbfd1e3ae86,11583659
foreman-1.13.1.1.tar.bz2,4cde275645bafe5b46448925dec1c6b295119bcd4b4b4ab76cc04f38109f2398,29859413
foreman_theme_satellite-1.0.0.gem,03f8ac79b51cb68f9308249396881a827d5b81840bed58bf466133cef6c37120,158720
</code></pre>
<p>Further, this behavior appears with the YUM repository type as well. A user can:</p>
<pre><code>1) sync a repository
2) upload an RPM that was synced down with a different checksum (maybe the underlying source changed)
3) Pulp will accept the upload with success
4) check the yum metadata and note both checksums in it but only one copy of the RPM in the repo (this will lead to yum errors)
</code></pre> Packaging - Issue #1147 (CLOSED - CURRENTRELEASE): Pulp's published src RPMs are not a yum repohttps://pulp.plan.io/issues/11472015-07-22T21:54:08Zehelms@redhat.comehelms@redhat.com
<p>For example, no repodata here <a href="https://repos.fedorapeople.org/repos/pulp/pulp/stable/2.6/6/src/" class="external">https://repos.fedorapeople.org/repos/pulp/pulp/stable/2.6/6/src/</a></p>