Pulp: Issueshttps://pulp.plan.io/https://pulp.plan.io/favicon.ico2021-08-02T19:37:16ZPulp
Planio Migration Plugin - Issue #9191 (CLOSED - DUPLICATE): Migrated advisories with dates-as-timestamps...https://pulp.plan.io/issues/91912021-08-02T19:37:16Zggainey
<p><strong>Ticket moved to GitHub</strong>: "pulp/pulp-2to3-migration/issues/483": <a href="https://github.com/pulp/pulp-2to3-migration/issues/483" class="external">https://github.com/pulp/pulp-2to3-migration/issues/483</a></p> Debian Support - Issue #8544 (CLOSED - DUPLICATE): Add some translation files to at least one tes...https://pulp.plan.io/issues/85442021-04-12T15:36:57Zquba42
<p><strong>Ticket moved to GitHub</strong>: "pulp/pulp_deb/401":<a href="https://github.com/pulp/pulp_deb/issues/401" class="external">https://github.com/pulp/pulp_deb/issues/401</a></p>
<hr>
<p>Should provide test coverage for the following:</p>
<ul>
<li><a href="https://pulp.plan.io/issues/8410" class="external">https://pulp.plan.io/issues/8410</a></li>
<li><a href="https://pulp.plan.io/issues/8096" class="external">https://pulp.plan.io/issues/8096</a></li>
</ul> Debian Support - Issue #8028 (CLOSED - WORKSFORME): Cannot sync Ubuntu repositorieshttps://pulp.plan.io/issues/80282020-12-29T03:40:11Znhavens
<p>With the following remote configuration, I'm unable to sync to a pulp repository:</p>
<pre><code class="json syntaxhl" data-language="json"><span class="p">{</span><span class="w">
</span><span class="nl">"pulp_href"</span><span class="p">:</span><span class="w"> </span><span class="s2">"/pulp/api/v3/remotes/deb/apt/d5143b62-3f97-4f10-a466-734dcd4d5146/"</span><span class="p">,</span><span class="w">
</span><span class="nl">"pulp_created"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2020-12-29T02:49:24.689377Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"name"</span><span class="p">:</span><span class="w"> </span><span class="s2">"ubuntu"</span><span class="p">,</span><span class="w">
</span><span class="nl">"url"</span><span class="p">:</span><span class="w"> </span><span class="s2">"http://mirror.us.leaseweb.net/ubuntu"</span><span class="p">,</span><span class="w">
</span><span class="nl">"ca_cert"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"client_cert"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"client_key"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"tls_validation"</span><span class="p">:</span><span class="w"> </span><span class="kc">true</span><span class="p">,</span><span class="w">
</span><span class="nl">"proxy_url"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"username"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"password"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"pulp_last_updated"</span><span class="p">:</span><span class="w"> </span><span class="s2">"2020-12-29T03:06:33.546708Z"</span><span class="p">,</span><span class="w">
</span><span class="nl">"download_concurrency"</span><span class="p">:</span><span class="w"> </span><span class="mi">10</span><span class="p">,</span><span class="w">
</span><span class="nl">"policy"</span><span class="p">:</span><span class="w"> </span><span class="s2">"immediate"</span><span class="p">,</span><span class="w">
</span><span class="nl">"total_timeout"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"connect_timeout"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"sock_connect_timeout"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"sock_read_timeout"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"distributions"</span><span class="p">:</span><span class="w"> </span><span class="s2">"bionic bionic-backports bionic-proposed bionic-security bionic-updates"</span><span class="p">,</span><span class="w">
</span><span class="nl">"components"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"architectures"</span><span class="p">:</span><span class="w"> </span><span class="s2">"amd64 i386"</span><span class="p">,</span><span class="w">
</span><span class="nl">"sync_sources"</span><span class="p">:</span><span class="w"> </span><span class="kc">false</span><span class="p">,</span><span class="w">
</span><span class="nl">"sync_udebs"</span><span class="p">:</span><span class="w"> </span><span class="kc">true</span><span class="p">,</span><span class="w">
</span><span class="nl">"sync_installer"</span><span class="p">:</span><span class="w"> </span><span class="kc">true</span><span class="p">,</span><span class="w">
</span><span class="nl">"gpgkey"</span><span class="p">:</span><span class="w"> </span><span class="kc">null</span><span class="p">,</span><span class="w">
</span><span class="nl">"ignore_missing_package_indices"</span><span class="p">:</span><span class="w"> </span><span class="kc">false</span><span class="w">
</span></code></pre>
<p>I get the following error message:</p>
<pre><code>Dec 28 21:32:42 pulp-server rq[48697]: psycopg2.errors.UniqueViolation: duplicate key value violates unique constraint "core_artifact_sha256_key"
Dec 28 21:32:42 pulp-server rq[48697]: DETAIL: Key (sha256)=(e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855) already exists.
</code></pre>
<p>If I subsequently patch the remote to set <code>ignore_missing_package_indices=true</code>, the sync also fails, but with a different error message:</p>
<pre><code>Dec 28 21:36:19 pulp-server rq[48741]: psycopg2.errors.UniqueViolation: duplicate key value violates unique constraint "core_contentartifact_content_id_relative_path_d2ef8231_uniq"
Dec 28 21:36:19 pulp-server rq[48741]: DETAIL: Key (content_id, relative_path)=(6bfcee15-6b12-4c36-831d-9b34d1dc9cf8, dists/bionic-backports) already exists.
</code></pre>
<p>I'd be happy to provide full stack traces if that would be helpful.</p> Debian Support - Issue #7756 (CLOSED - WONTFIX): Content upload has different method-definintion ...https://pulp.plan.io/issues/77562020-10-27T15:58:32Zmbucher
<p>Looking at the generated API-Bindings for ruby, the method for creating/uploading a new deb-package differs from the one used for e.g. rpm.</p>
<pre><code class="ruby syntaxhl" data-language="ruby"><span class="k">module</span> <span class="nn">PulpDebClient</span>
<span class="k">class</span> <span class="nc">ContentPackagesApi</span>
<span class="o">...</span>
<span class="k">def</span> <span class="nf">create</span><span class="p">(</span><span class="n">opts</span> <span class="o">=</span> <span class="p">{})</span>
</code></pre>
<p>While in the RPM-bindings it looks like this:</p>
<pre><code class="ruby syntaxhl" data-language="ruby"><span class="k">module</span> <span class="nn">PulpRpmClient</span>
<span class="k">class</span> <span class="nc">ContentPackagesApi</span>
<span class="o">...</span>
<span class="k">def</span> <span class="nf">create</span><span class="p">(</span><span class="n">relative_path</span><span class="p">,</span> <span class="n">opts</span> <span class="o">=</span> <span class="p">{})</span>
</code></pre>
<p>The fact that <code>relative_path</code> is specified as parameter in the latter case seems to be due to the fact that in the API, <code>relative_path</code> is marked as required in pulp_rpm, but not in pulp_deb.</p>
<p><a href="https://pulp-deb.readthedocs.io/en/latest/restapi.html#operation/content_deb_packages_create" class="external">https://pulp-deb.readthedocs.io/en/latest/restapi.html#operation/content_deb_packages_create</a></p>
<p><a href="https://pulp-rpm.readthedocs.io/en/latest/restapi.html#operation/content_rpm_packages_create" class="external">https://pulp-rpm.readthedocs.io/en/latest/restapi.html#operation/content_rpm_packages_create</a></p>
<p>THis came up during the <a href="https://github.com/Katello/katello/pull/8632#issuecomment-709563551" class="external">katello integration of pulp_deb for pulpcore</a>.</p> Migration Plugin - Issue #6935 (CLOSED - WONTFIX): Validation failure reports incorrect resources...https://pulp.plan.io/issues/69352020-06-09T12:05:08Zttereshcttereshc@redhat.com
<p><code>rpm_unsigned</code> repo exists, <code>drpm</code> does not.</p>
<p>Migration Plan:</p>
<pre><code class="json syntaxhl" data-language="json"><span class="p">{</span><span class="w"> </span><span class="nl">"plan"</span><span class="p">:</span><span class="w"> </span><span class="p">{</span><span class="w">
</span><span class="nl">"plugins"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"type"</span><span class="p">:</span><span class="w"> </span><span class="s2">"rpm"</span><span class="p">,</span><span class="w">
</span><span class="nl">"repositories"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"name"</span><span class="p">:</span><span class="w"> </span><span class="s2">"rpm_unsigned"</span><span class="p">,</span><span class="w">
</span><span class="nl">"repository_versions"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w">
</span><span class="p">{</span><span class="w">
</span><span class="nl">"pulp2_repository_id"</span><span class="p">:</span><span class="w"> </span><span class="s2">"rpm_unsigned"</span><span class="p">,</span><span class="w">
</span><span class="nl">"pulp2_distributor_repository_ids"</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="w"> </span><span class="s2">"rpm_unsigned"</span><span class="p">,</span><span class="w"> </span><span class="s2">"drpm"</span><span class="w"> </span><span class="p">]</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span><span class="p">}</span><span class="w">
</span><span class="p">]</span><span class="w">
</span><span class="p">}}</span><span class="w">
</span></code></pre>
<p>Result (see the description, it should have onlt <code>drpm</code> there):</p>
<pre><code>$ http :/pulp/api/v3/tasks/7bf152e9-971e-48c4-82a7-9bd8a0ce80fe/
HTTP/1.1 200 OK
Allow: GET, PATCH, DELETE, HEAD, OPTIONS
Connection: Keep-Alive
Content-Length: 1250
Content-Type: application/json
Date: Tue, 09 Jun 2020 10:48:03 GMT
Keep-Alive: timeout=5, max=10000
Server: gunicorn/20.0.4
Vary: Accept,Cookie
X-Frame-Options: SAMEORIGIN
{
"child_tasks": [],
"created_resources": [],
"error": {
"description": "Validation failed: resources missing {'repositories_missing_distributors': ['drpm', 'rpm_unsigned']}",
"traceback": " File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py\", line 886, in perform_job\n rv = job.perform()\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 664, in perform\n self._result = self._execute()\n File \"/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py\", line 670, in _execute\n return self.func(*self.args, **self.kwargs)\n File \"/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/tasks/migrate.py\", line 102, in migrate_from_pulp2\n \"Validation failed: resources missing {}\".format(missing_resources)\n"
},
"finished_at": "2020-06-09T10:47:56.137359Z",
"name": "pulp_2to3_migration.app.tasks.migrate.migrate_from_pulp2",
"parent_task": null,
"progress_reports": [],
"pulp_created": "2020-06-09T10:47:55.933361Z",
"pulp_href": "/pulp/api/v3/tasks/7bf152e9-971e-48c4-82a7-9bd8a0ce80fe/",
"reserved_resources_record": [
"pulp_2to3_migration"
],
"started_at": "2020-06-09T10:47:56.090277Z",
"state": "failed",
"task_group": null,
"worker": "/pulp/api/v3/workers/1b7a3c5f-86f6-4da7-922f-2a61cf6eac56/"
}
</code></pre> CertGuard - Issue #6424 (CLOSED - CURRENTRELEASE): An expired client RHSM Certificate should be d...https://pulp.plan.io/issues/64242020-03-31T19:43:21Zbmbouterbmbouter@redhat.comMigration Plugin - Issue #6111 (CLOSED - CURRENTRELEASE): Re-migrations take nearly as long as in...https://pulp.plan.io/issues/61112020-02-07T14:31:24Zdalleydalley@redhat.com
<p>With a large repository, re-migrations take a very long time.</p>
<pre><code><jsherrill> i was also planning on testing re-migration time with that repo
<jsherrill> and that seemed really really slow
<jsherrill> but i wasn't sure if that was related to the fact that not all of the units migrated properly
<jsherrill> so was waiting for it to be fixed to test for sure
<jsherrill> like it seemed like it took ~an hour to re-migrate it
<jsherrill> i'm sure there is a lot of low-hanging fruit performance wise
<jsherrill> and i'm less concerned about initial migration time
</code></pre> Migration Plugin - Issue #5374 (CLOSED - WONTFIX): re-run of migration tooling has incorrect countshttps://pulp.plan.io/issues/53742019-08-30T14:08:43Zjsherril@redhat.comjsherril@redhat.com
<p>I synced a repo with ~14K files in pulp2 and then migrated all content to pulp3:</p>
<pre><code>{
"_created": "2019-08-29T18:59:50.347635Z",
"_href": "/pulp/api/v3/tasks/1a1a93c2-dfd6-4ba6-b54e-c74735a3ce5d/",
"created_resources": [],
"error": null,
"finished_at": "2019-08-29T19:01:37.544664Z",
"name": "pulp_2to3_migrate.app.tasks.migrate.migrate_from_pulp2",
"non_fatal_errors": [],
"parent": null,
"progress_reports": [
{
"done": 14444,
"message": "Pre-migrating Pulp 2 ISO content (general info)",
"state": "completed",
"suffix": null,
"total": 14447
},
{
"done": 14444,
"message": "Pre-migrating Pulp 2 ISO content (detail info)",
"state": "completed",
"suffix": null,
"total": 14447
},
{
"done": 14051,
"message": "Migrating ISO content to Pulp 3",
"state": "completed",
"suffix": null,
"total": 14453
},
{
"done": 14453,
"message": "Migrating content to Pulp 3",
"state": "completed",
"suffix": null,
"total": 14453
}
],
"reserved_resources_record": [
"pulp_2to3_migration"
],
"spawned_tasks": [],
"started_at": "2019-08-29T18:59:50.474079Z",
"state": "completed",
"worker": "/pulp/api/v3/workers/75176664-9633-46f5-8989-456923ba333a/"
}
</code></pre>
<p>the task counts here looked correct. I then re-ran the migration without any changes, and it looked like this:</p>
<pre><code>{
"_created": "2019-08-29T19:24:08.615486Z",
"_href": "/pulp/api/v3/tasks/eee0440a-0d46-48f8-8d3b-2bf711b7b0c4/",
"created_resources": [],
"error": null,
"finished_at": "2019-08-29T19:24:11.410935Z",
"name": "pulp_2to3_migrate.app.tasks.migrate.migrate_from_pulp2",
"non_fatal_errors": [],
"parent": null,
"progress_reports": [
{
"done": 390,
"message": "Migrating ISO content to Pulp 3",
"state": "completed",
"suffix": null,
"total": 402
},
{
"done": 402,
"message": "Migrating content to Pulp 3",
"state": "completed",
"suffix": null,
"total": 402
},
{
"done": 0,
"message": "Pre-migrating Pulp 2 ISO content (general info)",
"state": "completed",
"suffix": null,
"total": 0
},
{
"done": 0,
"message": "Pre-migrating Pulp 2 ISO content (detail info)",
"state": "completed",
"suffix": null,
"total": 0
}
],
"reserved_resources_record": [
"pulp_2to3_migration"
],
"spawned_tasks": [],
"started_at": "2019-08-29T19:24:08.732119Z",
"state": "completed",
"worker": "/pulp/api/v3/workers/75176664-9633-46f5-8989-456923ba333a/"
}
</code></pre>
<p>the counts for that first progress_report appears incorrect</p> Ansible Plugin - Issue #4996 (CLOSED - CURRENTRELEASE): Ansible collection remote doesn't handle ...https://pulp.plan.io/issues/49962019-06-19T20:06:58Zsajha
<p>Ex:<br>
With a url <a href="https://galaxy.ansible.com" class="external">https://galaxy.ansible.com</a> it works fine.<br>
With a url <a href="https://galaxy.ansible.com/" class="external">https://galaxy.ansible.com/</a> , throws the following error: <a href="https://gist.github.com/sjha4/0afdd783bac7cea56055b706f6b02155" class="external">https://gist.github.com/sjha4/0afdd783bac7cea56055b706f6b02155</a></p> File Support - Issue #3410 (CLOSED - CURRENTRELEASE): Rename content field "path" to "relative_path"https://pulp.plan.io/issues/34102018-02-28T13:54:51Zkersom
<p>When reading content from a repository, the response is:</p>
<pre><code> {'next': None,
'previous': None,
'results': [{'_href': 'http://f27-p3:8000/api/v3/content/file/44f4dfa2-1b80-459c-960b-079c4dd6e48c/',
'artifacts': {'2.iso': 'http://f27-p3:8000/api/v3/artifacts/cbce4558-59b9-4674-83d2-7f6dd2875b6e/'},
'digest': '3a1b7f18cb8e51f381a9ceb32447fcdaa070d41bbf2d9bd12f5ea1731dfe0b0b',
'notes': {},
'path': '2.iso',
'type': 'file'}]}
</code>
</code></pre>
<p>"path" should be renamed to "relative_path" to better denote its purpose.</p> Docker Support - Issue #2983 (CLOSED - WONTFIX): Default httpd configuration makes directory list...https://pulp.plan.io/issues/29832017-08-15T13:55:32Ztwaughtwaugh@redhat.com
<p>Because .../manifests/2 and .../manifests/list set specific media types in responses, directory listings for these locations also use those media types instead of text/html.</p>
<p>For example: using a web browser, navigate to <a href="https://pulp.example.com/pulp/docker/v2/repository-name/manifests/2/" class="external">https://pulp.example.com/pulp/docker/v2/repository-name/manifests/2/</a></p> Infrastructure - Issue #2913 (CLOSED - WONTFIX): Build is not marked as failed in some cases when...https://pulp.plan.io/issues/29132017-07-17T09:48:57Zttereshcttereshc@redhat.com
<p>Example: <a href="https://pulpadmin.fedorapeople.org/jenkins/jobs/unittest-pulp_deb-pr/builds/59/" class="external">https://pulpadmin.fedorapeople.org/jenkins/jobs/unittest-pulp_deb-pr/builds/59/</a></p>
<p>I guess build is marked as failed when at least one unit test didn't pass.<br>
But unit tests didn't run at all in the example, failure happened earlier.<br>
It's expected to see FAILED result in the table from example.</p> Nectar - Issue #2809 (CLOSED - WONTFIX): Logging fails in case of non-ascii characters in the urlhttps://pulp.plan.io/issues/28092017-06-09T19:26:49Zehalcik
<p>i have a repo defined as :</p>
<pre><code>pulp-admin rpm repo create --repo-id=oel-addons-x86_64-6 --feed=http://yum.oracle.com/repo/OracleLinux/OL6/addons/x86_64/ --relative-url=addons/oel/x86_64/6 --description "oel-addons-x86_64-6" --serve-http=true
</code></pre>
<p>Issuing the command <code>pulp-admin rpm repo sync run --repo-id=oel-addons-x86_64-6</code> results in this error.</p>
<pre><code>Task Failed
'ascii' codec can't decode byte 0xc3 in position 48: ordinal not in range(128)
</code></pre>
<p>/var/log/messages says this:</p>
<pre><code>pulp: celery.worker.job:ERROR: (14295-74720) Task pulp.server.managers.repo.sync.sync[7f04fd3b-d2d8-4b8b-ad1a-f30816a6e095] raised unexpected: UnicodeDecodeError('ascii', 'Downloading metadata from http://yum.oracle.com/\xc3\xa2\xc2\x80\xc2\x8brepo/\xc3\xa2\xc2\x80\xc2\x8bOracleLinux/\xc3\xa2\xc2\x80\xc2\x8bOL6/\xc3\xa2\xc2\x80\xc2\x8baddons/\xc3\xa2\xc2\x80\xc2\x8bx86_64/.', 48, 49, 'ordinal not in range(128)')
</code></pre>
<p>My other repos sync just fine.</p> Crane - Issue #2700 (CLOSED - WONTFIX): Crane crashes on start-up if "debug" config option isn't ...https://pulp.plan.io/issues/27002017-04-10T20:48:58ZIchimonji10jerebear@protonmail.com
<p>Let's say that you install crane (in my case, from the nightly RPM build) and create the following <code>/etc/crane.conf</code>:</p>
<pre><code>[general]
data_dir: /var/lib/published/docker
endpoint: localhost:5000
</code></pre>
<p>In this case, Crane will fail to start:</p>
<pre><code>[root@fedora-24-pulp-2-13 ~]# python2 -c 'from crane.app import create_app; create_app().run()'
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/usr/lib/python2.7/site-packages/crane/app.py", line 29, in create_app
config.load(app)
File "/usr/lib/python2.7/site-packages/crane/config.py", line 59, in load
read_config(app, parser)
File "/usr/lib/python2.7/site-packages/crane/config.py", line 81, in read_config
app.config['DEBUG'] = parser.getboolean(SECTION_GENERAL, KEY_DEBUG)
File "/usr/lib64/python2.7/ConfigParser.py", line 368, in getboolean
v = self.get(section, option)
File "/usr/lib64/python2.7/ConfigParser.py", line 618, in get
raise NoOptionError(option, section)
ConfigParser.NoOptionError: No option 'debug' in section: 'general'
</code></pre>
<p>This isn't expected. The documentation states that <code>debug</code> defaults to "false", meaning that the <code>debug</code> option should be optional.</p>
<p>This affects the nightly builds of Crane for Pulp 2.12 and 2.13.</p> Docker Support - Issue #294 (CLOSED - WONTFIX): Docker Plugin Logging Needs Improvementhttps://pulp.plan.io/issues/2942015-02-24T11:36:35ZSkullmanmminar@redhat.com
<p>When trying to debug problems of pulp_docker - last time it was validate_config failing on wrong naming (uppercase in chars in repo name) without specific error - it has really weak logging of errors compared to other pulp plugins - for example rpm.<br>
Would it be possible to add same logging capability to docker plugin - please compare:</p>
<pre><code>https://github.com/pulp/pulp_rpm/blob/master/plugins/pulp_rpm/plugins/distributors/yum/configuration.py
</code></pre>
<p>versus</p>
<pre><code>https://github.com/pulp/pulp_docker/blob/master/plugins/pulp_docker/plugins/distributors/configuration.py
</code></pre>