Pulp: Issueshttps://pulp.plan.io/https://pulp.plan.io/favicon.ico2021-09-17T14:10:06ZPulp
Planio Pulp - Issue #9421 (MODIFIED): Add support for sslmode to settings in pulp and pulp-operator.https://pulp.plan.io/issues/94212021-09-17T14:10:06Zbenthomasson
<p>In order to run AAP on Azure I need to enable the sslmode option for the database connection for automation hub.</p>
<p>Automation Hub runs as a django app and so needs a DATABASES configuration like this:</p>
<pre><code class="python syntaxhl" data-language="python"><span class="n">DATABASES</span> <span class="o">=</span> <span class="p">{</span>
<span class="s">'default'</span><span class="p">:</span> <span class="p">{</span>
<span class="s">'ENGINE'</span><span class="p">:</span> <span class="s">'django.db.backends.postgresql'</span><span class="p">,</span>
<span class="s">'NAME'</span><span class="p">:</span> <span class="s">"db_name"</span><span class="p">,</span>
<span class="s">'USER'</span><span class="p">:</span> <span class="s">"db_username"</span><span class="p">,</span>
<span class="s">'PASSWORD'</span><span class="p">:</span> <span class="s">"db_password"</span><span class="p">,</span>
<span class="s">'HOST'</span><span class="p">:</span> <span class="s">"db_host"</span><span class="p">,</span>
<span class="s">'OPTIONS'</span><span class="p">:</span> <span class="p">{</span><span class="s">'sslmode'</span><span class="p">:</span> <span class="s">'require'</span><span class="p">},</span>
<span class="p">},</span>
<span class="p">}</span>
</code></pre>
<p>I am using the pulp-operator to install galaxy_ng and I would like the pulp-operator to look for this option in the databases secret:</p>
<pre><code class="yaml syntaxhl" data-language="yaml">
<span class="nn">---</span>
<span class="na">apiVersion</span><span class="pi">:</span> <span class="s">v1</span>
<span class="na">kind</span><span class="pi">:</span> <span class="s">Secret</span>
<span class="na">metadata</span><span class="pi">:</span>
<span class="na">name</span><span class="pi">:</span> <span class="s">galaxy-pulp-postgres-configuration</span>
<span class="na">namespace</span><span class="pi">:</span> <span class="s">default</span>
<span class="na">stringData</span><span class="pi">:</span>
<span class="na">host</span><span class="pi">:</span> <span class="s">postgres</span>
<span class="na">port</span><span class="pi">:</span> <span class="s2">"</span><span class="s">5432"</span>
<span class="na">database</span><span class="pi">:</span> <span class="s">pulp</span>
<span class="na">username</span><span class="pi">:</span> <span class="s">pulp</span>
<span class="na">password</span><span class="pi">:</span> <span class="s">XXX</span>
<span class="na">sslmode</span><span class="pi">:</span> <span class="s">require</span>
<span class="na">type</span><span class="pi">:</span> <span class="s">unmanaged</span>
<span class="na">type</span><span class="pi">:</span> <span class="s">Opaque</span>
</code></pre> RPM Support - Issue #9335 (CLOSED - DUPLICATE): Huge memory consumption when performing depsolvin...https://pulp.plan.io/issues/93352021-09-02T14:53:23Zdalleydalley@redhat.comPulp - Issue #9269 (CLOSED - CURRENTRELEASE): Allow content types that declare their own custom m...https://pulp.plan.io/issues/92692021-08-21T17:15:36Zdalleydalley@redhat.com
<p>Content subclasses that declare their own custom managers don't have access to touch() functionality, we need to export it through the API so that they can subclass it.</p> RPM Support - Issue #9107 (CLOSED - CURRENTRELEASE): filelists and changelog metadata is not pars...https://pulp.plan.io/issues/91072021-07-17T22:47:54Zoptiz0r
<p>Versions:</p>
<ul>
<li>Foreman 2.5.2</li>
<li>Katello 4.1.1</li>
<li>pulp-rpm-3.13.3</li>
</ul>
<p>Upstream: <a href="http://lon.mirror.rackspace.com/almalinux/8/BaseOS/x86_64/os/repodata/" class="external">http://lon.mirror.rackspace.com/almalinux/8/BaseOS/x86_64/os/repodata/</a>.</p>
<p>I am seeing filelists not being parsed correctly for Alma Linux repositories. Within Katello UI, I have checked a random sample of packages from all of the Alma repositories I have sync'd (18 in total, x86_64, sources and debug-x86_64 for each of baseos, appstream, highavailability, powertools, extras and devel), and none of them list any files. For comparison, CentOS 8 Stream RPMS do list files.</p>
<p>The generated filelist served up by katello contains each of the packages in the repo but with no package contents. For example, the upstream baseos filelist is 2MB whereas the generated filelist for the katello-hosted repo is just 105KB and looks like the below:</p>
<pre><code class="xml syntaxhl" data-language="xml"><span class="cp"><?xml version="1.0" encoding="UTF-8"?></span>
<span class="nt"><filelists</span> <span class="na">xmlns=</span><span class="s">"http://linux.duke.edu/metadata/filelists"</span> <span class="na">packages=</span><span class="s">"1985"</span><span class="nt">></span>
<span class="nt"><package</span> <span class="na">pkgid=</span><span class="s">"59c2172d6e423d8adc3248c1983146492471678afccdfae8ab0f66e18a1aaaa5"</span> <span class="na">name=</span><span class="s">"kernel-debug"</span> <span class="na">arch=</span><span class="s">"x86_64"</span><span class="nt">></span>
<span class="nt"><version</span> <span class="na">epoch=</span><span class="s">"0"</span> <span class="na">ver=</span><span class="s">"4.18.0"</span> <span class="na">rel=</span><span class="s">"305.el8"</span><span class="nt">/></span>
<span class="nt"></package></span>
<span class="nt"><package</span> <span class="na">pkgid=</span><span class="s">"c8120b541261d0ad425f369b1da5eef0aaad5883760ad0e149137027d102207c"</span> <span class="na">name=</span><span class="s">"avahi"</span> <span class="na">arch=</span><span class="s">"i686"</span><span class="nt">></span>
<span class="nt"><version</span> <span class="na">epoch=</span><span class="s">"0"</span> <span class="na">ver=</span><span class="s">"0.7"</span> <span class="na">rel=</span><span class="s">"20.el8"</span><span class="nt">/></span>
<span class="nt"></package></span>
</code></pre>
<p>This is breaking system installs which use the local mirrored content, because packages included in the kickstart base package set have dependencies specified using files, and these are all unsatisfied due to the empty filelists. I have triggered resyncs from upstream mirrors without any change in behaviour.</p>
<p>May be related to similar-looking issue <a class="issue tracker-1 status-11 priority-6 priority-default closed" title="Issue: Filelists and changlogs not always parsed properly (CLOSED - CURRENTRELEASE)" href="https://pulp.plan.io/issues/8955">#8955</a> ?</p> RPM Support - Issue #8944 (CLOSED - CURRENTRELEASE): Cannot sync RHEL6 repos from cdn.redhat.comhttps://pulp.plan.io/issues/89442021-06-21T22:37:08Zsskracic@redhat.comsskracic@redhat.com
<ul>
<li>a containerized pulp based on pulp-ci-centos image with:</li>
</ul>
<p>pulpcore-3.13.0
pulp-rpm-3.13.0</p>
<p>I am not sure whether it's a Pulp bug or a CDN data error, but RHEL6 i386 and x86_64
repo syncing repeatedly fails with this error. The repositories are synced with mirror=True
and the distribution is set to point to repository (so that the latest repo is always distributed).</p>
<pre><code>Repo: Red Hat Enterprise Linux 6 Server from RHUI (RPMs) (6Server-i386)
Start Time: 2021-06-21 22:24:04
Finish Time: 2021-06-21 22:28:18
Elapsed Time: 0:04:13.581718
Result: Error
Exception: Package id from primary metadata (42003b3621ebf25f9b5fe25b0d2c4f2024958a9d), does not match package id from filelists, other metadata (dcacfd1c930cba9ee112c1055e7a1e94bedd7f3a)
Traceback: File "/usr/local/lib/python3.6/site-packages/rq/worker.py", line 1013, in perform_job
rv job.perform()
File "/usr/local/lib/python3.6/site-packages/rq/job.py", line 709, in perform
self._result = self._execute()
File "/usr/local/lib/python3.6/site-packages/rq/job.py", line 732, in _execute
result = self.func(*self.args, **self.kwargs)
File "/src/pulp-rpm/pulp_rpm/app/tasks/synchronizing.py", line 395, in synchronize
version = dv.create()
File "/src/pulpcore/pulpcore/plugin/stages/declarative_version.py", line 149, in create
loop.run_until_complete(pipeline)
File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete
return future.result()
File "/src/pulpcore/pulpcore/plugin/stages/api.py", line 225, in create_pipeline
await asyncio.gather(*futures)
File "/src/pulpcore/pulpcore/plugin/stages/api.py", line 43, in __call__
await self.run()
File "/src/pulp-rpm/pulp_rpm/app/tasks/synchronizing.py", line 674, in run
await self.parse_repository_metadata(repomd, repomd_files, file_extension)
File "/src/pulp-rpm/pulp_rpm/app/tasks/synchronizing.py", line 719, in parse_repository_metadata
file_extension=file_extension,
File "/src/pulp-rpm/pulp_rpm/app/tasks/synchronizing.py", line 987, in parse_packages
).format(pkgid, pkgid_extra)
</code></pre> Pulp - Issue #8603 (CLOSED - CURRENTRELEASE): possible tasking race condition: update or delete ...https://pulp.plan.io/issues/86032021-04-20T19:30:22Zjsherril@redhat.comjsherril@redhat.com
<p>With pulpcore 3.11.0</p>
<pre><code>pulp [34656514-03a4-4255-b3b7-8986492b87b1]: rq.worker:ERROR: Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 240, in _commit
return self.connection.commit()
psycopg2.errors.ForeignKeyViolation: update or delete on table "core_reservedresource" violates foreign key constraint "core_taskreservedres_resource_id_ee0b7c62_fk_core_rese" on table "core_taskreservedresource"
DETAIL: Key (pulp_id)=(c0b7db83-401e-4a46-8d9e-07f5ab70de1e) is still referenced from table "core_taskreservedresource".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rq/worker.py", line 984, in perform_job
started_job_registry=started_job_registry)
File "/usr/lib/python3.6/site-packages/pulpcore/tasking/worker.py", line 146, in handle_job_success
task.release_resources()
File "/usr/lib/python3.6/site-packages/pulpcore/app/models/task.py", line 430, in release_resources
reservation.delete()
File "/usr/lib/python3.6/site-packages/django_lifecycle/mixins.py", line 146, in delete
value = super().delete(*args, **kwargs)
File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 922, in delete
return collector.delete()
File "/usr/lib/python3.6/site-packages/django/db/models/deletion.py", line 318, in delete
sender=model, instance=obj, using=self.using
File "/usr/lib/python3.6/site-packages/django/db/transaction.py", line 240, in __exit__
connection.commit()
File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 262, in commit
self._commit()
File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 240, in _commit
return self.connection.commit()
File "/usr/lib/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 240, in _commit
return self.connection.commit()
django.db.utils.IntegrityError: update or delete on table "core_reservedresource" violates foreign key constraint "core_taskreservedres_resource_id_ee0b7c62_fk_core_rese" on table "core_taskreservedresource"
DETAIL: Key (pulp_id)=(c0b7db83-401e-4a46-8d9e-07f5ab70de1e) is still referenced from table "core_taskreservedresource".
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 240, in _commit
return self.connection.commit()
psycopg2.errors.ForeignKeyViolation: update or delete on table "core_reservedresource" violates foreign key constraint "core_taskreservedres_resource_id_ee0b7c62_fk_core_rese" on table "core_taskreservedresource"
DETAIL: Key (pulp_id)=(c0b7db83-401e-4a46-8d9e-07f5ab70de1e) is still referenced from table "core_taskreservedresource".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rq/worker.py", line 984, in perform_job
started_job_registry=started_job_registry)
File "/usr/lib/python3.6/site-packages/pulpcore/tasking/worker.py", line 146, in handle_job_success
task.release_resources()
File "/usr/lib/python3.6/site-packages/pulpcore/app/models/task.py", line 430, in release_resources
reservation.delete()
File "/usr/lib/python3.6/site-packages/django_lifecycle/mixins.py", line 146, in delete
value = super().delete(*args, **kwargs)
File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 922, in delete
return collector.delete()
File "/usr/lib/python3.6/site-packages/django/db/models/deletion.py", line 318, in delete
sender=model, instance=obj, using=self.using
File "/usr/lib/python3.6/site-packages/django/db/transaction.py", line 240, in __exit__
connection.commit()
File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 262, in commit
self._commit()
File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 240, in _commit
return self.connection.commit()
File "/usr/lib/python3.6/site-packages/django/db/utils.py", line 89, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/usr/lib/python3.6/site-packages/django/db/backends/base/base.py", line 240, in _commit
return self.connection.commit()
django.db.utils.IntegrityError: update or delete on table "core_reservedresource" violates foreign key constraint "core_taskreservedres_resource_id_ee0b7c62_fk_core_rese" on table "core_taskreservedresource"
DETAIL: Key (pulp_id)=(c0b7db83-401e-4a46-8d9e-07f5ab70de1e) is still referenced from table "core_taskreservedresource".
pulp [None]: rq.worker:INFO: 28341@pipe-up-katello-proxy-nightly-centos7.n60.example.com: a9f5653c-8d52-47ea-b36b-52f86d91e9a3
</code></pre> Pulp - Issue #7867 (CLOSED - WONTFIX): Issue #7796 : Pulp Version 2.20 - Mongod and pulp_celerybe...https://pulp.plan.io/issues/78672020-11-19T11:53:20Ztosif.meman@kindredgroup.com
<p>Hello Team,</p>
<p>We have pulp version 2.20 configured in our environment and we have faced challenges as mongodb randomly stopped working and due to that pulp_celerybeat not able to connect to the database and apparently the result is pulp_celerybeat also failing.</p>
<p>mongodb version - mongodb-org-server-3.2.22-1.el7.x86_64</p>
<p>The logs did not helped me either as logs not showing sufficient info to troubleshoot.</p>
<p>localhost: pulp: kombu.async.hub:ERROR: (23150-55872) File "/usr/lib/python2.7/site-packages/pulp/server/async/app.py", line 119, in _record_heartbeat pulp: kombu.async.hub:ERROR: (23141-69152) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 39, in handle_worker_heartbeat pulp: kombu.async.hub:ERROR: (23240-19648) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 39, in handle_worker_heartbeat</p>
<p>MongoDB logs:</p>
<p>2020-11-04T12:19:29.375+0100 I CONTROL [initandlisten] db version v3.2.22
2020-11-04T12:19:29.375+0100 I CONTROL [initandlisten] git version: 105acca0d443f9a47c1a5bd608fd7133840a58dd
2020-11-04T12:19:29.375+0100 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013
2020-11-04T12:19:29.375+0100 I CONTROL [initandlisten] allocator: tcmalloc
2020-11-04T12:19:29.375+0100 I CONTROL [initandlisten] modules: none
2020-11-04T12:19:29.375+0100 I CONTROL [initandlisten] build environment:
2020-11-04T12:19:29.375+0100 I CONTROL [initandlisten] distmod: rhel70
2020-11-04T12:19:29.375+0100 I CONTROL [initandlisten] distarch: x86_64
2020-11-04T12:19:29.375+0100 I CONTROL [initandlisten] target_arch: x86_64
2020-11-04T12:19:29.375+0100 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "127.0.0.1" }, processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, security: { authorization: "disabled" }, storage: { dbPath: "/var/lib/mongodb", journal: { enabled: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongodb.log" } }
2020-11-04T12:19:29.404+0100 I - [initandlisten] Detected data files in /var/lib/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
2020-11-04T12:19:29.404+0100 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb/mongod.lock is not empty.
2020-11-04T12:19:29.404+0100 W STORAGE [initandlisten] Recovering data from the last clean checkpoint.
2020-11-04T12:19:29.404+0100 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=18G,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),verbose=(recovery_progress),</p>
<p>2020-11-04T12:19:30.164+0100 I CONTROL [initandlisten]
2020-11-04T12:19:30.164+0100 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2020-11-04T12:19:30.164+0100 I CONTROL [initandlisten] ** We suggest setting it to 'never'
2020-11-04T12:19:30.164+0100 I CONTROL [initandlisten]
2020-11-04T12:19:30.164+0100 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'.
2020-11-04T12:19:30.164+0100 I CONTROL [initandlisten] ** We suggest setting it to 'never'
2020-11-04T12:19:30.165+0100 I CONTROL [initandlisten]
2020-11-04T12:19:30.165+0100 I CONTROL [initandlisten] ** WARNING: soft rlimits too low. rlimits set to 4096 processes, 64000 files. Number of processes should be at least 32000 : 0.5 times number of files.</p> Pulp - Issue #7754 (CLOSED - CURRENTRELEASE): PostgreSQL extension uuid-ossp is missing in pulp/p...https://pulp.plan.io/issues/77542020-10-27T14:22:55Zosapryki
<p>Automation Hub requires PostgreSQL extension "uuid-ossp" to perform a data migration <a href="https://github.com/ansible/galaxy_ng/pull/528" class="external">https://github.com/ansible/galaxy_ng/pull/528</a>, however Travis CI fails with the following error:</p>
<pre><code>django.db.utils.OperationalError: could not open extension control file "/usr/share/pgsql/extension/uuid-ossp.control": No such file or directory
</code></pre>
<p>This error occurs because <code>pulp/pulp-ci</code> image has a PostgreSQL installed without compiled standard extensions (specifically "uuid-ossp").</p> Pulp - Issue #7676 (CLOSED - CURRENTRELEASE): django-cleanup can silently delete files being used...https://pulp.plan.io/issues/76762020-10-08T14:15:28Zdalleydalley@redhat.com
<pre><code>Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: pulp: pulp_rpm.app.tasks.publishing:INFO: Publishing: repository=centos8-baseos, version=1
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: pulp: rq.worker:ERROR: Traceback (most recent call last):
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py", line 936, in perform_job
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: rv = job.perform()
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 684, in perform
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: self._result = self._execute()
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 690, in _execute
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: return self.func(*self.args, **self.kwargs)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/tasks/migrate.py", line 142, in migrate_from_pulp2
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: create_repoversions_publications_distributions(plan)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/migration.py", line 323, in create_repoversions_publications_distributions
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: task_func(*task_args)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/migration.py", line 270, in complex_repo_migration
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: migrated_repo.pulp3_repository_version
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/migration.py", line 391, in migrate_repo_distributor
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: pulp2dist, repo_version)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/plugin/rpm/repository.py", line 74, in migrate_to_pulp3
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: publish(repo_version.pk, checksum_types=checksum_types)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/publishing.py", line 283, in publish
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: publication_data.populate()
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/publishing.py", line 224, in populate
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: self.handle_sub_repos(distribution_tree)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/publishing.py", line 165, in handle_sub_repos
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: artifact_file = storage.open(original_treeinfo_content_artifact.artifact.file.name)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/core/files/storage.py", line 36, in open
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: return self._open(name, mode)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/core/files/storage.py", line 224, in _open
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: return File(open(self.path(name), mode))
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/pulp/artifact/48/66eceaf78ffabb1d25774932085c6653f9f654411d7669db7b91e2ef0fd2a3'
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: Traceback (most recent call last):
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py", line 936, in perform_job
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: rv = job.perform()
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 684, in perform
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: self._result = self._execute()
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 690, in _execute
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: return self.func(*self.args, **self.kwargs)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/tasks/migrate.py", line 142, in migrate_from_pulp2
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: create_repoversions_publications_distributions(plan)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/migration.py", line 323, in create_repoversions_publications_distributions
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: task_func(*task_args)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/migration.py", line 270, in complex_repo_migration
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: migrated_repo.pulp3_repository_version
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/migration.py", line 391, in migrate_repo_distributor
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: pulp2dist, repo_version)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/plugin/rpm/repository.py", line 74, in migrate_to_pulp3
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: publish(repo_version.pk, checksum_types=checksum_types)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/publishing.py", line 283, in publish
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: publication_data.populate()
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/publishing.py", line 224, in populate
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: self.handle_sub_repos(distribution_tree)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/home/vagrant/devel/pulp_rpm/pulp_rpm/app/tasks/publishing.py", line 165, in handle_sub_repos
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: artifact_file = storage.open(original_treeinfo_content_artifact.artifact.file.name)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/core/files/storage.py", line 36, in open
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: return self._open(name, mode)
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/core/files/storage.py", line 224, in _open
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: return File(open(self.path(name), mode))
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/pulp/artifact/48/66eceaf78ffabb1d25774932085c6653f9f654411d7669db7b91e2ef0fd2a3'
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: pulp: rq.worker:INFO: 26855@pulp2-nightly-pulp3-source-centos7.localhost.example.com: c009a655-bb3e-4665-9b2e-b3100b82b060
Oct 08 13:30:37 pulp2-nightly-pulp3-source-centos7.localhost.example.com rq[26855]: pulp: rq.worker:INFO: 26855@pulp2-nightly-pulp3-source-centos7.localhost.example.com: Job OK (c009a655-bb3e-4665-9b2e-b3100b82b060)
</code></pre> RPM Support - Issue #6861 (CLOSED - CURRENTRELEASE): Migration from 3.2.0 to 3.3.z is brokenhttps://pulp.plan.io/issues/68612020-05-29T16:37:58Zdalleydalley@redhat.com
<p>In trying to resolve the migration issues between 3.3.0 and 3.3.1, we accidentally introduced a new blocking issue between 3.2.0 and 3.3.z.</p>
<p>Both migration 0005 and 0009 need to be modified, again, such that they both specify that 'last_sync_revision_number' is nullable.</p> RPM Support - Issue #6743 (CLOSED - CURRENTRELEASE): Installations migrating from 3.3.0 to 3.3.1 ...https://pulp.plan.io/issues/67432020-05-14T19:27:32Zdalleydalley@redhat.com
<p>By modifying a prior migration, we accidentally created a mismatch between the schema we expect and the schema Django seems to interpret and enforce, presumably due to some kind of optimization being employed.</p>
<p>It seems that because Django sees that migration 0005 made the 'last_sync_revision_number' column nullable (it didn't, it was modified afterwards) [0], it ignores when migration 0009 tells Django to perform that migration later. Thus the 'last_sync_revision_number' column remains non-nullable.</p>
<p>This impacts Pulp users by throwing the following error when creating new RPM repositories.</p>
<pre><code>django.db.utils.IntegrityError: null value in column "last_sync_revision_number" violates not-null constraint
</code></pre>
<p>[0] <a href="https://github.com/pulp/pulp_rpm/pull/1694/files#diff-8882c765a6805ada6c8a8bafe3e3e5b8" class="external">https://github.com/pulp/pulp_rpm/pull/1694/files#diff-8882c765a6805ada6c8a8bafe3e3e5b8</a></p> Debian Support - Issue #6593 (CLOSED - NOTABUG): No plugin found: deb_distributorhttps://pulp.plan.io/issues/65932020-04-28T20:12:14Zymadav
<p>I have pulp 2.18 running on RHEL 7.7 and have all pulp debain packages and pulgin packages installed,I was able to create the repo but when i try to run the sync command it says like no plugin found or missing resources, during the delete of the repo also it is the same situation.Below are the my pulp packages.Can some one help me here.</p>
<p>python-pulp-rpm-common-2.18.1-1.el7.noarch
pulp-docker-admin-extensions-3.2.2-1.el7.noarch
pulp-deb-admin-extensions-1.8.0-1.el7.noarch
python-pulp-client-lib-2.18.1-2.el7.noarch
pulp-puppet-plugins-2.18.1-1.el7.noarch
python-pulp-docker-common-3.2.2-1.el7.noarch
pulp-server-2.18.1-2.el7.noarch
python-pulp-repoauth-2.18.1-2.el7.noarch
pulp-rpm-admin-extensions-2.18.1-1.el7.noarch
python-pulp-bindings-2.18.1-2.el7.noarch
pulp-rpm-plugins-2.18.1-1.el7.noarch
python-pulp-deb-common-1.8.0-1.el7.noarch
python-pulp-puppet-common-2.18.1-1.el7.noarch
pulp-selinux-2.18.1-2.el7.noarch
pulp-puppet-admin-extensions-2.18.1-1.el7.noarch
python-pulp-common-2.18.1-2.el7.noarch
pulp-admin-client-2.18.1-2.el7.noarch
pulp-docker-plugins-3.2.2-1.el7.noarch
python-pulp-oid_validation-2.18.1-2.el7.noarch
pulp-deb-plugins-1.8.0-1.el7.noarch</p>
<p>Erros i am getting are as like below.</p>
<p>pulp-admin deb repo publish run --repo-id xenial-backports-amd64
+----------------------------------------------------------------------+
Publishing Repository [xenial-backports-amd64]
+----------------------------------------------------------------------+</p>
<p>This command may be exited via ctrl+c without affecting the request.</p>
<p>Task Failed</p>
<p>No plugin found: deb_distributor</p>
<p>pulp-admin deb repo delete --repo-id xenial-newrelic-test
This command may be exited via ctrl+c without affecting the request.
[]
Running...
Task Failed
Pulp exception occurred: PulpExecutionException
No plugin found: deb_importer
No plugin found: deb_distributor</p> Ansible Plugin - Issue #5571 (CLOSED - CURRENTRELEASE): Add the ability to filter collection vers...https://pulp.plan.io/issues/55712019-10-14T20:13:14Znewswangerd
<p>We need a parameter on `/pulp/api/v3/content/ansible/collection_versions/` that allows for us to filter collection versions by tag, such that we can specify `tags=?network,cloud` and get a list of collection versions that have the network AND cloud tags.</p> Debian Support - Issue #5377 (CLOSED - CURRENTRELEASE): Cannot modify, delete, or duplicate contenthttps://pulp.plan.io/issues/53772019-08-30T18:52:56Zjaymzh
<p>Once an artifact has been made into apt content, that content cannot be modified or deleted. Further, you can't work around this by creating new content because multiple contents cannot point to the same artifact because content cannot have the same sha256 sum.</p>
<p>As such if you create content incorrectly, there is literally now way out of it.</p> Pulp - Issue #4929 (CLOSED - WORKSFORME): Pulp 2.18 having issues to start workers celery and com...https://pulp.plan.io/issues/49292019-06-07T04:36:54Zymadav
<p>Team,</p>
<p>We upgraded pulp version from 2.12 to 2.18 and all the services are up and running but,worker services in worker server are not able to start and it is failing to communicate to rabbitmq server.we have below package versions installed in worker for celery and pulp,also posting the pulp errors.Please help us to fix this as this is production we are running out of the time.uploaded the message file for reference,please let me know if anything else is required.</p>
<p>We have earlier python2-celery-4.2.1-3.el7.noarch version installed,even with that we were unable to start the services,so using python2-celery-4.0.2-7.el7.noarch.Server is running with RHEL 7.6</p>
<p>Mostly i see these errors</p>
<p>Jun 07 04:17:21 ip-10-12-111-237. celery[319]: from billiard.compat import get_fdmax, close_open_fds<br>
Jun 07 04:17:21 ip-10-12-111-237. celery[319]: ImportError: cannot import name get_fdmax</p>
<p>Installed packaged<br>
rpm <del>qa | grep -i celery<br>
python2-celery-4.0.2-7.el7.noarch<br>
[ymadav@ip-10-12-111-237 ~]$ rpm -qa | egrep -i "amqp|celery|billiard|kombu"<br>
python2-celery-4.0.2-7.el7.noarch<br>
python2-kombu-4.0.2-11.el7.noarch<br>
python-gofer-amqp-2.12.5-1.el7.noarch<br>
python2-amqp-2.2.2-5.el7.noarch<br>
python2-billiard-3.5.0.3-4.el7.x86_64<br>
[ymadav@ip-10-12-111-237 ~]$ rpm -qa | grep -i pulp</del>*<br>
python-pulp-python-common-2.0.3-1.el7.noarch<br>
python-pulp-rpm-common-2.18.1-1.el7.noarch<br>
pulp-rpm-plugins-2.18.1-1.el7.noarch<br>
python-pulp-puppet-common-2.18.1-1.el7.noarch<br>
pulp-selinux-2.18.1-2.el7.noarch<br>
pulp-puppet-tools-2.18.1-1.el7.noarch<br>
python-pulp-manifest-2.16.4-1.el7.noarch<br>
python-pulp-docker-common-3.2.2-1.el7.noarch<br>
pulp-docker-plugins-3.2.2-1.el7.noarch<br>
pulp-python-plugins-2.0.3-1.el7.noarch<br>
python-pulp-deb-common-1.8.0-1.el7.noarch<br>
python-pulp-repoauth-2.18.1-2.el7.noarch<br>
python2-solv-0.6.34-2.pulp.el7.x86_64<br>
pulp-deb-plugins-1.8.0-1.el7.noarch<br>
python-pulp-ostree-common-1.4.0-1.el7.noarch<br>
pulp-puppet-plugins-2.18.1-1.el7.noarch<br>
python-pulp-oid_validation-2.18.1-2.el7.noarch<br>
pulp-server-2.18.1-2.el7.noarch<br>
python-pulp-common-2.18.1-2.el7.noarch<br>
libsolv-0.6.34-2.pulp.el7.x86_64<br>
pulp-ostree-plugins-1.4.0-1.el7.noarch</p>
<pre><code>sudo systemctl list-units | grep -i pulp
● pulp_worker-0.service loaded failed failed Pulp Worker #0
● pulp_worker-1.service loaded failed failed Pulp Worker #1
● pulp_worker-2.service loaded failed failed Pulp Worker #2
● pulp_worker-3.service loaded failed failed Pulp Worker #3
pulp_workers.service loaded active exited Pulp Celery Workers
</code></pre>
<p>Jun 07 04:17:21 ip-10-12-111-237. celery[319]: File "/usr/lib/python2.7/site-packages/celery/utils/log.py", line 19, in <module><br>
Jun 07 04:17:21 ip-10-12-111-237. celery[319]: from .term import colored<br>
Jun 07 04:17:21 ip-10-12-111-237. celery[319]: File "/usr/lib/python2.7/site-packages/celery/utils/term.py", line 11, in <module><br>
Jun 07 04:17:21 ip-10-12-111-237. celery[319]: from celery.platforms import isatty<br>
Jun 07 04:17:21 ip-10-12-111-237. celery[319]: File "/usr/lib/python2.7/site-packages/celery/platforms.py", line 21, in <module><br>
Jun 07 04:17:21 ip-10-12-111-237. celery[319]: from billiard.compat import get_fdmax, close_open_fds<br>
Jun 07 04:17:21 ip-10-12-111-237. celery[319]: ImportError: cannot import name get_fdmax<br>
Jun 07 04:17:21 ip-10-12-111-237. systemd[1]: pulp_worker-0.service: main process exited, code=exited, status=1/FAILURE<br>
Jun 07 04:17:21 ip-10-12-111-237. systemd[1]: Unit pulp_worker-0.service entered failed state.<br>
Jun 07 04:17:21 ip-10-12-111-237. systemd[1]: pulp_worker-0.service failed.<br>
<img src="https://pulp.plan.io/attachments/download/518583/clipboard-201906070629-xt6og.png" alt=""></p>
<p>Thanks,<br>
-Yash</p>