Issue #5699
closedRPM publication create fails with server error
Description
Testing rpm content type uploads in Katello. After issuing a create publication on the repository after an upload, the following error occurs (server side):
Nov 12 15:02:37 centos7-katello-devel-stable.example.com gunicorn[1131]: 127.0.0.1 - admin [12/Nov/2019:15:02:37 +0000] "POST /pulp/api/v3/repositories/505f11db-35e5-4647-9bfb-04f2acfc8786/versions/ HTTP/1.1" 202 67
Nov 12 15:02:38 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: 4abe9310-0ea3-4407-9dfc-8414edd148fe
Nov 12 15:02:38 centos7-katello-devel-stable.example.com rq[1126]: pulp: rq.worker:INFO: resource-manager: Job OK (95c6b171-881b-4066-b5cb-eb812028214c)
Nov 12 15:02:38 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: Job OK (4abe9310-0ea3-4407-9dfc-8414edd148fe)
Nov 12 15:02:38 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: 1537236c-410d-4be2-9139-51b07d6e287a
Nov 12 15:02:38 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: Job OK (1537236c-410d-4be2-9139-51b07d6e287a)
Nov 12 15:02:38 centos7-katello-devel-stable.example.com gunicorn[1131]: 127.0.0.1 - admin [12/Nov/2019:15:02:38 +0000] "GET /pulp/api/v3/tasks/4abe9310-0ea3-4407-9dfc-8414edd148fe/ HTTP/1.1" 200 611 "-" "OpenAPI-Ge
Nov 12 15:02:38 centos7-katello-devel-stable.example.com gunicorn[1131]: 127.0.0.1 - admin [12/Nov/2019:15:02:38 +0000] "GET /pulp/api/v3/repositories/505f11db-35e5-4647-9bfb-04f2acfc8786/versions/3/ HTTP/1.1" 200 3
Nov 12 15:02:38 centos7-katello-devel-stable.example.com gunicorn[1131]: 127.0.0.1 - admin [12/Nov/2019:15:02:38 +0000] "GET /pulp/api/v3/content/rpm/packages/?fields=pulp_href%2Cname%2Cversion%2Crelease%2Carch%2Cep
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1126]: pulp: rq.worker:INFO: resource-manager: bbc91cac-e3a1-44dc-b6e4-4673183ef2d2
Nov 12 15:02:39 centos7-katello-devel-stable.example.com gunicorn[1131]: 127.0.0.1 - admin [12/Nov/2019:15:02:39 +0000] "POST /pulp/api/v3/publications/rpm/rpm/ HTTP/1.1" 202 67 "-" "OpenAPI-Generator/3.0.0b8.dev015
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: 7984b5d7-efe8-4676-9568-92929309c7b2
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1126]: pulp: rq.worker:INFO: resource-manager: Job OK (bbc91cac-e3a1-44dc-b6e4-4673183ef2d2)
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pulp: pulp_rpm.app.tasks.publishing:INFO: Publishing: repository=test2-29561, version=2
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:ERROR: TypeError: Element of list has to be a tuple with 3 items.
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: Traceback (most recent call last):
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py", line 822, in perform_job
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: rv = job.perform()
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 605, in perform
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: self._result = self._execute()
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 611, in _execute
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: return self.func(*self.args, **self.kwargs)
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/tasks/publishing.py", line 254, in publish
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: create_rempomd_xml(packages, publication, publication_data.repomdrecords)
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/tasks/publishing.py", line 307, in create_rempomd_xml
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pkg = package.to_createrepo_c()
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/models.py", line 333, in to_createrepo_c
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: getattr(self, PULP_PACKAGE_ATTRS.CHANGELOGS))
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: TypeError: Element of list has to be a tuple with 3 items.
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: Traceback (most recent call last):
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py", line 822, in perform_job
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: rv = job.perform()
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 605, in perform
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: self._result = self._execute()
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 611, in _execute
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: return self.func(*self.args, **self.kwargs)
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/tasks/publishing.py", line 254, in publish
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: create_rempomd_xml(packages, publication, publication_data.repomdrecords)
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/tasks/publishing.py", line 307, in create_rempomd_xml
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pkg = package.to_createrepo_c()
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/models.py", line 333, in to_createrepo_c
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: getattr(self, PULP_PACKAGE_ATTRS.CHANGELOGS))
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: TypeError: Element of list has to be a tuple with 3 items.
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: bb0eaecd-8322-4970-84e5-49fbd2448b07
Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: Job OK (bb0eaecd-8322-4970-84e5-49fbd2448b07)
The pulp rpm client version is pulp_rpm_client 3.0.0b71572533171.
Pulp3 server status:
{
"versions": [
{
"component": "pulpcore",
"version": "3.0.0rc8.dev0"
},
{
"component": "pulp_docker",
"version": "4.0.0b8.dev0"
},
{
"component": "pulp_2to3_migration",
"version": "0.0.1a1.dev0"
},
{
"component": "pulp_rpm",
"version": "3.0.0b8.dev0"
},
{
"component": "pulp_ansible",
"version": "0.2.0b6.dev0"
},
{
"component": "pulp_file",
"version": "0.1.0b5.dev0"
}
],
"online_workers": [
{
"pulp_href": "/pulp/api/v3/workers/bcd800d6-3e4d-4517-9738-6ef4f5e87b42/",
"pulp_created": "2019-11-08T15:46:56.499466Z",
"name": "resource-manager@centos7-katello-devel-stable.example.com",
"last_heartbeat": "2019-11-12T15:42:23.754222Z",
"online": true,
"missing": false
},
{
"pulp_href": "/pulp/api/v3/workers/1cc5462b-7b16-4d23-bf4d-cd9dfce22445/",
"pulp_created": "2019-11-08T15:46:44.822305Z",
"name": "reserved-resource-worker-1@centos7-katello-devel-stable.example.com",
"last_heartbeat": "2019-11-12T15:42:24.256916Z",
"online": true,
"missing": false
},
{
"pulp_href": "/pulp/api/v3/workers/0e112894-01f0-4ba3-a157-7fea133662e3/",
"pulp_created": "2019-11-08T15:46:46.197086Z",
"name": "reserved-resource-worker-2@centos7-katello-devel-stable.example.com",
"last_heartbeat": "2019-11-12T15:42:24.355037Z",
"online": true,
"missing": false
}
],
"missing_workers": [],
"online_content_apps": [
{
"name": "22029@centos7-katello-devel-stable.example.com",
"last_heartbeat": "2019-11-12T15:42:35.474953Z"
},
{
"name": "1792@centos7-katello-devel-stable.example.com",
"last_heartbeat": "2019-11-12T15:42:35.475484Z"
}
],
"database_connection": {
"connected": true
},
"redis_connection": {
"connected": true
},
"storage": {
"total": 37558423552,
"used": 7136874496,
"free": 30421549056
}
}
Updated by jdjeffers about 5 years ago
This is a link to the rpm package used in the upload:
[[https://repos.fedorapeople.org/pulp/pulp/fixtures/rpm-unsigned/giraffe-0.67-2.noarch.rpm]]
Updated by jdjeffers about 5 years ago
Re-tried rpm upload with updated client 3.0.0b8.dev01573228480. The same error was observed.
Updated by jdjeffers about 5 years ago
Re-tested with non-pulp fixture rpm, [[https://rpmfind.net/linux/opensuse/update/leap/15.0/oss/rpms/x86_64/go-1.12-lp150.2.11.1.x86_64.rpm]], and confirmed the same error.
Updated by lmjachky about 5 years ago
- Status changed from NEW to ASSIGNED
- Assignee set to lmjachky
- Sprint set to Sprint 62
Updated by lmjachky about 5 years ago
- Status changed from ASSIGNED to POST
Added by Lubos Mjachky about 5 years ago
Updated by Anonymous about 5 years ago
- Status changed from POST to MODIFIED
Applied in changeset 0f81e873107cd6d59197f3ebb334e2c6c0ddb5a9.
Added by Lubos Mjachky about 5 years ago
Revision a7f473ab | View on GitHub
Do not dump data back to a string
Data can be now stored as a JSON binary. Therefore, it is not requried to dump data back to the string format.
closes #5699 https://pulp.plan.io/issues/5699
(cherry picked from commit 0f81e873107cd6d59197f3ebb334e2c6c0ddb5a9)
Updated by Anonymous about 5 years ago
Applied in changeset a7f473abed8727bc2a1686116ebf9d454db33f4c.
Updated by ttereshc almost 5 years ago
- Status changed from MODIFIED to CLOSED - CURRENTRELEASE
Updated by ggainey over 4 years ago
- Tags Katello added
- Tags deleted (
Katello-P2)
Do not dump data back to a string
Data can be now stored as a JSON binary. Therefore, it is not requried to dump data back to the string format.
closes #5699 https://pulp.plan.io/issues/5699