Project

Profile

Help

Actions
Send by e-mail Copy link

Issue #5699

closed

RPM publication create fails with server error

Added by jdjeffers about 5 years ago. Updated over 4 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
lmjachky
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Katello
Sprint:
Sprint 62
Quarter:

Description

Testing rpm content type uploads in Katello. After issuing a create publication on the repository after an upload, the following error occurs (server side):

Nov 12 15:02:37 centos7-katello-devel-stable.example.com gunicorn[1131]: 127.0.0.1 - admin [12/Nov/2019:15:02:37 +0000] "POST /pulp/api/v3/repositories/505f11db-35e5-4647-9bfb-04f2acfc8786/versions/ HTTP/1.1" 202 67
    Nov 12 15:02:38 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: 4abe9310-0ea3-4407-9dfc-8414edd148fe
    Nov 12 15:02:38 centos7-katello-devel-stable.example.com rq[1126]: pulp: rq.worker:INFO: resource-manager: Job OK (95c6b171-881b-4066-b5cb-eb812028214c)
    Nov 12 15:02:38 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: Job OK (4abe9310-0ea3-4407-9dfc-8414edd148fe)
    Nov 12 15:02:38 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: 1537236c-410d-4be2-9139-51b07d6e287a
    Nov 12 15:02:38 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: Job OK (1537236c-410d-4be2-9139-51b07d6e287a)
    Nov 12 15:02:38 centos7-katello-devel-stable.example.com gunicorn[1131]: 127.0.0.1 - admin [12/Nov/2019:15:02:38 +0000] "GET /pulp/api/v3/tasks/4abe9310-0ea3-4407-9dfc-8414edd148fe/ HTTP/1.1" 200 611 "-" "OpenAPI-Ge
    Nov 12 15:02:38 centos7-katello-devel-stable.example.com gunicorn[1131]: 127.0.0.1 - admin [12/Nov/2019:15:02:38 +0000] "GET /pulp/api/v3/repositories/505f11db-35e5-4647-9bfb-04f2acfc8786/versions/3/ HTTP/1.1" 200 3
    Nov 12 15:02:38 centos7-katello-devel-stable.example.com gunicorn[1131]: 127.0.0.1 - admin [12/Nov/2019:15:02:38 +0000] "GET /pulp/api/v3/content/rpm/packages/?fields=pulp_href%2Cname%2Cversion%2Crelease%2Carch%2Cep
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1126]: pulp: rq.worker:INFO: resource-manager: bbc91cac-e3a1-44dc-b6e4-4673183ef2d2
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com gunicorn[1131]: 127.0.0.1 - admin [12/Nov/2019:15:02:39 +0000] "POST /pulp/api/v3/publications/rpm/rpm/ HTTP/1.1" 202 67 "-" "OpenAPI-Generator/3.0.0b8.dev015
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: 7984b5d7-efe8-4676-9568-92929309c7b2
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1126]: pulp: rq.worker:INFO: resource-manager: Job OK (bbc91cac-e3a1-44dc-b6e4-4673183ef2d2)
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pulp: pulp_rpm.app.tasks.publishing:INFO: Publishing: repository=test2-29561, version=2
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:ERROR: TypeError: Element of list has to be a tuple with 3 items.
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: Traceback (most recent call last):
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py", line 822, in perform_job
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: rv = job.perform()
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 605, in perform
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: self._result = self._execute()
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 611, in _execute
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: return self.func(*self.args, **self.kwargs)
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/tasks/publishing.py", line 254, in publish
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: create_rempomd_xml(packages, publication, publication_data.repomdrecords)
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/tasks/publishing.py", line 307, in create_rempomd_xml
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pkg = package.to_createrepo_c()
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/models.py", line 333, in to_createrepo_c
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: getattr(self, PULP_PACKAGE_ATTRS.CHANGELOGS))
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: TypeError: Element of list has to be a tuple with 3 items.
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: Traceback (most recent call last):
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py", line 822, in perform_job
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: rv = job.perform()
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 605, in perform
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: self._result = self._execute()
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 611, in _execute
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: return self.func(*self.args, **self.kwargs)
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/tasks/publishing.py", line 254, in publish
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: create_rempomd_xml(packages, publication, publication_data.repomdrecords)
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/tasks/publishing.py", line 307, in create_rempomd_xml
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pkg = package.to_createrepo_c()
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: File "/usr/local/lib/pulp/src/pulp-rpm/pulp_rpm/app/models.py", line 333, in to_createrepo_c
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: getattr(self, PULP_PACKAGE_ATTRS.CHANGELOGS))
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: TypeError: Element of list has to be a tuple with 3 items.
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: bb0eaecd-8322-4970-84e5-49fbd2448b07
    Nov 12 15:02:39 centos7-katello-devel-stable.example.com rq[1115]: pulp: rq.worker:INFO: reserved-resource-worker-1@centos7-katello-devel-stable.example.com: Job OK (bb0eaecd-8322-4970-84e5-49fbd2448b07)

The pulp rpm client version is pulp_rpm_client 3.0.0b71572533171.

Pulp3 server status:

{
  "versions": [
    {
      "component": "pulpcore",
      "version": "3.0.0rc8.dev0"
    },
    {
      "component": "pulp_docker",
      "version": "4.0.0b8.dev0"
    },
    {
      "component": "pulp_2to3_migration",
      "version": "0.0.1a1.dev0"
    },
    {
      "component": "pulp_rpm",
      "version": "3.0.0b8.dev0"
    },
    {
      "component": "pulp_ansible",
      "version": "0.2.0b6.dev0"
    },
    {
      "component": "pulp_file",
      "version": "0.1.0b5.dev0"
    }
  ],
  "online_workers": [
    {
      "pulp_href": "/pulp/api/v3/workers/bcd800d6-3e4d-4517-9738-6ef4f5e87b42/",
      "pulp_created": "2019-11-08T15:46:56.499466Z",
      "name": "resource-manager@centos7-katello-devel-stable.example.com",
      "last_heartbeat": "2019-11-12T15:42:23.754222Z",
      "online": true,
      "missing": false
    },
    {
      "pulp_href": "/pulp/api/v3/workers/1cc5462b-7b16-4d23-bf4d-cd9dfce22445/",
      "pulp_created": "2019-11-08T15:46:44.822305Z",
      "name": "reserved-resource-worker-1@centos7-katello-devel-stable.example.com",
      "last_heartbeat": "2019-11-12T15:42:24.256916Z",
      "online": true,
      "missing": false
    },
    {
      "pulp_href": "/pulp/api/v3/workers/0e112894-01f0-4ba3-a157-7fea133662e3/",
      "pulp_created": "2019-11-08T15:46:46.197086Z",
      "name": "reserved-resource-worker-2@centos7-katello-devel-stable.example.com",
      "last_heartbeat": "2019-11-12T15:42:24.355037Z",
      "online": true,
      "missing": false
    }
  ],
  "missing_workers": [],
  "online_content_apps": [
    {
      "name": "22029@centos7-katello-devel-stable.example.com",
      "last_heartbeat": "2019-11-12T15:42:35.474953Z"
    },
    {
      "name": "1792@centos7-katello-devel-stable.example.com",
      "last_heartbeat": "2019-11-12T15:42:35.475484Z"
    }
  ],
  "database_connection": {
    "connected": true
  },
  "redis_connection": {
    "connected": true
  },
  "storage": {
    "total": 37558423552,
    "used": 7136874496,
    "free": 30421549056
  }
}
Actions
Copy link
 #1

Updated by jdjeffers about 5 years ago

This is a link to the rpm package used in the upload:
[[https://repos.fedorapeople.org/pulp/pulp/fixtures/rpm-unsigned/giraffe-0.67-2.noarch.rpm]]

Actions
Copy link
 #2

Updated by jsherril@redhat.com about 5 years ago

  • Tags Katello-P2 added
Actions
Copy link
 #3

Updated by jdjeffers about 5 years ago

Re-tried rpm upload with updated client 3.0.0b8.dev01573228480. The same error was observed.

Actions
Copy link
 #4

Updated by jdjeffers about 5 years ago

Re-tested with non-pulp fixture rpm, [[https://rpmfind.net/linux/opensuse/update/leap/15.0/oss/rpms/x86_64/go-1.12-lp150.2.11.1.x86_64.rpm]], and confirmed the same error.

Actions
Copy link
 #5

Updated by lmjachky about 5 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to lmjachky
  • Sprint set to Sprint 62
Actions
Copy link
 #6

Updated by lmjachky about 5 years ago

  • Status changed from ASSIGNED to POST
Actions
Copy link
 #7

Updated by ttereshc about 5 years ago

  • Triaged changed from No to Yes

Added by Lubos Mjachky about 5 years ago

Revision 0f81e873 | View on GitHub

Do not dump data back to a string

Data can be now stored as a JSON binary. Therefore, it is not requried to dump data back to the string format.

closes #5699 https://pulp.plan.io/issues/5699

Actions
Copy link
 #8

Updated by Anonymous about 5 years ago

  • Status changed from POST to MODIFIED

Added by Lubos Mjachky almost 5 years ago

Revision a7f473ab | View on GitHub

Do not dump data back to a string

Data can be now stored as a JSON binary. Therefore, it is not requried to dump data back to the string format.

closes #5699 https://pulp.plan.io/issues/5699

(cherry picked from commit 0f81e873107cd6d59197f3ebb334e2c6c0ddb5a9)

Actions
Copy link
 #9

Updated by Anonymous almost 5 years ago

Actions
Copy link
 #10

Updated by ttereshc almost 5 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE
Actions
Copy link
 #11

Updated by ggainey over 4 years ago

  • Tags Katello added
  • Tags deleted (Katello-P2)
Actions
Send by e-mail Copy link

Also available in: Atom PDF