Project

Profile

Help

Actions
Send by e-mail Copy link

Issue #2093

closed

errors importing some rpms after upgrading to pulp 2.9

Added by cristi.falcas@gmail.com over 7 years ago. Updated almost 4 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Urgent
Assignee:
fdobrovo
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
3. High
Version:
2.9.0
Platform Release:
2.9.2
OS:
CentOS 7
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Sprint 6
Quarter:

Description

Hi,

After upgrading to pulp 2.9, we encounter errors uploading some rpms. For example protobuf-2.3.0-9.el6.x86_64.rpm from epel fails with this message:

Task Failed

The importer yum_importer indicated a failed response when uploading rpm unit to
repository external_rpms_el6.

Those are the logs from the server (a unicode ):

pulp_rpm.plugins.importers.yum.upload:ERROR: (20733-48768) unexpected error occurred importing uploaded file: 'ascii' codec can't decode byte 0xc4 in position 116281: ordinal not in range(128)
pulp_rpm.plugins.importers.yum.upload:ERROR: (20733-48768) Traceback (most recent call last):
pulp_rpm.plugins.importers.yum.upload:ERROR: (20733-48768)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/upload.py", line 113, in upload
pulp_rpm.plugins.importers.yum.upload:ERROR: (20733-48768)     handlers[type_id](repo, type_id, unit_key, metadata, file_path, conduit, config)
pulp_rpm.plugins.importers.yum.upload:ERROR: (20733-48768)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/upload.py", line 410, in _handle_package
pulp_rpm.plugins.importers.yum.upload:ERROR: (20733-48768)     unit.modify_xml()
pulp_rpm.plugins.importers.yum.upload:ERROR: (20733-48768)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/db/models.py", line 824, in modify_xml
pulp_rpm.plugins.importers.yum.upload:ERROR: (20733-48768)     faked_other = utils.fake_xml_element(self.repodata['other'])
pulp_rpm.plugins.importers.yum.upload:ERROR: (20733-48768)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/utils.py", line 128, in fake_xml_element
pulp_rpm.plugins.importers.yum.upload:ERROR: (20733-48768)     repodata_snippet.encode(codec)
pulp_rpm.plugins.importers.yum.upload:ERROR: (20733-48768) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc4 in position 116281: ordinal not in range(128)
pulp.server.managers.content.upload:ERROR: (20733-48768) Error from the importer while importing uploaded unit to repository [external_rpms_el6]
pulp.server.managers.content.upload:ERROR: (20733-48768) Traceback (most recent call last):
pulp.server.managers.content.upload:ERROR: (20733-48768)   File "/usr/lib/python2.7/site-packages/pulp/server/managers/content/upload.py", line 223, in import_uploaded_unit
pulp.server.managers.content.upload:ERROR: (20733-48768)     unit_type=unit_type_id, summary=result['summary'], details=result['details']
pulp.server.managers.content.upload:ERROR: (20733-48768) PulpCodedException: The importer yum_importer indicated a failed response when uploading rpm unit to repository external_rpms_el6.
pulp.server.async.tasks:INFO: Task failed : [f8bc500a-6dae-40bf-b69c-7ed37f30a30d] : The importer yum_importer indicated a failed response when uploading rpm unit to repository external_rpms_el6.
Actions
Copy link
 #1

Updated by amacdona@redhat.com over 7 years ago

  • Priority changed from Normal to Urgent
  • Severity changed from 2. Medium to 3. High
  • Triaged changed from No to Yes
Actions
Copy link
 #2

Updated by semyers over 7 years ago

  • Tags Known Issue for Release Notes added

This is considered a blocker for 2.10. It isn't blocking 2.9.1 (yet?), which goes GA next Tuesday. I think it should be considered for a 2.9.2 hotfix release.

Actions
Copy link
 #3

Updated by bmbouter over 7 years ago

+1 to 2.9.2 hotfix

Actions
Copy link
 #4

Updated by bmbouter over 7 years ago

  • Sprint/Milestone set to 24

Moving onto the sprint on the basis that it is urgent.

Actions
Copy link
 #5

Updated by cristi.falcas@gmail.com over 7 years ago

No dirty quick fix for this? We have breakage on a lot of repos because of it.

Actions
Copy link
 #6

Updated by fdobrovo over 7 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to fdobrovo
Actions
Copy link
 #7

Updated by fdobrovo over 7 years ago

  • Status changed from ASSIGNED to POST
Actions
Copy link
 #8

Updated by bmbouter over 7 years ago

Can a link to the PR be added to this?

Added by ttereshc over 7 years ago

Revision e4891345 | View on GitHub

Fixes unicode encoding issue for non-ASCII characters in the metadata

closes #2093 https://pulp.plan.io/issues/2093

Actions
Copy link
 #10

Updated by ttereshc over 7 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100
Actions
Copy link
 #11

Updated by ttereshc over 7 years ago

  • Platform Release set to 2.9.2
Actions
Copy link
 #12

Updated by semyers over 7 years ago

  • Project changed from Pulp to RPM Support
Actions
Copy link
 #13

Updated by semyers over 7 years ago

  • Status changed from MODIFIED to 5
Actions
Copy link
 #14

Updated by pthomas@redhat.com over 7 years ago

  • Status changed from 5 to 6

verified
[root@ibm-x3550m3-13 ~]# rpm -qa pulp-server
pulp-server-2.9.2-0.2.beta.el7.noarch
[root@ibm-x3550m3-13 ~]#

[root@ibm-x3550m3-13 ~]#  wget ftp://fr2.rpmfind.net/linux/epel/6/x86_64/protobuf-2.3.0-9.el6.x86_64.rpm
--2016-08-09 17:20:42--  ftp://fr2.rpmfind.net/linux/epel/6/x86_64/protobuf-2.3.0-9.el6.x86_64.rpm
           => ‘protobuf-2.3.0-9.el6.x86_64.rpm’
Resolving fr2.rpmfind.net (fr2.rpmfind.net)... 195.220.108.108
Connecting to fr2.rpmfind.net (fr2.rpmfind.net)|195.220.108.108|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done.    ==> PWD ... done.
==> TYPE I ... done.  ==> CWD (1) /linux/epel/6/x86_64 ... done.
==> SIZE protobuf-2.3.0-9.el6.x86_64.rpm ... 296132
==> PASV ... done.    ==> RETR protobuf-2.3.0-9.el6.x86_64.rpm ... done.
Length: 296132 (289K) (unauthoritative)

100%[===============================================================>] 296,132     1.75MB/s   in 0.2s   

2016-08-09 17:20:42 (1.75 MB/s) - ‘protobuf-2.3.0-9.el6.x86_64.rpm’ saved [296132]

[root@ibm-x3550m3-13 ~]# pulp-admin rpm repo uploads  rpm --repo-id myzoo -f protobuf-2.3.0-9.el6.x86_64.rpm  -v 
+----------------------------------------------------------------------+
                              Unit Upload
+----------------------------------------------------------------------+

Extracting necessary metadata for each request...
[==================================================] 100%
Analyzing: protobuf-2.3.0-9.el6.x86_64.rpm
... completed

Files to be uploaded:
  protobuf-2.3.0-9.el6.x86_64.rpm

Creating upload requests on the server...
[==================================================] 100%
Initializing: protobuf-2.3.0-9.el6.x86_64.rpm
... completed

Starting upload of selected units. If this process is stopped through ctrl+c,
the uploads will be paused and may be resumed later using the resume command or
canceled entirely using the cancel command.

Uploading: protobuf-2.3.0-9.el6.x86_64.rpm
[==================================================] 100%
296132/296132 bytes
... completed

Importing into the repository...
This command may be exited via ctrl+c without affecting the request.

[\]
Running...

Task Succeeded

Deleting the upload request...
... completed

[root@ibm-x3550m3-13 ~]#
Actions
Copy link
 #15

Updated by semyers over 7 years ago

  • Status changed from 6 to CLOSED - CURRENTRELEASE
Actions
Copy link
 #18

Updated by bmbouter about 6 years ago

  • Sprint set to Sprint 6
Actions
Copy link
 #19

Updated by bmbouter about 6 years ago

  • Sprint/Milestone deleted (24)
Actions
Copy link
 #20

Updated by bmbouter about 5 years ago

  • Tags Pulp 2 added
Actions
Copy link
 #21

Updated by bmbouter almost 4 years ago

  • Tags deleted (Known Issue for Release Notes)
Actions
Send by e-mail Copy link

Also available in: Atom PDF