Project

Profile

Help

Issue #3571

closed

Pulp not able to sync via DNS

Added by dsouza.rohan06 about 6 years ago. Updated almost 4 years ago.

Status:
CLOSED - NOTABUG
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
2.14.0
Platform Release:
OS:
CentOS 7
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Performance, Pulp 2
Sprint:
Quarter:

Description

Hello,

Pulp is not able to sync repositories via DNS (/etc/resolv.conf) . However, if create an hosts entry in /etc/hosts, it is able to sync without any issues.

[rohan.ds@pulp-2 ~]$ dig pulp-hk.india.endurance.com

; <<>> DiG 9.9.4-RedHat-9.9.4-51.el7_4.1 <<>> pulp-hk.india.endurance.com
;; global options: +cmd
;; Got answer:
;; >>HEADER<< opcode: QUERY, status: NOERROR, id: 23329
;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 13, ADDITIONAL: 27

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 4096
;; QUESTION SECTION:
;pulp-hk.india.endurance.com. IN A

;; ANSWER SECTION:
pulp-hk.india.endurance.com. 134 IN A 172.25.160.40
pulp-hk.india.endurance.com. 134 IN A 172.25.160.41

;; Query time: 1 msec
;; SERVER: 172.25.160.36#53(172.25.160.36)
;; WHEN: Mon Apr 16 19:10:46 UTC 2018
;; MSG SIZE rcvd: 884

As you can see, it hardly took about 1 msec to get the A record of the pulp server.

I get the following error when using my local DNS server for name resolution:

[rohan.ds@pulp-2 ~]$ sudo pulp-admin rpm repo sync run --repo-id obox-7-x86_64
--------------------------------------------------------------------
Synchronizing Repository [obox-7-x86_64]
--------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Downloading metadata...
[/]

Task Failed

Importer indicated a failed response

Logs:

Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://pulp-austin.india.endura
nce.com/pulp/repos/obox-7-x86_64/repodata/690ce5d57fa45e23f3cd74fa10903795bdd9917a96e8c6437453b46bb85b3589-other.xml.gz failed with code
404: NOT FOUND
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: nectar.downloaders.threaded:INFO: Download succeeded: https://pulp-austin.india.endurance.com/p
ulp/repos/obox-7-x86_64/repodata/a27718cc28ec6d71432e0ef3e6da544b7f9d93f6bb7d0a55aacd592d03144b70-comps.xml.
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://pulp-austin.india.endura
nce.com/pulp/repos/obox-7-x86_64/repodata/ccc68b23d5ede576394da4593097a8023ca2d407d8458a53db0566f4a1f3230c-primary.xml.gz failed with co
de 404: NOT FOUND
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) NOT FOUND
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) Traceback (most recent call
last):
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) File "/usr/lib/python2.7/s
ite-packages/pulp_rpm/plugins/importers/yum/sync.py", line 262, in run
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) metadata_files = self.ge
t_metadata(metadata_files)
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) File "/usr/lib/python2.7/s
ite-packages/pulp_rpm/plugins/importers/yum/sync.py", line 449, in get_metadata
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) metadata_files.download_
metadata_files()
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) File "/usr/lib/python2.7/s
ite-packages/pulp_rpm/plugins/importers/yum/repomd/metadata.py", line 217, in download_metadata_files
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) raise IOError(error_repo
rt.error_msg)
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp_rpm.plugins.importers.yum.sync:ERROR: [81df630b] (2126-95616) IOError: NOT FOUND
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: pulp.server.async.tasks:INFO: [81df630b] Task failed : [81df630b-9895-4a15-9369-d3d402be6f66]
Apr 16 19:12:20 pulp-2.tel-hk.colo pulp: celery.worker.job:ERROR: (1900-95616) Task pulp.server.managers.repo.sync.sync[81df630b-9895-4a15-9369-d3d402be6f66] raised unexpected: PulpExecutionException('Importer indicated a failed response',)

Please let me know as to why am I facing this issue.

Regards,
Rohan Dsouza

Actions #1

Updated by dsouza.rohan06 about 6 years ago

Its similar to the issue mentioned here: https://pulp.plan.io/issues/478

Actions #2

Updated by dkliban@redhat.com about 6 years ago

  • Status changed from NEW to CLOSED - NOTABUG

After some discussion on IRC it sounds like this is a problem with the DNS servers being used. If a better way to reproduce this problem is discovered, please feel free to reopen the bug.

Actions #3

Updated by bmbouter about 5 years ago

  • Tags Pulp 2 added
Actions #4

Updated by bmbouter almost 4 years ago

  • Tags Performance added
  • Tags deleted (Sync Performance)

Also available in: Atom PDF