Project

Profile

Help

Issue #1210

ConnectionError - BadStatusLine during repo sync

Added by ipanova@redhat.com almost 6 years ago. Updated about 2 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Start date:
Due date:
Estimated time:
(Total: 0:00 h)
Severity:
3. High
Version - Nectar:
1.5.1
Platform Release:
Target Release - Nectar:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

From time to time ConnectionError: ('Connection aborted.', BadStatusLine("''",)) is raised during synchronization of content. The requirements for this bug to happens is -sync of multiple big repos. This leads to the situation where 1-2 packages are skipped and not fetched.
A re-try logic of fetching same item needs to be introduced when this specific situation happens.

for more info check https://bugzilla.redhat.com/show_bug.cgi?id=1248167


Subtasks

RPM Support - Issue #960: Sync sometimes fetches partial filesCLOSED - DUPLICATEActions

Related issues

Related to Nectar - Issue #1709: Nectar 1.4.5 should be retagged/released as 1.5.0CLOSED - CURRENTRELEASE<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Has duplicate RPM Support - Issue #1767: Errors when synchronizing from a mirror listCLOSED - DUPLICATE<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

Associated revisions

Revision e1a26e6f View on GitHub
Added by ipanova@redhat.com almost 6 years ago

ConnectionError - BadStatusLine during repo sync.

closes #1210 https://pulp.plan.io/issues/1210

Revision 34d9470c View on GitHub
Added by Jeremy Cline over 5 years ago

Use urllib3's retry functionality for failed connections.

urllib3, the library used by requests (which is used by nectar) provides ways to configure it to retry connections that fail for various reasons. We should use these.

closes #1210

History

#1 Updated by ipanova@redhat.com almost 6 years ago

  • Project changed from Pulp to Nectar
  • Status changed from NEW to ASSIGNED
  • Version - Nectar set to 1.3.1
  • Target Release - Nectar set to master

#2 Updated by ipanova@redhat.com almost 6 years ago

  • Severity changed from 2. Medium to 3. High

#3 Updated by ipanova@redhat.com almost 6 years ago

  • Status changed from ASSIGNED to POST
  • Priority changed from Normal to High
  • Severity changed from 3. High to 2. Medium

#4 Updated by mhrivnak almost 6 years ago

  • Triaged changed from No to Yes

#5 Updated by ipanova@redhat.com almost 6 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100

#7 Updated by rbarlow over 5 years ago

  • Target Release - Nectar changed from master to 1.4.4

#8 Updated by rbarlow over 5 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

#9 Updated by jcline@redhat.com over 5 years ago

  • Status changed from CLOSED - CURRENTRELEASE to NEW
  • Assignee deleted (ipanova@redhat.com)
  • Version - Nectar deleted (1.3.1)
  • Target Release - Nectar deleted (1.4.4)

Today someone encountered this with python-nectar-1.3.4-1.el7sat:

pulp[6863]: pulp.plugins.conduits.mixins:DEBUG: cannot update unit; does not exist. adding instead.
pulp[6863]: requests.packages.urllib3.connectionpool:DEBUG: "GET /pub/epel/7/x86_64/t/thunderbird-lightning-3.3-5.el7.x86_64.rpm HTTP/1.1" 200 2854964
pulp[6863]: pulp.plugins.conduits.mixins:DEBUG: cannot update unit; does not exist. adding instead.
pulp[6863]: nectar.downloaders.threaded:WARNING: ('Connection aborted.', BadStatusLine("''",))
pulp[6863]: pulp.plugins.conduits.mixins:DEBUG: cannot update unit; does not exist. adding instead.
pulp[6863]: nectar.downloaders.threaded:DEBUG: Skipping https://dl.fedoraproject.org/pub/epel/7/x86_64/t/tidy-0.99.0-31.20091203.el7.x86_64.rpm because dl.fedoraproject.org could not be reached.
pulp[6863]: nectar.downloaders.threaded:DEBUG: Skipping https://dl.fedoraproject.org/pub/epel/7/x86_64/t/tidyp-1.02-11.el7.x86_64.rpm because dl.fedoraproject.org could not be reached.

I believe the issue has not been resolved.

#10 Updated by jcline@redhat.com over 5 years ago

  • Triaged changed from Yes to No

#11 Updated by mhrivnak over 5 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to jcline@redhat.com
  • Severity changed from 2. Medium to 3. High
  • Triaged changed from No to Yes

#12 Updated by mhrivnak over 5 years ago

  • Related to Issue #1709: Nectar 1.4.5 should be retagged/released as 1.5.0 added

#13 Updated by jcline@redhat.com over 5 years ago

  • Status changed from ASSIGNED to POST

#14 Updated by Anonymous over 5 years ago

  • Status changed from POST to MODIFIED

#15 Updated by dkliban@redhat.com over 5 years ago

  • Status changed from MODIFIED to 5

#16 Updated by ipanova@redhat.com over 5 years ago

  • Has duplicate Issue #1767: Errors when synchronizing from a mirror list added

#18 Updated by jcline@redhat.com about 5 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE
  • Version - Nectar set to 1.5.1

The fix from https://github.com/pulp/nectar/pull/45 is included in nectar v1.5.0

#20 Updated by bmbouter about 2 years ago

  • Tags Pulp 2 added

Please register to edit this issue

Also available in: Atom PDF