Project

Profile

Help

Issue #1210

closed

ConnectionError - BadStatusLine during repo sync

Added by ipanova@redhat.com over 7 years ago. Updated over 3 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Start date:
Due date:
Estimated time:
(Total: 0:00 h)
Severity:
3. High
Version - Nectar:
1.5.1
Platform Release:
Target Release - Nectar:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

From time to time ConnectionError: ('Connection aborted.', BadStatusLine("''",)) is raised during synchronization of content. The requirements for this bug to happens is -sync of multiple big repos. This leads to the situation where 1-2 packages are skipped and not fetched.
A re-try logic of fetching same item needs to be introduced when this specific situation happens.

for more info check https://bugzilla.redhat.com/show_bug.cgi?id=1248167


Subtasks 1 (0 open1 closed)

RPM Support - Issue #960: Sync sometimes fetches partial filesCLOSED - DUPLICATEActions

Related issues

Related to Nectar - Issue #1709: Nectar 1.4.5 should be retagged/released as 1.5.0CLOSED - CURRENTRELEASEipanova@redhat.comActions
Has duplicate RPM Support - Issue #1767: Errors when synchronizing from a mirror listCLOSED - DUPLICATEActions
Actions #1

Updated by ipanova@redhat.com over 7 years ago

  • Project changed from Pulp to Nectar
  • Status changed from NEW to ASSIGNED
  • Version - Nectar set to 1.3.1
  • Target Release - Nectar set to master
Actions #2

Updated by ipanova@redhat.com over 7 years ago

  • Severity changed from 2. Medium to 3. High
Actions #3

Updated by ipanova@redhat.com over 7 years ago

  • Status changed from ASSIGNED to POST
  • Priority changed from Normal to High
  • Severity changed from 3. High to 2. Medium
Actions #4

Updated by mhrivnak over 7 years ago

  • Triaged changed from No to Yes

Added by ipanova@redhat.com over 7 years ago

Revision e1a26e6f

ConnectionError - BadStatusLine during repo sync.

closes #1210 https://pulp.plan.io/issues/1210

Actions #5

Updated by ipanova@redhat.com over 7 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100
Actions #7

Updated by rbarlow almost 7 years ago

  • Target Release - Nectar changed from master to 1.4.4
Actions #8

Updated by rbarlow almost 7 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE
Actions #9

Updated by jcline@redhat.com almost 7 years ago

  • Status changed from CLOSED - CURRENTRELEASE to NEW
  • Assignee deleted (ipanova@redhat.com)
  • Version - Nectar deleted (1.3.1)
  • Target Release - Nectar deleted (1.4.4)

Today someone encountered this with python-nectar-1.3.4-1.el7sat:

pulp[6863]: pulp.plugins.conduits.mixins:DEBUG: cannot update unit; does not exist. adding instead.
pulp[6863]: requests.packages.urllib3.connectionpool:DEBUG: "GET /pub/epel/7/x86_64/t/thunderbird-lightning-3.3-5.el7.x86_64.rpm HTTP/1.1" 200 2854964
pulp[6863]: pulp.plugins.conduits.mixins:DEBUG: cannot update unit; does not exist. adding instead.
pulp[6863]: nectar.downloaders.threaded:WARNING: ('Connection aborted.', BadStatusLine("''",))
pulp[6863]: pulp.plugins.conduits.mixins:DEBUG: cannot update unit; does not exist. adding instead.
pulp[6863]: nectar.downloaders.threaded:DEBUG: Skipping https://dl.fedoraproject.org/pub/epel/7/x86_64/t/tidy-0.99.0-31.20091203.el7.x86_64.rpm because dl.fedoraproject.org could not be reached.
pulp[6863]: nectar.downloaders.threaded:DEBUG: Skipping https://dl.fedoraproject.org/pub/epel/7/x86_64/t/tidyp-1.02-11.el7.x86_64.rpm because dl.fedoraproject.org could not be reached.

I believe the issue has not been resolved.

Actions #10

Updated by jcline@redhat.com almost 7 years ago

  • Triaged changed from Yes to No
Actions #11

Updated by mhrivnak almost 7 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to jcline@redhat.com
  • Severity changed from 2. Medium to 3. High
  • Triaged changed from No to Yes
Actions #12

Updated by mhrivnak almost 7 years ago

  • Related to Issue #1709: Nectar 1.4.5 should be retagged/released as 1.5.0 added
Actions #13

Updated by jcline@redhat.com almost 7 years ago

  • Status changed from ASSIGNED to POST

Added by Jeremy Cline almost 7 years ago

Revision 34d9470c

Use urllib3's retry functionality for failed connections.

urllib3, the library used by requests (which is used by nectar) provides ways to configure it to retry connections that fail for various reasons. We should use these.

closes #1210

Actions #14

Updated by Anonymous almost 7 years ago

  • Status changed from POST to MODIFIED
Actions #15

Updated by dkliban@redhat.com over 6 years ago

  • Status changed from MODIFIED to 5
Actions #16

Updated by ipanova@redhat.com over 6 years ago

  • Has duplicate Issue #1767: Errors when synchronizing from a mirror list added
Actions #18

Updated by jcline@redhat.com over 6 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE
  • Version - Nectar set to 1.5.1

The fix from https://github.com/pulp/nectar/pull/45 is included in nectar v1.5.0

Actions #20

Updated by bmbouter over 3 years ago

  • Tags Pulp 2 added

Also available in: Atom PDF