Project

Profile

Help

Send by e-mail

Refactor #6930

Story #6875: [Meta] Integrate with Bandersnatch

Use Bandersnatch to perform package metadata fetching and filtering

Added by dalley over 1 year ago. Updated 11 months ago.

Status:
MODIFIED
Priority:
Normal
Assignee:
gerrod
Sprint/Milestone:
-
Start date:
Due date:
% Done:

100%

Estimated time:
Platform Release:
3.0.0
Target Release - Python:
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 82
Quarter:

Description

We should use Bandersnatch as a library to perform metadata fetching and filtering. Bandersnatch already supports a large number of the features which we want to support, is well tested and used, and is appropriately "polite" about accessing PyPI's APIs.

Some work needs to be done on the Bandersnatch side of things to make this possible, but the developers are very receptive to these changes since it will improve the overall code quality of the project. This issue discusses some of this work:

https://github.com/pypa/bandersnatch/issues/548

Related issues

Related to Python Support - Refactor #4132: Metadata is not downloaded in parallelCLOSED - NOTABUG

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to Python Support - Story #2040: As a user, I can choose which package types to syncCLOSED - DUPLICATE

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to Python Support - Story #985: As a user, I can sync all packages from pypi (complete mirror)MODIFIED

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to Python Support - Story #138: As a user, I can express how many old versions of a package to keep during syncCLOSED - DUPLICATE

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

Associated revisions

Revision 5270947a View on GitHub
Added by gerrod about 1 year ago

Pulp now uses Bandersnatch to perform metadata syncing

Sync uses Bandersnatch to perform metadata fetching and filtering enabling Pulp to sync all of PyPi.

closes: #6930 closes: #6875 closes: #985 https://pulp.plan.io/issues/6930 https://pulp.plan.io/issues/6875 https://pulp.plan.io/issues/985

History

#1 Updated by dalley over 1 year ago

  • Related to Refactor #4132: Metadata is not downloaded in parallel added

#2 Updated by dalley over 1 year ago

  • Related to Story #2040: As a user, I can choose which package types to sync added

#3 Updated by dalley over 1 year ago

  • Related to Story #985: As a user, I can sync all packages from pypi (complete mirror) added

#4 Updated by dalley over 1 year ago

  • Related to Story #138: As a user, I can express how many old versions of a package to keep during sync added

#5 Updated by dalley over 1 year ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to gerrod
  • Sprint set to Sprint 76

#6 Updated by rchan over 1 year ago

  • Sprint changed from Sprint 76 to Sprint 77

#7 Updated by rchan over 1 year ago

  • Sprint changed from Sprint 77 to Sprint 78

#8 Updated by rchan over 1 year ago

  • Sprint changed from Sprint 78 to Sprint 79

#9 Updated by rchan over 1 year ago

  • Sprint changed from Sprint 79 to Sprint 80

#10 Updated by rchan about 1 year ago

  • Sprint changed from Sprint 80 to Sprint 81

#11 Updated by rchan about 1 year ago

  • Sprint changed from Sprint 81 to Sprint 82

#12 Updated by gerrod about 1 year ago

  • Status changed from ASSIGNED to MODIFIED
  • % Done changed from 0 to 100

#13 Updated by dalley 11 months ago

  • Platform Release set to 3.0.0
Send by e-mail

Also available in: Atom PDF