Project

Profile

Help

Refactor #6930

Story #6875: [Meta] Integrate with Bandersnatch

Use Bandersnatch to perform package metadata fetching and filtering

Added by dalley 4 months ago. Updated 7 days ago.

Status:
MODIFIED
Priority:
Normal
Assignee:
Sprint/Milestone:
-
Start date:
Due date:
% Done:

100%

Estimated time:
Platform Release:
Target Release - Python:
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 82
Quarter:

Description

We should use Bandersnatch as a library to perform metadata fetching and filtering. Bandersnatch already supports a large number of the features which we want to support, is well tested and used, and is appropriately "polite" about accessing PyPI's APIs.

Some work needs to be done on the Bandersnatch side of things to make this possible, but the developers are very receptive to these changes since it will improve the overall code quality of the project. This issue discusses some of this work:

https://github.com/pypa/bandersnatch/issues/548


Related issues

Related to Python Support - Refactor #4132: Metadata is not downloaded in parallelNEW

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to Python Support - Story #2040: As a user, I can choose which package types to syncNEW

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to Python Support - Story #985: As a user, I can sync all packages from pypi (complete mirror)MODIFIED

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to Python Support - Story #138: As a user, I can express how many old versions of a package to keep during syncNEW

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

Associated revisions

Revision 5270947a View on GitHub
Added by gerrod 7 days ago

Pulp now uses Bandersnatch to perform metadata syncing

Sync uses Bandersnatch to perform metadata fetching and filtering enabling Pulp to sync all of PyPi.

closes: #6930 closes: #6875 closes: #985 https://pulp.plan.io/issues/6930 https://pulp.plan.io/issues/6875 https://pulp.plan.io/issues/985

History

#1 Updated by dalley 4 months ago

  • Related to Refactor #4132: Metadata is not downloaded in parallel added

#2 Updated by dalley 4 months ago

  • Related to Story #2040: As a user, I can choose which package types to sync added

#3 Updated by dalley 4 months ago

  • Related to Story #985: As a user, I can sync all packages from pypi (complete mirror) added

#4 Updated by dalley 4 months ago

  • Related to Story #138: As a user, I can express how many old versions of a package to keep during sync added

#5 Updated by dalley 3 months ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to gerrod
  • Sprint set to Sprint 76

#6 Updated by rchan 3 months ago

  • Sprint changed from Sprint 76 to Sprint 77

#7 Updated by rchan 2 months ago

  • Sprint changed from Sprint 77 to Sprint 78

#8 Updated by rchan about 2 months ago

  • Sprint changed from Sprint 78 to Sprint 79

#9 Updated by rchan about 1 month ago

  • Sprint changed from Sprint 79 to Sprint 80

#10 Updated by rchan 25 days ago

  • Sprint changed from Sprint 80 to Sprint 81

#11 Updated by rchan 11 days ago

  • Sprint changed from Sprint 81 to Sprint 82

#12 Updated by gerrod 7 days ago

  • Status changed from ASSIGNED to MODIFIED
  • % Done changed from 0 to 100

Please register to edit this issue

Also available in: Atom PDF