Project

Profile

Help

Refactor #6930

closed

Story #6875: [Meta] Integrate with Bandersnatch

Use Bandersnatch to perform package metadata fetching and filtering

Added by dalley almost 4 years ago. Updated over 3 years ago.

Status:
MODIFIED
Priority:
Normal
Assignee:
Sprint/Milestone:
-
Start date:
Due date:
% Done:

100%

Estimated time:
Platform Release:
3.0.0
Target Release - Python:
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 82
Quarter:

Description

We should use Bandersnatch as a library to perform metadata fetching and filtering. Bandersnatch already supports a large number of the features which we want to support, is well tested and used, and is appropriately "polite" about accessing PyPI's APIs.

Some work needs to be done on the Bandersnatch side of things to make this possible, but the developers are very receptive to these changes since it will improve the overall code quality of the project. This issue discusses some of this work:

https://github.com/pypa/bandersnatch/issues/548


Related issues

Related to Python Support - Refactor #4132: Metadata is not downloaded in parallelCLOSED - NOTABUG

Actions
Related to Python Support - Story #2040: As a user, I can choose which package types to syncCLOSED - DUPLICATE

Actions
Related to Python Support - Story #985: As a user, I can sync all packages from pypi (complete mirror)MODIFIED

Actions
Related to Python Support - Story #138: As a user, I can express how many old versions of a package to keep during syncCLOSED - DUPLICATE

Actions
Actions #1

Updated by dalley almost 4 years ago

  • Related to Refactor #4132: Metadata is not downloaded in parallel added
Actions #2

Updated by dalley almost 4 years ago

  • Related to Story #2040: As a user, I can choose which package types to sync added
Actions #3

Updated by dalley almost 4 years ago

  • Related to Story #985: As a user, I can sync all packages from pypi (complete mirror) added
Actions #4

Updated by dalley almost 4 years ago

  • Related to Story #138: As a user, I can express how many old versions of a package to keep during sync added
Actions #5

Updated by dalley almost 4 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to gerrod
  • Sprint set to Sprint 76
Actions #6

Updated by rchan almost 4 years ago

  • Sprint changed from Sprint 76 to Sprint 77
Actions #7

Updated by rchan almost 4 years ago

  • Sprint changed from Sprint 77 to Sprint 78
Actions #8

Updated by rchan over 3 years ago

  • Sprint changed from Sprint 78 to Sprint 79
Actions #9

Updated by rchan over 3 years ago

  • Sprint changed from Sprint 79 to Sprint 80
Actions #10

Updated by rchan over 3 years ago

  • Sprint changed from Sprint 80 to Sprint 81
Actions #11

Updated by rchan over 3 years ago

  • Sprint changed from Sprint 81 to Sprint 82

Added by gerrod over 3 years ago

Revision 5270947a | View on GitHub

Pulp now uses Bandersnatch to perform metadata syncing

Sync uses Bandersnatch to perform metadata fetching and filtering enabling Pulp to sync all of PyPi.

closes: #6930 closes: #6875 closes: #985 https://pulp.plan.io/issues/6930 https://pulp.plan.io/issues/6875 https://pulp.plan.io/issues/985

Actions #12

Updated by gerrod over 3 years ago

  • Status changed from ASSIGNED to MODIFIED
  • % Done changed from 0 to 100
Actions #13

Updated by dalley over 3 years ago

  • Platform Release set to 3.0.0

Also available in: Atom PDF