Project

Profile

Help

Story #6875

[Meta] Integrate with Bandersnatch

Added by dalley 4 months ago. Updated 7 days ago.

Status:
MODIFIED
Priority:
Normal
Assignee:
-
Sprint/Milestone:
-
Start date:
Due date:
% Done:

100%

Estimated time:
(Total: 0:00 h)
Platform Release:
Target Release - Python:
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Quarter:

Description

Bandersnatch is an officially-blessed tool for mirroring Python repositories developed by the PyPA organization. It has fairly widespread usage.

https://github.com/pypa/bandersnatch

https://bandersnatch.readthedocs.io

Currently we're attempting to re-implement several features such as package whitelists and blacklists, full PyPI mirroring support, and some version of "keep only the latest releases" -- all of which Bandersnatch already supports, with some degree of polish and testing and additional minor features such as regex filtering.

It would be ideal if we could leverage Bandersnatch's existing support for these features by using Bandersnatch as a library which acts as the frontend to Pulp, and is the only way in which we interact with PyPI. This would be beneficial to both ourselves and to the Python community, as it would increase the testing and quality of the Bandersnatch upstream as issues are found and fixed.

An issue has been file upstream to track the changes that are necessary within Bandersnatch to support this kind of usage.

https://github.com/pypa/bandersnatch/issues/548

This issue will be used to track the efforts needed within Pulp to integrate with Bandersnatch.


Subtasks

Story #6929: As a User, I can configure Pulp Python remotes using a Bandersnatch config fileMODIFIEDgerrod

Actions
Refactor #6930: Use Bandersnatch to perform package metadata fetching and filteringMODIFIEDgerrod

Actions

Associated revisions

Revision 5270947a View on GitHub
Added by gerrod 7 days ago

Pulp now uses Bandersnatch to perform metadata syncing

Sync uses Bandersnatch to perform metadata fetching and filtering enabling Pulp to sync all of PyPi.

closes: #6930 closes: #6875 closes: #985 https://pulp.plan.io/issues/6930 https://pulp.plan.io/issues/6875 https://pulp.plan.io/issues/985

History

#1 Updated by dalley 4 months ago

  • Related to Story #4690: Implement package locking / digest specification added

#2 Updated by dalley 4 months ago

  • Description updated (diff)

#3 Updated by dalley 4 months ago

  • Description updated (diff)

#4 Updated by dalley 4 months ago

  • Subject changed from Implement support for bandersnatch config file format for expressing sync settings to [Meta] Integrate with Bandersnatch
  • Description updated (diff)

#5 Updated by dalley 4 months ago

  • Related to deleted (Story #4690: Implement package locking / digest specification)

#6 Updated by gerrod 7 days ago

  • Status changed from NEW to MODIFIED

Please register to edit this issue

Also available in: Atom PDF