Project

Profile

Help

Maintenance: Planio will be observing a scheduled maintenance window this Tuesday, November 5, 2024 from 03:00 UTC until 06:30 UTC to perform urgent network maintenance in our primary data center. Your Planio account will be unavailable during this maintenance window.

Story #6875

closed

[Meta] Integrate with Bandersnatch

Added by dalley over 4 years ago. Updated almost 4 years ago.

Status:
MODIFIED
Priority:
Normal
Assignee:
-
Sprint/Milestone:
-
Start date:
Due date:
% Done:

100%

Estimated time:
(Total: 0:00 h)
Platform Release:
3.0.0
Target Release - Python:
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Quarter:

Description

Bandersnatch is an officially-blessed tool for mirroring Python repositories developed by the PyPA organization. It has fairly widespread usage.

https://github.com/pypa/bandersnatch

https://bandersnatch.readthedocs.io

Currently we're attempting to re-implement several features such as package whitelists and blacklists, full PyPI mirroring support, and some version of "keep only the latest releases" -- all of which Bandersnatch already supports, with some degree of polish and testing and additional minor features such as regex filtering.

It would be ideal if we could leverage Bandersnatch's existing support for these features by using Bandersnatch as a library which acts as the frontend to Pulp, and is the only way in which we interact with PyPI. This would be beneficial to both ourselves and to the Python community, as it would increase the testing and quality of the Bandersnatch upstream as issues are found and fixed.

An issue has been file upstream to track the changes that are necessary within Bandersnatch to support this kind of usage.

https://github.com/pypa/bandersnatch/issues/548

This issue will be used to track the efforts needed within Pulp to integrate with Bandersnatch.


Sub-issues 2 (0 open2 closed)

Story #6929: As a User, I can configure Pulp Python remotes using a Bandersnatch config fileMODIFIEDgerrod

Actions
Refactor #6930: Use Bandersnatch to perform package metadata fetching and filteringMODIFIEDgerrod

Actions
Actions #1

Updated by dalley over 4 years ago

  • Related to Story #4690: Implement package locking / digest specification added
Actions #2

Updated by dalley over 4 years ago

  • Description updated (diff)
Actions #3

Updated by dalley over 4 years ago

  • Description updated (diff)
Actions #4

Updated by dalley over 4 years ago

  • Subject changed from Implement support for bandersnatch config file format for expressing sync settings to [Meta] Integrate with Bandersnatch
  • Description updated (diff)
Actions #5

Updated by dalley over 4 years ago

  • Related to deleted (Story #4690: Implement package locking / digest specification)

Added by gerrod about 4 years ago

Revision 5270947a | View on GitHub

Pulp now uses Bandersnatch to perform metadata syncing

Sync uses Bandersnatch to perform metadata fetching and filtering enabling Pulp to sync all of PyPi.

closes: #6930 closes: #6875 closes: #985 https://pulp.plan.io/issues/6930 https://pulp.plan.io/issues/6875 https://pulp.plan.io/issues/985

Actions #6

Updated by gerrod about 4 years ago

  • Status changed from NEW to MODIFIED
Actions #7

Updated by dalley almost 4 years ago

  • Platform Release set to 3.0.0

Also available in: Atom PDF