Project

Profile

Help

Story #5165

As a user, I can mirror collection content

Added by bmbouter 5 months ago. Updated 4 months ago.

Status:
MODIFIED
Priority:
Normal
Sprint/Milestone:
-
Start date:
Due date:
% Done:

100%

Platform Release:
Blocks Release:
Backwards Incompatible:
No
Groomed:
Yes
Sprint Candidate:
No
Tags:
QA Contact:
Complexity:
Smash Test:
Verified:
No
Verification Required:
No
Sprint:
Sprint 57

Description

Currently pulp_ansible calls out to Mazer to perform the sync of Collection content from the Galaxy V2 API. This was done initially to get something working, but it's inefficient since the Stages API could provide asyncio based downloading and Artifact creation.

Solution

Switch pulp_ansible sync to use the Stages API instead. This will require several calls to be made to implement the client side of the Collection downloading workflow.

The calls that will need to be made by the downloaders will need to probably call the V2 collection URLs pulp_ansible implements here: https://github.com/pulp/pulp_ansible/blob/master/pulp_ansible/app/urls.py#L24-L38 Also the /api/ call.

Associated revisions

Revision 49bc50e0 View on GitHub
Added by Fabricio Aguiar 4 months ago

Sync collections with stages API

Sync all collections (a full mirror) from Galaxy.
Removing whitelist from CollectionRemote,
now you can sync collections utilizing just the url:
- All collections:
url=https://galaxy.ansible.com/api/v2/collections/
- Specific collection:
url=https://galaxy.ansible.com/api/v2/collections/testing/k8s_demo_collection/
- Filtering:
url=https://galaxy.ansible.com/api/v2/collections/?namespace__name=testing

closes #5165
https://pulp.plan.io/issues/5165

History

#1 Updated by bmbouter 4 months ago

  • Description updated (diff)

#2 Updated by bmbouter 4 months ago

  • Description updated (diff)

#3 Updated by daviddavis 4 months ago

  • Groomed changed from No to Yes
  • Sprint set to Sprint 56

#4 Updated by bmbouter 4 months ago

  • Subject changed from As a user, Sync is faster by switching sync to use Stages API to As a user, I can mirror collection content

It's not really about performance as much as being able to mirror all collection content instead of what we have now which is whitelist only. Currently the user would have to name all content to download it all.

#5 Updated by rchan 4 months ago

  • Sprint changed from Sprint 56 to Sprint 57

#6 Updated by fabricio.aguiar 4 months ago

  • Status changed from NEW to POST
  • Assignee set to fabricio.aguiar

#7 Updated by Anonymous 4 months ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100

Please register to edit this issue

Also available in: Atom PDF