Story #7942
Task #7938: [EPIC] As a user, I have improved Galaxy V3 sync performance
As a sync user, I get no-op when possible
100%
Description
The first stage needs to keep all the existing code and fall back to it if the "new metadata endpoints are not available". They are only available on the Galaxy V3 API and if the server side implements them.
Model Changes¶
Add to the AnsibleRemote a new attribute named last_synced_metadata_time. Allow it to be None since in many cases, e.g. V2 sync and V3 sync's that don't yet support the new "metadata optimizations" won't be saving data into this attribute.
No migration is needed, since a None value will cause a sync to occur, and only subsequent sync's will be no-operation optimized.
Sync Workflow Changes¶
- Check at the
/pulp_ansible/galaxy/<path:path>/api/v3/endpoint and check the build time. If 404, fall back to the existing sync implementation. - If the build time is the same as the one stored on the Repository object, exit the sync doing nothing (no-operation)
- Save the
last_synced_metadata_timeto theAnsibleRepositoryso that the next time sync occurs we can determine if the server side has changed.
Related issues
Associated revisions
History
#1
Updated by bmbouter 6 months ago
- Blocked by Story #7939: As a user, the /v3/ endpoint returns the repository_version.created time added
#2
Updated by bmbouter 6 months ago
- Blocked by Story #7940: As a user, I have a new v3/metadata/collections/ endpoint returning all collections unpaginated added
#3
Updated by bmbouter 6 months ago
- Blocked by Story #7941: As a user, I have a new v3/metadata/collection_versions/ endpoint returning all collection_versions unpaginated added
#6
Updated by fao89 5 months ago
- Copied to Story #8177: As a sync user, I use the efficient unpaginated metadata endpoints if they are available added
#11
Updated by Anonymous 4 months ago
- Status changed from POST to MODIFIED
- % Done changed from 0 to 100
Applied in changeset pulp_ansible|e09fee302577c91613e73f5ab9e19b435730ccfc.
#13
Updated by bmbouter 4 months ago
- Has duplicate Story #7672: Sync Repository Metadata at sync time and parse and save it added
Please register to edit this issue
.
Improve sync performance with no-op when possible
https://pulp.plan.io/issues/7942 closes #7942