Issue #9233
closedDownloaded content seems to be removed when a task fails
Description
Ticket moved to GitHub: "pulp/pulp_rpm/2294":https://github.com/pulp/pulp_rpm/issues/2294
For large repositories, this means that when performing immediate synchronization, all the downloaded content is lost after the task's failure. Pulp is then trying to download the content (artifacts) once again from scratch when issuing re-syncing, rather than associating the orphaned artifacts with corresponding content units.
More info can be found here: https://community.theforeman.org/t/oracle-linux-8-appstream-sync-fails/24676/9. The following part is the most important to us:
If you are performing one of these large syncs, and get part way through before the sync fails with the timeout, it seems everything which was downloaded into the tmp directory is thrown away, and not kept. So, the next time the sync is tried, it has to download everything again.
Used versions: pulpcore 3.14.3 and pulp_rpm 3.14.0
This behaviour could not be reproduced for pulp_file (https://fixtures.pulpproject.org/file/; pulpcore 3.15.0.dev and pulp_file 1.9.0.dev); therefore, we should focus on the pulp_rpm plugin.
Updated by dalley about 2 years ago
- Triaged changed from No to Yes
We still need to confirm whether this happens
Updated by rchan almost 2 years ago
- Sprint changed from Sprint 106 to Sprint 107
Updated by rchan almost 2 years ago
- Sprint changed from Sprint 107 to Sprint 108
Updated by rchan almost 2 years ago
- Sprint changed from Sprint 108 to Sprint 109
Updated by rchan almost 2 years ago
- Sprint changed from Sprint 109 to Sprint 110
Updated by rchan almost 2 years ago
- Sprint changed from Sprint 110 to Sprint 111
Updated by fao89 almost 2 years ago
- Description updated (diff)
- Status changed from NEW to CLOSED - DUPLICATE