Project

Profile

Help

Issue #9233

Downloaded content seems to be removed when a task fails

Added by lmjachky 2 months ago. Updated 8 days ago.

Status:
NEW
Priority:
Low
Assignee:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 107
Quarter:

Description

For large repositories, this means that when performing immediate synchronization, all the downloaded content is lost after the task's failure. Pulp is then trying to download the content (artifacts) once again from scratch when issuing re-syncing, rather than associating the orphaned artifacts with corresponding content units.

More info can be found here: https://community.theforeman.org/t/oracle-linux-8-appstream-sync-fails/24676/9. The following part is the most important to us:

If you are performing one of these large syncs, and get part way through before the sync fails with the timeout, it seems everything which was downloaded into the tmp directory is thrown away, and not kept. So, the next time the sync is tried, it has to download everything again.

Used versions: pulpcore 3.14.3 and pulp_rpm 3.14.0

This behaviour could not be reproduced for pulp_file (https://fixtures.pulpproject.org/file/; pulpcore 3.15.0.dev and pulp_file 1.9.0.dev); therefore, we should focus on the pulp_rpm plugin.

History

#1 Updated by lmjachky 2 months ago

  • Description updated (diff)

#2 Updated by lmjachky 2 months ago

  • Description updated (diff)

#3 Updated by lmjachky 2 months ago

  • Description updated (diff)

#4 Updated by lmjachky 2 months ago

  • Description updated (diff)

#5 Updated by dalley about 2 months ago

  • Triaged changed from No to Yes

We still need to confirm whether this happens

#6 Updated by dalley about 1 month ago

  • Sprint set to Sprint 104

#7 Updated by dalley about 1 month ago

  • Priority changed from Normal to Low

#8 Updated by rchan about 1 month ago

  • Sprint changed from Sprint 104 to Sprint 105

#9 Updated by rchan 23 days ago

  • Sprint changed from Sprint 105 to Sprint 106

#10 Updated by rchan 8 days ago

  • Sprint changed from Sprint 106 to Sprint 107

Please register to edit this issue

Also available in: Atom PDF