Project

Profile

Help

Issue #9233

closed

Downloaded content seems to be removed when a task fails

Added by lmjachky over 2 years ago. Updated over 2 years ago.

Status:
CLOSED - DUPLICATE
Priority:
Low
Assignee:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 111
Quarter:

Description

Ticket moved to GitHub: "pulp/pulp_rpm/2294":https://github.com/pulp/pulp_rpm/issues/2294


For large repositories, this means that when performing immediate synchronization, all the downloaded content is lost after the task's failure. Pulp is then trying to download the content (artifacts) once again from scratch when issuing re-syncing, rather than associating the orphaned artifacts with corresponding content units.

More info can be found here: https://community.theforeman.org/t/oracle-linux-8-appstream-sync-fails/24676/9. The following part is the most important to us:

If you are performing one of these large syncs, and get part way through before the sync fails with the timeout, it seems everything which was downloaded into the tmp directory is thrown away, and not kept. So, the next time the sync is tried, it has to download everything again.

Used versions: pulpcore 3.14.3 and pulp_rpm 3.14.0

This behaviour could not be reproduced for pulp_file (https://fixtures.pulpproject.org/file/; pulpcore 3.15.0.dev and pulp_file 1.9.0.dev); therefore, we should focus on the pulp_rpm plugin.

Actions #1

Updated by lmjachky over 2 years ago

  • Description updated (diff)
Actions #2

Updated by lmjachky over 2 years ago

  • Description updated (diff)
Actions #3

Updated by lmjachky over 2 years ago

  • Description updated (diff)
Actions #4

Updated by lmjachky over 2 years ago

  • Description updated (diff)
Actions #5

Updated by dalley over 2 years ago

  • Triaged changed from No to Yes

We still need to confirm whether this happens

Actions #6

Updated by dalley over 2 years ago

  • Sprint set to Sprint 104
Actions #7

Updated by dalley over 2 years ago

  • Priority changed from Normal to Low
Actions #8

Updated by rchan over 2 years ago

  • Sprint changed from Sprint 104 to Sprint 105
Actions #9

Updated by rchan over 2 years ago

  • Sprint changed from Sprint 105 to Sprint 106
Actions #10

Updated by rchan over 2 years ago

  • Sprint changed from Sprint 106 to Sprint 107
Actions #11

Updated by rchan over 2 years ago

  • Sprint changed from Sprint 107 to Sprint 108
Actions #12

Updated by rchan over 2 years ago

  • Sprint changed from Sprint 108 to Sprint 109
Actions #13

Updated by rchan over 2 years ago

  • Sprint changed from Sprint 109 to Sprint 110
Actions #14

Updated by rchan over 2 years ago

  • Sprint changed from Sprint 110 to Sprint 111
Actions #15

Updated by fao89 over 2 years ago

  • Description updated (diff)
  • Status changed from NEW to CLOSED - DUPLICATE

Also available in: Atom PDF