Project

Profile

Help

Task #8960

Story #7659: [EPIC] As a user, orphan cleanup does not block all other tasks

Ensure that pulp imports can run concurrently with orphan cleanup

Added by daviddavis 3 months ago. Updated about 2 months ago.

Status:
NEW
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Platform Release:
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Quarter:

Description

I've confirmed that when an import happens, it bumps the timestamp_of_interest for artifacts and content so that when the import gets to the repository version creation step, the artifacts/content are still there.

However, I am not so sure that there isn't a possibly a race condition with django-import-export that could occur between when it selects the record(s) and then updates them. In fact, given the async problems we've seen in the past, I think it's likely.

I know we fixed another error similar to this:

https://pulp.plan.io/issues/8633

And perhaps our fix for #8633 might save us here: the fix added code to retry the import if it experienced errors and perhaps that will also apply to this situation where an artifact/content goes missing before it's updated. We need to confirm this though.

History

#1 Updated by daviddavis 3 months ago

  • Sprint/Milestone set to 3.15.0

This needs to be done before we make orphan cleanup non-blocking but it doesn't necessarily need to be done as part of 3.14.

#2 Updated by daviddavis 3 months ago

  • Blocks Task #8824: Convert orphan cleanup into a non-blocking task added

#3 Updated by daviddavis 2 months ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to daviddavis

#4 Updated by daviddavis about 2 months ago

  • Status changed from ASSIGNED to NEW
  • Assignee deleted (daviddavis)

#5 Updated by daviddavis about 2 months ago

  • Sprint/Milestone deleted (3.15.0)

Per our go/no-go meeting, we decided that a potential fix could be released as a z-stream and doesn't need to block the 3.15 release.

#6 Updated by mdellweg about 1 month ago

  • Blocks deleted (Task #8824: Convert orphan cleanup into a non-blocking task)

Please register to edit this issue

Also available in: Atom PDF