Project

Profile

Help

Task #6677

Task #6672: [Epic] Upload Process Improvements

Split the import_collection task into two tasks to reduce the amount of time the repository lock is held

Added by bmbouter 6 months ago. Updated about 2 months ago.

Status:
POST
Priority:
Normal
Assignee:
Sprint/Milestone:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Platform Release:
Groomed:
Yes
Sprint Candidate:
No
Tags:
Sprint:
Sprint 81
Quarter:

Description

Background

The import_collection task both analyzes a collection here and then creates content and adds it to a repository version here.

Problem

The import_collection runs long enough that to import a lot of content into a repository serializes these long tasks making the whole workload take long. It takes longer than it should because the collection analysis portion of the task runtime takes the majority of the time and the lock on repository is not needed during that. The lock is only needed when creating the RepositoryVersion itself.

Solution

  1. Split import_collection into two tasks. analyze_and_create_collection and then add_collection_to_repository.
  2. Have the analyze_and_create_collection task dispatch the add_collection_to_repository. The analyze_and_create_collection task requires no lock. The add_collection_to_respository should have the lock on the repository.

History

#1 Updated by bmbouter 6 months ago

  • Parent task set to #6672

#2 Updated by fao89 6 months ago

  • Groomed changed from No to Yes
  • Sprint set to Sprint 72

#3 Updated by rchan 6 months ago

  • Sprint changed from Sprint 72 to Sprint 73

#4 Updated by fao89 5 months ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to fao89

#5 Updated by pulpbot 5 months ago

  • Status changed from ASSIGNED to POST

#6 Updated by rchan 5 months ago

  • Sprint changed from Sprint 73 to Sprint 74

#7 Updated by rchan 5 months ago

  • Sprint changed from Sprint 74 to Sprint 75

#8 Updated by rchan 4 months ago

  • Sprint changed from Sprint 75 to Sprint 76

#9 Updated by rchan 4 months ago

  • Sprint changed from Sprint 76 to Sprint 77

#10 Updated by rchan 3 months ago

  • Sprint changed from Sprint 77 to Sprint 78

#11 Updated by rchan 3 months ago

  • Sprint changed from Sprint 78 to Sprint 79

#12 Updated by rchan 2 months ago

  • Sprint changed from Sprint 79 to Sprint 80

#13 Updated by rchan about 2 months ago

  • Sprint changed from Sprint 80 to Sprint 81

Please register to edit this issue

Also available in: Atom PDF