Project

Profile

Help

Task #6677

closed

Task #6672: [Epic] Upload Process Improvements

Split the import_collection task into two tasks to reduce the amount of time the repository lock is held

Added by bmbouter over 4 years ago. Updated about 3 years ago.

Status:
CLOSED - DUPLICATE
Priority:
Normal
Assignee:
Sprint/Milestone:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Platform Release:
Groomed:
Yes
Sprint Candidate:
No
Tags:
Sprint:
Sprint 81
Quarter:

Description

Ticket moved to GitHub: "pulp/pulp_ansible/709":https://github.com/pulp/pulp_ansible/issues/709


Background

The import_collection task both analyzes a collection here and then creates content and adds it to a repository version here.

Problem

The import_collection runs long enough that to import a lot of content into a repository serializes these long tasks making the whole workload take long. It takes longer than it should because the collection analysis portion of the task runtime takes the majority of the time and the lock on repository is not needed during that. The lock is only needed when creating the RepositoryVersion itself.

Solution

  1. Split import_collection into two tasks. analyze_and_create_collection and then add_collection_to_repository.
  2. Have the analyze_and_create_collection task dispatch the add_collection_to_repository. The analyze_and_create_collection task requires no lock. The add_collection_to_respository should have the lock on the repository.
Actions #1

Updated by bmbouter over 4 years ago

  • Parent issue set to #6672
Actions #2

Updated by fao89 over 4 years ago

  • Groomed changed from No to Yes
  • Sprint set to Sprint 72
Actions #3

Updated by rchan over 4 years ago

  • Sprint changed from Sprint 72 to Sprint 73
Actions #4

Updated by fao89 over 4 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to fao89
Actions #5

Updated by pulpbot over 4 years ago

  • Status changed from ASSIGNED to POST
Actions #6

Updated by rchan over 4 years ago

  • Sprint changed from Sprint 73 to Sprint 74
Actions #7

Updated by rchan over 4 years ago

  • Sprint changed from Sprint 74 to Sprint 75
Actions #8

Updated by rchan over 4 years ago

  • Sprint changed from Sprint 75 to Sprint 76
Actions #9

Updated by rchan over 4 years ago

  • Sprint changed from Sprint 76 to Sprint 77
Actions #10

Updated by rchan over 4 years ago

  • Sprint changed from Sprint 77 to Sprint 78
Actions #11

Updated by rchan over 4 years ago

  • Sprint changed from Sprint 78 to Sprint 79
Actions #12

Updated by rchan about 4 years ago

  • Sprint changed from Sprint 79 to Sprint 80
Actions #13

Updated by rchan about 4 years ago

  • Sprint changed from Sprint 80 to Sprint 81
Actions #14

Updated by pulpbot about 3 years ago

  • Description updated (diff)
  • Status changed from POST to CLOSED - DUPLICATE

Also available in: Atom PDF