Project

Profile

Help

Issue #5236

Collections sync doesn't fetch metadata in parallel

Added by bmbouter over 1 year ago. Updated 7 months ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Performance
Sprint:
Sprint 57
Quarter:

Description

The current sync implementation schedules a single coroutine and waits for it to return, this effectively schedules a single downloader. When you have to make thousands of requests (as this sync does) we should parallelize it.

Associated revisions

Revision be614270 View on GitHub
Added by Fabricio Aguiar over 1 year ago

Optimize collections sync

closes #5236

History

#1 Updated by bmbouter over 1 year ago

  • Tracker changed from Task to Issue
  • Subject changed from Update Collections sync to be parallelized to Collections sync doesn't fetch metadata in parallel
  • Severity set to 2. Medium
  • Triaged set to Yes
  • Sprint set to Sprint 57

#2 Updated by fao89 over 1 year ago

  • Status changed from NEW to POST

#3 Updated by Anonymous over 1 year ago

  • Status changed from POST to MODIFIED

#4 Updated by bmbouter about 1 year ago

  • Sprint/Milestone set to 3.0.0

#5 Updated by bmbouter about 1 year ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

#6 Updated by bmbouter 7 months ago

  • Tags Performance added
  • Tags deleted (Sync Performance)

Please register to edit this issue

Also available in: Atom PDF