Project

Profile

Help

Refactor #9309

Add support for new memory-efficient createrepo_c parsing method

Added by dalley about 2 months ago. Updated 1 day ago.

Status:
POST
Priority:
High
Assignee:
Sprint/Milestone:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Platform Release:
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 108
Quarter:


Related issues

Copied to RPM Support - Backport #9313: Backport #9309 "Add support for new memory-efficient createrepo_c parsing method" to 3.14.zNEW

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

History

#1 Updated by dalley about 2 months ago

  • Sprint/Milestone set to 3.16.0

#2 Updated by dalley about 2 months ago

250
250

Here's a measurement of the raw overhead of createrepo_c during the parsing of rhel6 repos (so, this doesn't include Pulp at all)

Current parsing strategy (peak: 392mb)

New API (peak: 19mb)

The time taken to parse the metadata also dropped from around 1 min 15 seconds with the current strategy to 13 seconds with the new API.

The old pure-createrepo_c parsing strategy which is disabled in Pulp due to memory consumption peaks at 1.9gb

#4 Updated by dalley about 2 months ago

  • Copied to Backport #9313: Backport #9309 "Add support for new memory-efficient createrepo_c parsing method" to 3.14.z added

#6 Updated by dalley about 2 months ago

  • Priority changed from Normal to High

#7 Updated by rchan about 1 month ago

  • Sprint changed from Sprint 104 to Sprint 105

#8 Updated by rchan 29 days ago

  • Sprint changed from Sprint 105 to Sprint 106

#9 Updated by rchan 14 days ago

  • Sprint changed from Sprint 106 to Sprint 107

#10 Updated by dalley 8 days ago

  • Sprint/Milestone deleted (3.16.0)

#11 Updated by rchan 1 day ago

  • Sprint changed from Sprint 107 to Sprint 108

Please register to edit this issue

Also available in: Atom PDF