Project

Profile

Help

Refactor #9309

closed

Add support for new memory-efficient createrepo_c parsing method

Added by dalley about 1 year ago. Updated 10 months ago.

Status:
CLOSED - DUPLICATE
Priority:
High
Assignee:
Sprint/Milestone:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Platform Release:
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 111
Quarter:

Description

Ticket moved to GitHub: "pulp/pulp_rpm/2296":https://github.com/pulp/pulp_rpm/issues/2296


Files


Related issues

Has duplicate RPM Support - Issue #9567: More fault tollerant metadata parsingCLOSED - DUPLICATE11/12/2021Actions
Copied to RPM Support - Backport #9313: Backport #9309 "Add support for new memory-efficient createrepo_c parsing method" to 3.14.zCLOSED - DUPLICATEdalley

Actions
Actions #1

Updated by dalley about 1 year ago

  • Sprint/Milestone set to 3.16.0
Actions #2

Updated by dalley about 1 year ago

Here's a measurement of the raw overhead of createrepo_c during the parsing of rhel6 repos (so, this doesn't include Pulp at all)

Current parsing strategy (peak: 392mb)

New API (peak: 19mb)

The time taken to parse the metadata also dropped from around 1 min 15 seconds with the current strategy to 13 seconds with the new API.

The old pure-createrepo_c parsing strategy which is disabled in Pulp due to memory consumption peaks at 1.9gb

Actions #4

Updated by dalley about 1 year ago

  • Copied to Backport #9313: Backport #9309 "Add support for new memory-efficient createrepo_c parsing method" to 3.14.z added
Actions #6

Updated by dalley about 1 year ago

  • Priority changed from Normal to High
Actions #7

Updated by rchan about 1 year ago

  • Sprint changed from Sprint 104 to Sprint 105
Actions #8

Updated by rchan about 1 year ago

  • Sprint changed from Sprint 105 to Sprint 106
Actions #9

Updated by rchan 12 months ago

  • Sprint changed from Sprint 106 to Sprint 107
Actions #10

Updated by dalley 12 months ago

  • Sprint/Milestone deleted (3.16.0)
Actions #11

Updated by rchan 12 months ago

  • Sprint changed from Sprint 107 to Sprint 108
Actions #12

Updated by rchan 11 months ago

  • Sprint changed from Sprint 108 to Sprint 109
Actions #13

Updated by rchan 11 months ago

  • Sprint changed from Sprint 109 to Sprint 110
Actions #14

Updated by dalley 10 months ago

  • Has duplicate Issue #9567: More fault tollerant metadata parsing added
Actions #15

Updated by rchan 10 months ago

  • Sprint changed from Sprint 110 to Sprint 111
Actions #16

Updated by fao89 10 months ago

  • Description updated (diff)
  • Status changed from POST to CLOSED - DUPLICATE

Also available in: Atom PDF