Refactor #9309
closed
Add support for new memory-efficient createrepo_c parsing method
Status:
CLOSED - DUPLICATE
Files
- Sprint/Milestone set to 3.16.0
Here's a measurement of the raw overhead of createrepo_c during the parsing of rhel6 repos (so, this doesn't include Pulp at all)
Current parsing strategy (peak: 392mb)
New API (peak: 19mb)
The time taken to parse the metadata also dropped from around 1 min 15 seconds with the current strategy to 13 seconds with the new API.
The old pure-createrepo_c parsing strategy which is disabled in Pulp due to memory consumption peaks at 1.9gb
- Copied to Backport #9313: Backport #9309 "Add support for new memory-efficient createrepo_c parsing method" to 3.14.z added
- Priority changed from Normal to High
- Sprint changed from Sprint 104 to Sprint 105
- Sprint changed from Sprint 105 to Sprint 106
- Sprint changed from Sprint 106 to Sprint 107
- Sprint/Milestone deleted (
3.16.0)
- Sprint changed from Sprint 107 to Sprint 108
- Sprint changed from Sprint 108 to Sprint 109
- Sprint changed from Sprint 109 to Sprint 110
- Has duplicate Issue #9567: More fault tollerant metadata parsing added
- Sprint changed from Sprint 110 to Sprint 111
- Description updated (diff)
- Status changed from POST to CLOSED - DUPLICATE
Also available in: Atom
PDF
.