Project

Profile

Help

Issue #7183

Updated by dalley almost 4 years ago

On my system, with 8 pulp2 repositories comprised EDIT: I need to follow up on this in light of about 183,000 the fact that content units, re-migration takes 15+ minutes which is still are not where we would like it to be (a couple of minutes). being migrated properly.    Content migration That likely throws off the ratio and makes pre-migration is ~87% look like more of an issue than it is. 



 The following results were gathered by migrating the following repos with multi-tasking parallelism turned off (because it makes gathering profiles like this basically impossible). 

 * Fedora 30 release & update repositories 
 * Fedora 31 release & update repositories 
 * Centos 6 & Centos 7 
 * Centos 8 AppStream and BaseOS 

 It's something like ~230,000 content units in total runtime here. 

 ## Initial migration 

 ![](migration_performance_initial.png) ![](many_repo_initial_migration.png) 

 ## Re-migration Remigration 

 ![](migration_performance_remigration.png) 
 ![](many_repo_re_migration.png) 

 As you can see in both the intitial and subsequent migrations, the pre-migration of content is by far the most significant contributor to runtime, and it's not parallelized so this effect is completely unmitigated.    We need to figure out how to improve this.

Back