Story #6024
Updated by gmbnomis almost 5 years ago
h1. Motivation Plugins need to iterate over the content in a repository version to create a publication. Pulp should offer a batching iterator over content in order to limit the memory footprint and to allow efficient use of content batches in DB operations. h1. Solution We could make @batch_qs()@ available to plugin writers. But this generator is hard to use correctly because of the ordering requirement (even in pulpcore it has not been used correctly). Instead, add a generator to @RepositoryVersion@, which does "the right thing" by default and is customizable by plugin writers if necessary. For an example use case, see https://github.com/gmbnomis/pulp_cookbook/blob/batched_publication_upstream/pulp_cookbook/app/tasks/publishing.py#L87-L117
.