https://pulp.plan.io/https://pulp.plan.io/favicon.ico2017-12-08T15:50:47ZPulpRPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=232202017-12-08T15:50:47Zdalleydalley@redhat.com
<ul><li><strong>Sprint/Milestone</strong> set to <i>48</i></li><li><strong>Triaged</strong> changed from <i>No</i> to <i>Yes</i></li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=235022017-12-19T16:17:11Zrchan
<ul><li><strong>Sprint/Milestone</strong> changed from <i>48</i> to <i>52</i></li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=236052018-01-03T06:13:01Zhyu
<ul></ul><p>The issue happened in Satellite 6 when I have some organizations with the same repositories.</p>
<p>To reproduce the issues I created additional 2 organizations (total 3 orgs) and synced the following repositories for each organization.</p>
<p>Red Hat Enterprise Linux 6 Server RPMs x86_64 6Server<br>
Red Hat Enterprise Linux 6 Server - RH Common RPMs x86_64 6Server<br>
Red Hat Enterprise Linux 6 Server - Optional RPMs x86_64 6Server<br>
Red Hat Enterprise Linux 6 Server - Fastrack RPMs x86_64<br>
Red Hat Enterprise Linux 6 Server - Extras RPMs x86_64</p>
<p>Result of generate applicability without my patch:</p>
<p>It consumed ~500MB RSS. Before I created additional 2 organizations it was consuming ~350MB. This proof that the memory will</p>
<p>apache 1811 34.5 6.2 1017124 487380 ? Sl 12:48 0:58 /usr/bin/python /usr/bin/celery worker -n reserved_resource_worker-0@%h -A pulp.server.async.app -c 1 --events --umask 18 --pidfile=/var/run/pulp/reserved_resource_worker-0.pid --heartbeat-interval=30 --maxtasksperchild=20</p>
<p>Result of generate applicability with my patch from upstream bug:</p>
<p>It memory is stable at ~150MB RSS before and after creating additional organizations.</p>
<p>apache 2629 11.0 1.9 684440 150632 ? Sl 12:58 0:54 /usr/bin/python /usr/bin/celery worker -n reserved_resource_worker-0@%h -A pulp.server.async.app -c 1 --events --umask 18 --pidfile=/var/run/pulp/reserved_resource_worker-0.pid --heartbeat-interval=30 --maxtasksperchild=20</p>
<p>Although the memory has significantly reduced with my patch but there is only a little or no performance improvement. it took about 1 minute to run the "generate applicability" task.</p> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=236192018-01-03T18:45:20Zttereshcttereshc@redhat.com
<ul><li><strong>Status</strong> changed from <i>NEW</i> to <i>ASSIGNED</i></li><li><strong>Assignee</strong> set to <i>ttereshc</i></li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=237592018-01-08T21:27:12Zrchan
<ul><li><strong>Sprint/Milestone</strong> changed from <i>52</i> to <i>53</i></li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=243202018-01-30T14:22:05Zjortel@redhat.comjortel@redhat.com
<ul><li><strong>Sprint/Milestone</strong> changed from <i>53</i> to <i>54</i></li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=246972018-02-22T16:22:42Zrchan
<ul><li><strong>Sprint/Milestone</strong> changed from <i>54</i> to <i>56</i></li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=265172018-03-08T23:35:52Zbmbouterbmbouter@redhat.com
<ul><li><strong>Sprint</strong> set to <i>Sprint 33</i></li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=265382018-03-08T23:36:21Zbmbouterbmbouter@redhat.com
<ul><li><strong>Sprint/Milestone</strong> deleted (<del><i>56</i></del>)</li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=267612018-03-14T16:39:55Zjortel@redhat.comjortel@redhat.com
<ul><li><strong>Sprint Candidate</strong> changed from <i>No</i> to <i>Yes</i></li><li><strong>Sprint</strong> deleted (<del><i>Sprint 33</i></del>)</li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=281072018-05-11T12:06:11Zttereshcttereshc@redhat.com
<ul><li><strong>Status</strong> changed from <i>ASSIGNED</i> to <i>POST</i></li></ul><p><a href="https://github.com/pulp/pulp_rpm/pull/1107" class="external">https://github.com/pulp/pulp_rpm/pull/1107</a></p> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=281092018-05-11T12:57:15Zttereshcttereshc@redhat.com
<ul><li><strong>Sprint</strong> set to <i>Sprint 36</i></li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=281492018-05-11T21:03:10Zrchan
<ul><li><strong>Sprint</strong> changed from <i>Sprint 36</i> to <i>Sprint 37</i></li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=283102018-05-18T07:59:35Zttereshcttereshc@redhat.com
<ul><li><strong>Status</strong> changed from <i>POST</i> to <i>MODIFIED</i></li></ul><p>Applied in changeset <a class="changeset" title="Use aggregation to identify unique errata pkglists To improve both performance and memory consum..." href="https://pulp.plan.io/projects/pulp_rpm/repository/9/revisions/6a40090685f8295d42419a1641351998fa75e709">6a40090685f8295d42419a1641351998fa75e709</a>.</p> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=288522018-06-15T12:00:00Zdkliban@redhat.com
<ul><li><strong>Platform Release</strong> set to <i>2.16.2</i></li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=289092018-06-18T18:09:30Zttereshcttereshc@redhat.com
<ul></ul><p>Applied in changeset <a class="changeset" title="Use aggregation to identify unique errata pkglists To improve both performance and memory consum..." href="https://pulp.plan.io/projects/pulp_rpm/repository/9/revisions/759ff1c0f48b07881dcbb0c10b97f0dbfc9b2701">759ff1c0f48b07881dcbb0c10b97f0dbfc9b2701</a>.</p> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=293512018-07-09T14:26:06Zipanova@redhat.comipanova@redhat.com
<ul><li><strong>Status</strong> changed from <i>MODIFIED</i> to <i>CLOSED - CURRENTRELEASE</i></li></ul> RPM Support - Issue #3172: Celery worker consumes large number of memory when regenerating applicability for a consumer that binds to many repositories with many errata.https://pulp.plan.io/issues/3172?journal_id=380752019-04-15T20:14:42Zbmbouterbmbouter@redhat.com
<ul><li><strong>Tags</strong> <i>Pulp 2</i> added</li></ul>