https://pulp.plan.io/https://pulp.plan.io/favicon.ico2017-09-19T14:40:37ZPulpPulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=219222017-09-19T14:40:37Zttereshcttereshc@redhat.com
<ul><li><strong>Triaged</strong> changed from <i>No</i> to <i>Yes</i></li><li><strong>Sprint Candidate</strong> changed from <i>No</i> to <i>Yes</i></li></ul> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=219672017-09-21T14:40:23Zmhrivnakmhrivnak@redhat.com
<ul><li><strong>Sprint/Milestone</strong> set to <i>45</i></li></ul> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=219792017-09-21T19:36:06Zbmbouterbmbouter@redhat.com
<ul></ul><p>I think the on_failures() and on_success() handlers should flush the database connection. These should always run after the task code has completed unless there is a SIGKILL. <a href="https://github.com/pulp/pulp/blob/3.0-dev/platform/pulpcore/tasking/tasks.py#L274-L315" class="external">https://github.com/pulp/pulp/blob/3.0-dev/platform/pulpcore/tasking/tasks.py#L274-L315</a></p> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=221722017-10-02T14:58:46Zdkliban@redhat.com
<ul><li><strong>Status</strong> changed from <i>NEW</i> to <i>ASSIGNED</i></li><li><strong>Assignee</strong> set to <i>dkliban@redhat.com</i></li></ul> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=221802017-10-02T18:13:40Zdkliban@redhat.com
<ul></ul><p>This seems like a bug with asyncio downloaders. The following traceback is emitted when an exception is not recorded:</p>
<pre><code>[2017-10-02 18:04:33,899: ERROR/ForkPoolWorker-1] Task exception was never retrieved
future: <Task finished coro=<attach_url_to_exception.<locals>.wrapper() done, defined at /home/vagrant/devel/pulp/plugin/pulpcore/plugin/download/asyncio/base.py:45> exception=ClientResponseError("404, message='Not Found'",)>
Traceback (most recent call last):
File "/usr/lib64/python3.5/asyncio/tasks.py", line 240, in _step
result = coro.send(None)
File "/home/vagrant/devel/pulp/plugin/pulpcore/plugin/download/asyncio/base.py", line 50, in wrapper
raise error
File "/home/vagrant/devel/pulp/plugin/pulpcore/plugin/download/asyncio/base.py", line 47, in wrapper
return await func(downloader)
File "/home/vagrant/devel/pulp/plugin/pulpcore/plugin/download/asyncio/http.py", line 129, in run
response.raise_for_status()
File "/home/vagrant/.virtualenvs/pulp/lib64/python3.5/site-packages/aiohttp/client_reqrep.py", line 653, in raise_for_status
headers=self.headers)
aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found'
</code></pre>
<p>I am investigating further and will post back when I know more about the nature of this problem.</p> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=221822017-10-02T19:14:22Zdkliban@redhat.com
<ul></ul><p>This problem is described here[0]. Though it looks like we are already chaining the coroutines.</p>
<p>[0] <a href="https://docs.python.org/3.5/library/asyncio-dev.html#detect-exceptions-never-consumed" class="external">https://docs.python.org/3.5/library/asyncio-dev.html#detect-exceptions-never-consumed</a></p> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=222362017-10-04T16:11:23Zdkliban@redhat.com
<ul><li><strong>Status</strong> changed from <i>ASSIGNED</i> to <i>POST</i></li></ul><p>The GroupDownloader was returning too soon when more than 1 download was complete.</p>
<p><a href="https://github.com/pulp/pulp/pull/3181" class="external">https://github.com/pulp/pulp/pull/3181</a></p> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=222372017-10-04T16:32:05Zdkliban@redhat.com
<ul><li><strong>Status</strong> changed from <i>POST</i> to <i>MODIFIED</i></li></ul><p>Applied in changeset <a class="changeset" title="Problem: GroupDownloader skips some downloads Solution: process all finished downloads before ch..." href="https://pulp.plan.io/projects/pulp/repository/pulp/revisions/ca975fba83b63574773a43b33d488c560ecd9d82">pulp|ca975fba83b63574773a43b33d488c560ecd9d82</a>.</p> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=262212018-03-08T23:24:34Zbmbouterbmbouter@redhat.com
<ul><li><strong>Sprint</strong> set to <i>Sprint 26</i></li></ul> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=262352018-03-08T23:24:56Zbmbouterbmbouter@redhat.com
<ul><li><strong>Sprint/Milestone</strong> deleted (<del><i>45</i></del>)</li></ul> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=415132019-04-25T16:46:00Zdaviddavis
<ul><li><strong>Sprint/Milestone</strong> set to <i>3.0.0</i></li></ul> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=428232019-04-26T20:37:48Zbmbouterbmbouter@redhat.com
<ul><li><strong>Tags</strong> deleted (<del><i>Pulp 3</i></del>)</li></ul> Pulp - Issue #3021: Database writes are not all recordedhttps://pulp.plan.io/issues/3021?journal_id=507312019-12-13T17:25:19Zbmbouterbmbouter@redhat.com
<ul><li><strong>Status</strong> changed from <i>MODIFIED</i> to <i>CLOSED - CURRENTRELEASE</i></li></ul>