https://pulp.plan.io/
https://pulp.plan.io/favicon.ico
2018-04-20T20:17:48Z
Pulp
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=27729
2018-04-20T20:17:48Z
dkliban@redhat.com
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/journals/27729/diff?detail_id=28358">diff</a>)</li></ul>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=27739
2018-04-22T20:37:50Z
dalley
dalley@redhat.com
<ul></ul><p>It fails like 90% of the time, but it does work like 10% of the time on Python 3.5.</p>
<p>It works (seemingly) 100% of the time on Python 3.6</p>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=27793
2018-04-24T14:36:07Z
daviddavis
<ul><li><strong>Triaged</strong> changed from <i>No</i> to <i>Yes</i></li><li><strong>Sprint</strong> set to <i>Sprint 36</i></li></ul><p>I think the next step is to try to reproduce this locally and debug. I tried with python 3.5.4 and couldn't reproduce though. I think Travis is using python 3.5.5 so maybe that's why.</p>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28075
2018-05-07T16:01:19Z
jortel@redhat.com
jortel@redhat.com
<ul><li><strong>Status</strong> changed from <i>NEW</i> to <i>ASSIGNED</i></li><li><strong>Assignee</strong> set to <i>jortel@redhat.com</i></li></ul>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28098
2018-05-09T19:33:52Z
jortel@redhat.com
jortel@redhat.com
<ul></ul><p>Failing test: <a href="https://github.com/PulpQE/pulp-smash/blob/dcc0fbe495ad5dcc8e0899a128b785008907f908/pulp_smash/tests/pulp3/pulpcore/api_v3/test_workers.py#L70" class="external">https://github.com/PulpQE/pulp-smash/blob/dcc0fbe495ad5dcc8e0899a128b785008907f908/pulp_smash/tests/pulp3/pulpcore/api_v3/test_workers.py#L70</a></p>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28143
2018-05-11T21:02:41Z
rchan
<ul><li><strong>Sprint</strong> changed from <i>Sprint 36</i> to <i>Sprint 37</i></li></ul>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28165
2018-05-14T15:28:24Z
jortel@redhat.com
jortel@redhat.com
<ul></ul><p>Unable to reproduce so far using:</p>
<ul>
<li>django-crispy-forms (1.7.2)</li>
<li>django-extensions (2.0.7)</li>
<li>django-filter (1.1.0)</li>
<li>djangorestframework (3.8.2)</li>
<li>djangorestframework-jwt (1.11.0)</li>
</ul>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28242
2018-05-15T19:28:24Z
dalley
dalley@redhat.com
<ul><li><strong>Assignee</strong> changed from <i>jortel@redhat.com</i> to <i>dalley</i></li><li><strong>Tags</strong> <i>Pulp 3</i> added</li></ul>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28247
2018-05-15T23:55:30Z
dalley
dalley@redhat.com
<ul></ul><p>Reproduced:</p>
<pre><code>CPython/3.5.2
=============
pip list | grep -i django
-------------------------
Django 2.0.5
django-crispy-forms 1.7.2
django-extensions 2.0.7
django-filter 1.1.0
djangorestframework 3.8.2
(pulp) [vagrant@pulp3 pulp]$ http GET ":8000/pulp/api/v3/workers/"
{
"next": null,
"previous": null,
"results": [
{
"_href": "http://localhost:8000/pulp/api/v3/workers/267e7528-43c4-4e98-aa43-5e39e72a94c3/",
"id": "267e7528-43c4-4e98-aa43-5e39e72a94c3",
"last_heartbeat": "2018-05-15T22:23:19.825483Z",
"missing": false,
"name": "reserved_resource_worker_2@pulp3.dev",
"online": false
},
{
"_href": "http://localhost:8000/pulp/api/v3/workers/454f6b10-e4bc-46bd-9102-d5b2384c4be1/",
"id": "454f6b10-e4bc-46bd-9102-d5b2384c4be1",
"last_heartbeat": "2018-05-15T22:34:23.902196Z",
"missing": false,
"name": "reserved_resource_worker_1@pulp3.dev",
"online": true
},
{
"_href": "http://localhost:8000/pulp/api/v3/workers/d5096dd8-8126-4bb6-917d-7a4ffe9932d9/",
"id": "d5096dd8-8126-4bb6-917d-7a4ffe9932d9",
"last_heartbeat": "2018-05-15T22:23:19.829143Z",
"missing": false,
"name": "resource_manager@pulp3.dev",
"online": false
}
]
}
(pulp) [vagrant@pulp3 pulp]$ http GET ":8000/pulp/api/v3/workers/?online=True"
{
"next": null,
"previous": null,
"results": [
{
"_href": "http://localhost:8000/pulp/api/v3/workers/454f6b10-e4bc-46bd-9102-d5b2384c4be1/",
"id": "454f6b10-e4bc-46bd-9102-d5b2384c4be1",
"last_heartbeat": "2018-05-15T22:23:20.987260Z",
"missing": false,
"name": "reserved_resource_worker_1@pulp3.dev",
"online": true
}
]
}
(pulp) [vagrant@pulp3 pulp]$ http GET ":8000/pulp/api/v3/workers/?name=reserved_resource_worker_2@pulp3.dev"
{
"next": null,
"previous": null,
"results": [
{
"_href": "http://localhost:8000/pulp/api/v3/workers/267e7528-43c4-4e98-aa43-5e39e72a94c3/",
"id": "267e7528-43c4-4e98-aa43-5e39e72a94c3",
"last_heartbeat": "2018-05-15T22:23:19.825483Z",
"missing": false,
"name": "reserved_resource_worker_2@pulp3.dev",
"online": false
}
]
}
(pulp) [vagrant@pulp3 pulp]$ http GET ":8000/pulp/api/v3/workers/?name=reserved_resource_worker_2@pulp3.dev&online=True"
{
"next": null,
"previous": null,
"results": [
{
"_href": "http://localhost:8000/pulp/api/v3/workers/454f6b10-e4bc-46bd-9102-d5b2384c4be1/",
"id": "454f6b10-e4bc-46bd-9102-d5b2384c4be1",
"last_heartbeat": "2018-05-15T22:23:51.110808Z",
"missing": false,
"name": "reserved_resource_worker_1@pulp3.dev",
"online": true
}
]
}
CPython/3.6.5
=============
pip list | grep -i django
-------------------------
Django 2.0.5
django-crispy-forms 1.7.2
django-extensions 2.0.7
django-filter 1.1.0
djangorestframework 3.8.2
(pulp) [vagrant@pulp3 pulp]$ http GET ":8000/pulp/api/v3/workers/"
{
"next": null,
"previous": null,
"results": [
{
"_href": "http://localhost:8000/pulp/api/v3/workers/4be920ab-2458-4955-a54c-bfe673f94d1a/",
"id": "4be920ab-2458-4955-a54c-bfe673f94d1a",
"last_heartbeat": "2018-05-15T23:43:48.026657Z",
"missing": false,
"name": "reserved_resource_worker_2@pulp3.dev",
"online": false
},
{
"_href": "http://localhost:8000/pulp/api/v3/workers/bbc7abd1-7c5e-49fa-9231-2e9a42d5bf39/",
"id": "bbc7abd1-7c5e-49fa-9231-2e9a42d5bf39",
"last_heartbeat": "2018-05-15T23:43:48.028704Z",
"missing": false,
"name": "resource_manager@pulp3.dev",
"online": false
},
{
"_href": "http://localhost:8000/pulp/api/v3/workers/db161f9d-b67a-444e-8280-f8dfd5a0dc97/",
"id": "db161f9d-b67a-444e-8280-f8dfd5a0dc97",
"last_heartbeat": "2018-05-15T23:44:12.789671Z",
"missing": false,
"name": "reserved_resource_worker_1@pulp3.dev",
"online": true
}
]
}
(pulp) [vagrant@pulp3 pulp]$ http GET ":8000/pulp/api/v3/workers/?online=True"
{
"next": null,
"previous": null,
"results": [
{
"_href": "http://localhost:8000/pulp/api/v3/workers/db161f9d-b67a-444e-8280-f8dfd5a0dc97/",
"id": "db161f9d-b67a-444e-8280-f8dfd5a0dc97",
"last_heartbeat": "2018-05-15T23:46:28.543678Z",
"missing": false,
"name": "reserved_resource_worker_1@pulp3.dev",
"online": true
}
]
}
(pulp) [vagrant@pulp3 pulp]$ http GET ":8000/pulp/api/v3/workers/?name=reserved_resource_worker_2@pulp3.dev"
{
"next": null,
"previous": null,
"results": [
{
"_href": "http://localhost:8000/pulp/api/v3/workers/4be920ab-2458-4955-a54c-bfe673f94d1a/",
"id": "4be920ab-2458-4955-a54c-bfe673f94d1a",
"last_heartbeat": "2018-05-15T23:43:48.026657Z",
"missing": false,
"name": "reserved_resource_worker_2@pulp3.dev",
"online": false
}
]
}
(pulp) [vagrant@pulp3 pulp]$ http GET ":8000/pulp/api/v3/workers/?name=reserved_resource_worker_2@pulp3.dev&online=True"
{
"next": null,
"previous": null,
"results": []
}
</code></pre>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28373
2018-05-22T17:35:38Z
dalley
dalley@redhat.com
<ul><li><strong>Status</strong> changed from <i>ASSIGNED</i> to <i>POST</i></li></ul><p>PR: <a href="https://github.com/pulp/pulp/pull/3500" class="external">https://github.com/pulp/pulp/pull/3500</a></p>
<p>Intersection limits what you can do in further queries. If the intersection happens first, the name filter doesn't get applied.</p>
<pre><code>System check identified no issues (0 silenced).
May 22, 2018 - 15:53:24
Django version 2.0.5, using settings 'pulpcore.app.settings'
Starting development server at http://0.0.0.0:8000/
Quit the server with CONTROL-C.
(SELECT "pulp_app_worker"."id",
"pulp_app_worker"."created",
"pulp_app_worker"."last_updated",
"pulp_app_worker"."name",
"pulp_app_worker"."last_heartbeat",
"pulp_app_worker"."gracefully_stopped",
"pulp_app_worker"."cleaned_up"
FROM "pulp_app_worker"
WHERE "pulp_app_worker"."name" = resource_manager@pulp3.dev) INTERSECT
(SELECT "pulp_app_worker"."id",
"pulp_app_worker"."created",
"pulp_app_worker"."last_updated",
"pulp_app_worker"."name",
"pulp_app_worker"."last_heartbeat",
"pulp_app_worker"."gracefully_stopped",
"pulp_app_worker"."cleaned_up"
FROM "pulp_app_worker"
WHERE ("pulp_app_worker"."gracefully_stopped" = FALSE
AND "pulp_app_worker"."last_heartbeat" >= 2018-05-22 15:52:57.894782+00:00))
[22/May/2018 15:53:27] "GET /pulp/api/v3/workers/?name=resource_manager@pulp3.dev&online=True HTTP/1.1" 200 290
^C(pulp) [vagrant@pulp3 pulp]$ python manage.py runserver 0.0.0.0:8000
/home/vagrant/.virtualenvs/pulp/lib64/python3.5/site-packages/psycopg2/__init__.py:144: UserWarning: The psycopg2 wheel package will be renamed from release 2.8; in order to keep installing from binary please use "pip install psycopg2-binary" instead. For details see: <http://initd.org/psycopg/docs/install.html#binary-install-from-pypi>.
""")
/home/vagrant/.virtualenvs/pulp/lib64/python3.5/site-packages/psycopg2/__init__.py:144: UserWarning: The psycopg2 wheel package will be renamed from release 2.8; in order to keep installing from binary please use "pip install psycopg2-binary" instead. For details see: <http://initd.org/psycopg/docs/install.html#binary-install-from-pypi>.
""")
Performing system checks...
System check identified no issues (0 silenced).
May 22, 2018 - 15:53:35
Django version 2.0.5, using settings 'pulpcore.app.settings'
Starting development server at http://0.0.0.0:8000/
Quit the server with CONTROL-C.
(SELECT "pulp_app_worker"."id",
"pulp_app_worker"."created",
"pulp_app_worker"."last_updated",
"pulp_app_worker"."name",
"pulp_app_worker"."last_heartbeat",
"pulp_app_worker"."gracefully_stopped",
"pulp_app_worker"."cleaned_up"
FROM "pulp_app_worker") INTERSECT
(SELECT "pulp_app_worker"."id",
"pulp_app_worker"."created",
"pulp_app_worker"."last_updated",
"pulp_app_worker"."name",
"pulp_app_worker"."last_heartbeat",
"pulp_app_worker"."gracefully_stopped",
"pulp_app_worker"."cleaned_up"
FROM "pulp_app_worker"
WHERE ("pulp_app_worker"."gracefully_stopped" = FALSE
AND "pulp_app_worker"."last_heartbeat" >= 2018-05-22 15:53:19.456311+00:00))
[22/May/2018 15:53:49] "GET /pulp/api/v3/workers/?name=resource_manager@pulp3.dev&online=True HTTP/1.1" 200 808
In [11]: fmt(Worker.objects.filter(name='resource_manager@pulp3.dev').intersection(Worker.objects.online_workers()))
(SELECT "pulp_app_worker"."id",
"pulp_app_worker"."created",
"pulp_app_worker"."last_updated",
"pulp_app_worker"."name",
"pulp_app_worker"."last_heartbeat",
"pulp_app_worker"."gracefully_stopped",
"pulp_app_worker"."cleaned_up"
FROM "pulp_app_worker"
WHERE "pulp_app_worker"."name" = resource_manager@pulp3.dev) INTERSECT
(SELECT "pulp_app_worker"."id",
"pulp_app_worker"."created",
"pulp_app_worker"."last_updated",
"pulp_app_worker"."name",
"pulp_app_worker"."last_heartbeat",
"pulp_app_worker"."gracefully_stopped",
"pulp_app_worker"."cleaned_up"
FROM "pulp_app_worker"
WHERE ("pulp_app_worker"."gracefully_stopped" = FALSE
AND "pulp_app_worker"."last_heartbeat" >= 2018-05-22 15:41:50.722037+00:00))
In [12]: fmt(Worker.objects.online_workers().intersection(Worker.objects.filter(name='resource_manager@pulp3.dev')))
(SELECT "pulp_app_worker"."id",
"pulp_app_worker"."created",
"pulp_app_worker"."last_updated",
"pulp_app_worker"."name",
"pulp_app_worker"."last_heartbeat",
"pulp_app_worker"."gracefully_stopped",
"pulp_app_worker"."cleaned_up"
FROM "pulp_app_worker"
WHERE ("pulp_app_worker"."gracefully_stopped" = FALSE
AND "pulp_app_worker"."last_heartbeat" >= 2018-05-22 15:42:25.810284+00:00)) INTERSECT
(SELECT "pulp_app_worker"."id",
"pulp_app_worker"."created",
"pulp_app_worker"."last_updated",
"pulp_app_worker"."name",
"pulp_app_worker"."last_heartbeat",
"pulp_app_worker"."gracefully_stopped",
"pulp_app_worker"."cleaned_up"
FROM "pulp_app_worker"
WHERE "pulp_app_worker"."name" = resource_manager@pulp3.dev)
</code></pre>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28374
2018-05-22T17:43:18Z
dalley
dalley@redhat.com
<ul><li><strong>Status</strong> changed from <i>POST</i> to <i>MODIFIED</i></li></ul><p>Applied in changeset <a class="changeset" title="Fix indeterministic worker filtering closes #3586 https://pulp.plan.io/issues/3586" href="https://pulp.plan.io/projects/pulp/repository/pulp/revisions/d62bf5a292bd552d509491f6e7013ac180a26b8b">pulp|d62bf5a292bd552d509491f6e7013ac180a26b8b</a>.</p>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28424
2018-05-24T14:17:40Z
bizhang
bizhang@redhat.com
<ul><li><strong>Status</strong> changed from <i>MODIFIED</i> to <i>ASSIGNED</i></li></ul><p>It looks like this issue is still popping up in the current travis tests</p>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28483
2018-05-30T13:22:18Z
Ichimonji10
jerebear@protonmail.com
<ul><li><strong>Subject</strong> changed from <i>Filtering workers is indetermanistic</i> to <i>Filtering workers is indeterministic</i></li></ul>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28601
2018-06-01T21:12:04Z
rchan
<ul><li><strong>Sprint</strong> changed from <i>Sprint 37</i> to <i>Sprint 38</i></li></ul>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=28858
2018-06-15T13:23:43Z
dalley
dalley@redhat.com
<ul><li><strong>Status</strong> changed from <i>ASSIGNED</i> to <i>MODIFIED</i></li></ul><p>I can't reproduce this anymore locally, despite an awful lot of trying. Going to close it out and re-enable the tests.</p>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=42545
2019-04-26T20:35:43Z
bmbouter
bmbouter@redhat.com
<ul><li><strong>Tags</strong> deleted (<del><i>Pulp 3</i></del>)</li></ul>
Pulp - Issue #3586: Filtering workers is indeterministic
https://pulp.plan.io/issues/3586?journal_id=51073
2019-12-13T17:30:07Z
bmbouter
bmbouter@redhat.com
<ul><li><strong>Status</strong> changed from <i>MODIFIED</i> to <i>CLOSED - CURRENTRELEASE</i></li></ul>