Task #4450
closedremove pulp-manager
Added by bmbouter over 5 years ago. Updated almost 5 years ago.
100%
Description
What is pulp-manager¶
It's a thin wrapper around django-admin. It's a Python entry point that points to: https://github.com/pulp/pulp/blob/master/pulpcore/app/entry_points.py
Problem¶
It's a wrapper around django-admin so we could just expose django-admin directly. Users who use django-admin know that they have to have it configured correctly. There are huge amounts of docs on how to do that.
We provide it like a binary that should "just work", but if you don't have the python environment activated or Pulp installed systemwide it won't.
With pulp-manager we hide all that from the user. The theme of our pulp3 usage was to get out of the way between the user and Django. This is one place where we are putting something we built in between the user and Django.
Consider how this affects the user experience for migrations. Currently the user would use pulp-manager, but they probably should use django-admin since migrate is a Django's command. It's not a Pulp command so putting it under pulp-manager is confusing.
Also pulp-manager looses autocompletion so it's already not as great as django-admin.
Solution¶
Remove pulp-manager altogether and just use django-admin. Pulp is a Django site after all.
Related issues
Updated by CodeHeeler over 5 years ago
- Tracker changed from Issue to Task
- Subject changed from pulp-manager autocomplete doesn't work to remove pulp-manager
- % Done set to 0
Updated by amacdona@redhat.com over 5 years ago
From the perspective of the user, I think that people will be using pulp who don't know much about django. I like that we "own" the interface that they should use.
Updated by bmbouter over 5 years ago
I rewrote the description just now with a clearer case for its removal versus it being an autocomplete issue.
Updated by amacdona@redhat.com over 5 years ago
bmbouter, there was some conversation around using pulp-manager to execute some of the functions in our developer aliases.
prestart (stop, start) pjournal, to name a few. This seems like something that would be useful to expose to users, but something that falls outside the scope of what django-admin would be expected to do. I'm not sold that its appropriate to do this for pulp-manager, but it does seem like it at least has the potential to be nice.
Can you confirm that what we added to pulp-manager (reset-admin-password) is also added to django-admin?
Updated by bmbouter over 5 years ago
amacdona@redhat.com wrote:
Can you confirm that what we added to pulp-manager (reset-admin-password) is also added to django-admin?
Yes when I run django-admin
I can see these commands listed.
(pulp) [vagrant@pulp3-source-fedora28 pulp_rpm]$ django-admin
/usr/local/lib/pulp/lib64/python3.6/site-packages/psycopg2/__init__.py:144: UserWarning: The psycopg2 wheel package will be renamed from release 2.8; in order to keep installing from binary please use "pip insta
ll psycopg2-binary" instead. For details see: <http://initd.org/psycopg/docs/install.html#binary-install-from-pypi>.
""")
Type 'django-admin help <subcommand>' for help on a specific subcommand.
Available subcommands:
[app]
reset-admin-password
stage-profile-summary
[auth]
changepassword
createsuperuser
Updated by ipanova@redhat.com over 5 years ago
FYI
django-admin uses setting from 'pulpcore.app.settings'
and this leads to the traceback
Django version 2.1.7, using settings 'pulpcore.app.settings'
Starting development server at http://127.0.0.1:8000/
Quit the server with CONTROL-C.
pulp: django.request:ERROR: Internal Server Error: /pulp/api/v3/remotes/docker/docker/1/sync/
Traceback (most recent call last):
File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/django/core/handlers/exception.py", line 34, in inner
response = get_response(request)
File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/django/core/handlers/base.py", line 126, in _get_response
response = self.process_exception_by_middleware(e, request)
File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/django/core/handlers/base.py", line 124, in _get_response
response = wrapped_callback(request, *callback_args, **callback_kwargs)
File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/django/views/decorators/csrf.py", line 54, in wrapped_view
return view_func(*args, **kwargs)
File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/rest_framework/viewsets.py", line 116, in view
return self.dispatch(request, *args, **kwargs)
File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/rest_framework/views.py", line 495, in dispatch
response = self.handle_exception(exc)
File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/rest_framework/views.py", line 455, in handle_exception
self.raise_uncaught_exception(exc)
File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/rest_framework/views.py", line 492, in dispatch
response = handler(request, *args, **kwargs)
File "/home/vagrant/devel/pulp_docker/pulp_docker/app/viewsets.py", line 145, in sync
'repository_pk': repository.pk
File "/home/vagrant/devel/pulp/pulpcore/tasking/tasks.py", line 194, in enqueue_with_reservation
redis_conn = connection.get_redis_connection()
File "/home/vagrant/devel/pulp/pulpcore/tasking/connection.py", line 11, in get_redis_connection
_conn = get_redis_from_config(settings)
File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/rq/cli/helpers.py", line 39, in get_redis_from_config
if settings.get('REDIS_URL') is not None:
File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/django/conf/__init__.py", line 58, in __getattr__
val = getattr(self._wrapped, name)
AttributeError: 'Settings' object has no attribute 'get'
[26/Feb/2019 13:46:31] "POST /pulp/api/v3/remotes/docker/docker/1/sync/ HTTP/1.1" 500 27
meanwhile pulp-manager uses /etc/pulp/settings.py and all is fine :)
Updated by bmbouter over 5 years ago
pulp-manager handles the setting of DJANGO_SETTINGS_MODULE
for the user in a way that django-admin does not automatically handle. We have no docs on this configuration requirement, so I'm not surprised you're hitting that error when using django-admin. This highlights my main concern actually; pulp-manager
is taking action for the user but is lacking in documentation and functionality (autocomplete).
Either way, we need to document that Pulp's settings file is at pulpcore.app.settings
and that users need to set DJANGO_SETTINGS_MODULE
with something like: export DJANGO_SETTINGS_MODULE=pulpcore.app.settings
. We should also link to the Django docs they have on it: https://docs.djangoproject.com/en/2.1/topics/settings/#designating-the-settings If you export this and run django-admin
then it'll work for you.
I'm open to keeping pulp-manager, but I need some convincing that it's doing more good than harm. Also is the effort to write/maintain a bunch of docs and fix the tooling to go in-between Django and Pulp's users worth it? It's a pretty big responsibility that Django is already 100% committed to in terms of docs and support.
Note also pulp-manager isn't using "/etc/pulp/server.conf". It's using pulp.app.settings which is what is referencing /etc/pulp/server.conf. A correctly configured django-settings is identical to this so it also uses /etc/pulp/server.conf.
Updated by dkliban@redhat.com over 5 years ago
- Status changed from NEW to ASSIGNED
- Assignee set to dkliban@redhat.com
Added by dkliban@redhat.com over 5 years ago
Updated by dkliban@redhat.com over 5 years ago
I am changing how we integrate with DynaConf so that django-admin is able to properly load the settings. This is the suggested solution from the dynaconf issue we filed during our initial integration.
https://github.com/rochacbruno/dynaconf/issues/89#issuecomment-449421777
Added by dkliban@redhat.com over 5 years ago
Revision 494f0964 | View on GitHub
Problem: DynaConf integration requires modifying entry points
Solution: load DynaConf settings directly in the pulpcore.app.settings
Added by dkliban@redhat.com over 5 years ago
Revision ecf45bbc | View on GitHub
Problem: pulp-manager is not needed
Solution: remove pulp-manager and update docs
This patch removes pulp-manager wrapper for django-admin. It also updates all the docs with references to django-admin directly.
Added by dkliban@redhat.com over 5 years ago
Revision 2c07be45 | View on GitHub
Problem: pulp-manager is not needed
Solution: use django-admin directly
Added by dkliban@redhat.com over 5 years ago
Revision 2c07be45 | View on GitHub
Problem: pulp-manager is not needed
Solution: use django-admin directly
Added by dkliban@redhat.com over 5 years ago
Revision 2c07be45 | View on GitHub
Problem: pulp-manager is not needed
Solution: use django-admin directly
Added by dkliban@redhat.com over 5 years ago
Revision 2c07be45 | View on GitHub
Problem: pulp-manager is not needed
Solution: use django-admin directly
Added by dkliban@redhat.com over 5 years ago
Revision e1e5d04b | View on GitHub
Problem: installer depends on non-existing pulp-manager
Solution: use django-admin directly
This patch updates the installer to use djang-admin binary instead of pulp-manager.
Added by daviddavis over 5 years ago
Revision d78f77e7 | View on GitHub
Remove calls to pulp-manager
refs #4450
Added by daviddavis over 5 years ago
Revision f5c415c0 | View on GitHub
Remove calls to pulp-manager
fixes #4450
Added by mdellweg over 5 years ago
Revision 6a7bef2b | View on GitHub
Replace use of pulp-manager with django-admin
Added by dkliban@redhat.com over 5 years ago
Revision 4458958a | View on GitHub
Problem: installer depends on non-existing pulp-manager
Solution: use django-admin directly
This patch updates the installer to use djang-admin binary instead of pulp-manager.
Added by dkliban@redhat.com over 5 years ago
Revision 31ab0f92 | View on GitHub
Problem: installer depends on non-existing pulp-manager
Solution: use django-admin directly
This patch updates the installer to use djang-admin binary instead of pulp-manager.
Added by dkliban@redhat.com over 5 years ago
Revision 31ab0f92 | View on GitHub
Problem: installer depends on non-existing pulp-manager
Solution: use django-admin directly
This patch updates the installer to use djang-admin binary instead of pulp-manager.
Updated by amacdona@redhat.com over 5 years ago
- Blocks Issue #4545: pulp fails to install on centos7 added
Updated by dkliban@redhat.com over 5 years ago
- Status changed from ASSIGNED to POST
Added by dkliban@redhat.com over 5 years ago
Revision a29db8a7 | View on GitHub
Adds environment variable needed for django-admin
Added by dkliban@redhat.com over 5 years ago
Revision 793226fc | View on GitHub
Problem: docs don't mention DJANGO_SETTINGS_MODULE
Solution: update the docs
Updated by daviddavis over 5 years ago
- Status changed from POST to MODIFIED
- % Done changed from 0 to 100
Applied in changeset pulp_rpm:f5c415c0cf7b0a497c4bd8670ef2830dcae92bca.
Added by CodeHeeler over 5 years ago
Revision 638de805 | View on GitHub
Remove pulp-manager and return to django-admin
pulp-manager is not needed, use django-admin directly
Updated by bmbouter almost 5 years ago
- Status changed from MODIFIED to CLOSED - CURRENTRELEASE
Problem: pulp-manager is not needed
Solution: use django-admin directly
re: #4450 https://pulp.plan.io/issues/4450