Project

Profile

Help

Task #4450

closed

remove pulp-manager

Added by bmbouter over 5 years ago. Updated almost 5 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Category:
-
Sprint/Milestone:
Start date:
Due date:
% Done:

100%

Estimated time:
Platform Release:
Groomed:
No
Sprint Candidate:
Yes
Tags:
Sprint:
Sprint 50
Quarter:

Description

What is pulp-manager

It's a thin wrapper around django-admin. It's a Python entry point that points to: https://github.com/pulp/pulp/blob/master/pulpcore/app/entry_points.py

Problem

It's a wrapper around django-admin so we could just expose django-admin directly. Users who use django-admin know that they have to have it configured correctly. There are huge amounts of docs on how to do that.

We provide it like a binary that should "just work", but if you don't have the python environment activated or Pulp installed systemwide it won't.

With pulp-manager we hide all that from the user. The theme of our pulp3 usage was to get out of the way between the user and Django. This is one place where we are putting something we built in between the user and Django.

Consider how this affects the user experience for migrations. Currently the user would use pulp-manager, but they probably should use django-admin since migrate is a Django's command. It's not a Pulp command so putting it under pulp-manager is confusing.

Also pulp-manager looses autocompletion so it's already not as great as django-admin.

Solution

Remove pulp-manager altogether and just use django-admin. Pulp is a Django site after all.


Related issues

Blocks Pulp - Issue #4545: pulp fails to install on centos7CLOSED - CURRENTRELEASEamacdona@redhat.comActions
Actions #1

Updated by CodeHeeler over 5 years ago

  • Tracker changed from Issue to Task
  • Subject changed from pulp-manager autocomplete doesn't work to remove pulp-manager
  • % Done set to 0
Actions #2

Updated by amacdona@redhat.com over 5 years ago

From the perspective of the user, I think that people will be using pulp who don't know much about django. I like that we "own" the interface that they should use.

Actions #3

Updated by amacdona@redhat.com over 5 years ago

  • Tags Pulp 3 RC Blocker added
Actions #4

Updated by bmbouter over 5 years ago

  • Description updated (diff)
Actions #5

Updated by bmbouter over 5 years ago

I rewrote the description just now with a clearer case for its removal versus it being an autocomplete issue.

Actions #6

Updated by amacdona@redhat.com over 5 years ago

bmbouter, there was some conversation around using pulp-manager to execute some of the functions in our developer aliases.

prestart (stop, start) pjournal, to name a few. This seems like something that would be useful to expose to users, but something that falls outside the scope of what django-admin would be expected to do. I'm not sold that its appropriate to do this for pulp-manager, but it does seem like it at least has the potential to be nice.

Can you confirm that what we added to pulp-manager (reset-admin-password) is also added to django-admin?

Actions #7

Updated by bmbouter over 5 years ago

wrote:

Can you confirm that what we added to pulp-manager (reset-admin-password) is also added to django-admin?

Yes when I run django-admin I can see these commands listed.

(pulp) [vagrant@pulp3-source-fedora28 pulp_rpm]$ django-admin
/usr/local/lib/pulp/lib64/python3.6/site-packages/psycopg2/__init__.py:144: UserWarning: The psycopg2 wheel package will be renamed from release 2.8; in order to keep installing from binary please use "pip insta
ll psycopg2-binary" instead. For details see: <http://initd.org/psycopg/docs/install.html#binary-install-from-pypi>.
  """)

Type 'django-admin help <subcommand>' for help on a specific subcommand.

Available subcommands:

[app]
    reset-admin-password
    stage-profile-summary

[auth]
    changepassword
    createsuperuser
Actions #8

Updated by ipanova@redhat.com over 5 years ago

FYI
django-admin uses setting from 'pulpcore.app.settings'
and this leads to the traceback

Django version 2.1.7, using settings 'pulpcore.app.settings'
Starting development server at http://127.0.0.1:8000/
Quit the server with CONTROL-C.

pulp: django.request:ERROR: Internal Server Error: /pulp/api/v3/remotes/docker/docker/1/sync/
Traceback (most recent call last):
  File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/django/core/handlers/exception.py", line 34, in inner
    response = get_response(request)
  File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/django/core/handlers/base.py", line 126, in _get_response
    response = self.process_exception_by_middleware(e, request)
  File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/django/core/handlers/base.py", line 124, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/django/views/decorators/csrf.py", line 54, in wrapped_view
    return view_func(*args, **kwargs)
  File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/rest_framework/viewsets.py", line 116, in view
    return self.dispatch(request, *args, **kwargs)
  File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/rest_framework/views.py", line 495, in dispatch
    response = self.handle_exception(exc)
  File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/rest_framework/views.py", line 455, in handle_exception
    self.raise_uncaught_exception(exc)
  File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/rest_framework/views.py", line 492, in dispatch
    response = handler(request, *args, **kwargs)
  File "/home/vagrant/devel/pulp_docker/pulp_docker/app/viewsets.py", line 145, in sync
    'repository_pk': repository.pk
  File "/home/vagrant/devel/pulp/pulpcore/tasking/tasks.py", line 194, in enqueue_with_reservation
    redis_conn = connection.get_redis_connection()
  File "/home/vagrant/devel/pulp/pulpcore/tasking/connection.py", line 11, in get_redis_connection
    _conn = get_redis_from_config(settings)
  File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/rq/cli/helpers.py", line 39, in get_redis_from_config
    if settings.get('REDIS_URL') is not None:
  File "/home/vagrant/.virtualenvs/pulp/lib64/python3.7/site-packages/django/conf/__init__.py", line 58, in __getattr__
    val = getattr(self._wrapped, name)
AttributeError: 'Settings' object has no attribute 'get'
[26/Feb/2019 13:46:31] "POST /pulp/api/v3/remotes/docker/docker/1/sync/ HTTP/1.1" 500 27

meanwhile pulp-manager uses /etc/pulp/settings.py and all is fine :)

Actions #9

Updated by bmbouter over 5 years ago

pulp-manager handles the setting of DJANGO_SETTINGS_MODULE for the user in a way that django-admin does not automatically handle. We have no docs on this configuration requirement, so I'm not surprised you're hitting that error when using django-admin. This highlights my main concern actually; pulp-manager is taking action for the user but is lacking in documentation and functionality (autocomplete).

Either way, we need to document that Pulp's settings file is at pulpcore.app.settings and that users need to set DJANGO_SETTINGS_MODULE with something like: export DJANGO_SETTINGS_MODULE=pulpcore.app.settings. We should also link to the Django docs they have on it: https://docs.djangoproject.com/en/2.1/topics/settings/#designating-the-settings If you export this and run django-admin then it'll work for you.

I'm open to keeping pulp-manager, but I need some convincing that it's doing more good than harm. Also is the effort to write/maintain a bunch of docs and fix the tooling to go in-between Django and Pulp's users worth it? It's a pretty big responsibility that Django is already 100% committed to in terms of docs and support.

Note also pulp-manager isn't using "/etc/pulp/server.conf". It's using pulp.app.settings which is what is referencing /etc/pulp/server.conf. A correctly configured django-settings is identical to this so it also uses /etc/pulp/server.conf.

Actions #10

Updated by daviddavis over 5 years ago

  • Sprint set to Sprint 49
Actions #11

Updated by rchan over 5 years ago

  • Sprint changed from Sprint 49 to Sprint 50
Actions #12

Updated by dkliban@redhat.com over 5 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to dkliban@redhat.com

Added by dkliban@redhat.com over 5 years ago

Revision 1d9c697c | View on GitHub

Problem: pulp-manager is not needed

Solution: use django-admin directly

re: #4450 https://pulp.plan.io/issues/4450

Actions #13

Updated by dkliban@redhat.com over 5 years ago

I am changing how we integrate with DynaConf so that django-admin is able to properly load the settings. This is the suggested solution from the dynaconf issue we filed during our initial integration.

https://github.com/rochacbruno/dynaconf/issues/89#issuecomment-449421777

Added by dkliban@redhat.com over 5 years ago

Revision 494f0964 | View on GitHub

Problem: DynaConf integration requires modifying entry points

Solution: load DynaConf settings directly in the pulpcore.app.settings

re: #4450 https://pulp.plan.io/issues/4450

Added by dkliban@redhat.com over 5 years ago

Revision ecf45bbc | View on GitHub

Problem: pulp-manager is not needed

Solution: remove pulp-manager and update docs

This patch removes pulp-manager wrapper for django-admin. It also updates all the docs with references to django-admin directly.

re: #4450 https://pulp.plan.io/issues/4450

Added by dkliban@redhat.com over 5 years ago

Revision 2c07be45 | View on GitHub

Problem: pulp-manager is not needed

Solution: use django-admin directly

re: #4450 https://pulp.plan.io/issues/4450

Added by dkliban@redhat.com over 5 years ago

Revision 2c07be45 | View on GitHub

Problem: pulp-manager is not needed

Solution: use django-admin directly

re: #4450 https://pulp.plan.io/issues/4450

Added by dkliban@redhat.com over 5 years ago

Revision 2c07be45 | View on GitHub

Problem: pulp-manager is not needed

Solution: use django-admin directly

re: #4450 https://pulp.plan.io/issues/4450

Added by dkliban@redhat.com over 5 years ago

Revision 2c07be45 | View on GitHub

Problem: pulp-manager is not needed

Solution: use django-admin directly

re: #4450 https://pulp.plan.io/issues/4450

Added by dkliban@redhat.com over 5 years ago

Revision e1e5d04b | View on GitHub

Problem: installer depends on non-existing pulp-manager

Solution: use django-admin directly

This patch updates the installer to use djang-admin binary instead of pulp-manager.

re: #4450 https://pulp.plan.io/issues/4450

Added by daviddavis over 5 years ago

Revision d78f77e7 | View on GitHub

Remove calls to pulp-manager

refs #4450

Added by daviddavis over 5 years ago

Revision f5c415c0 | View on GitHub

Remove calls to pulp-manager

fixes #4450

Added by mdellweg over 5 years ago

Revision 6a7bef2b | View on GitHub

Replace use of pulp-manager with django-admin

re: #4450 https://pulp.plan.io/issues/4450

Added by dkliban@redhat.com over 5 years ago

Revision 4458958a | View on GitHub

Problem: installer depends on non-existing pulp-manager

Solution: use django-admin directly

This patch updates the installer to use djang-admin binary instead of pulp-manager.

re: #4450 https://pulp.plan.io/issues/4450

Added by dkliban@redhat.com over 5 years ago

Revision 31ab0f92 | View on GitHub

Problem: installer depends on non-existing pulp-manager

Solution: use django-admin directly

This patch updates the installer to use djang-admin binary instead of pulp-manager.

re: #4450 https://pulp.plan.io/issues/4450

Added by dkliban@redhat.com over 5 years ago

Revision 31ab0f92 | View on GitHub

Problem: installer depends on non-existing pulp-manager

Solution: use django-admin directly

This patch updates the installer to use djang-admin binary instead of pulp-manager.

re: #4450 https://pulp.plan.io/issues/4450

Actions #14

Updated by amacdona@redhat.com over 5 years ago

  • Blocks Issue #4545: pulp fails to install on centos7 added

Added by dkliban@redhat.com over 5 years ago

Revision a29db8a7 | View on GitHub

Adds environment variable needed for django-admin

re: #4450 https://pulp.plan.io/issues/4450

Added by dkliban@redhat.com over 5 years ago

Revision 793226fc | View on GitHub

Problem: docs don't mention DJANGO_SETTINGS_MODULE

Solution: update the docs

re: #4450 https://pulp.plan.io/issues/4450

Actions #16

Updated by daviddavis over 5 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100

Added by CodeHeeler over 5 years ago

Revision 638de805 | View on GitHub

Remove pulp-manager and return to django-admin

pulp-manager is not needed, use django-admin directly

re: #4450 https://pulp.plan.io/issues/4450

Actions #17

Updated by daviddavis over 5 years ago

  • Sprint/Milestone set to 3.0.0
Actions #18

Updated by bmbouter over 5 years ago

  • Tags deleted (Pulp 3, Pulp 3 RC Blocker)
Actions #19

Updated by bmbouter almost 5 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

Also available in: Atom PDF