Project

Profile

Help

Pulp 3 Developer Notes » History » Sprint/Milestone 8

bizhang, 06/06/2017 03:41 PM

1 1 semyers
# Pulp 3 Developer Notes
2
3
This wiki page is intended for use during early development of Pulp 3. Over time, as our development practices become standard, the contents of this page should be moved into the [Pulp Contributing Guide](https://docs.pulpproject.org/en/3.0/nightly/contributing/index.html)
4
5 5 semyers
Before reporting issues with the development environment, please ensure that you are using the latest version.
6 4 semyers
7 1 semyers
## Migrations
8
9
In both platform and plugins, the data model is not complete. As a result, committing migrations to the 3.0-dev branch will result in merge/migration conflicts from pull request to pull request. The simplest solution for now is not to commit migrations to the repository.
10
11
Because User model depends on Django's auth app having been migrated, this means that you currently need to run `python manage.py migrate auth` before running a general `python manage.py migrate` to set up the pulp database.
12
13
### Making migrations during development
14
15
Tests require migrations to run, so while we should not *commit* migrations to the repositories just yet, we do still need to *make* them. This can be done with the `python manage.py makemigrations` command. Apps that depend on the platform migrations existing (such as plugins) may cause errors when making migrations. To avoid these errors, platform migrations should be made prior to installing any plugins.
16
17
Once the initial migrations are created, and model changes made thereafter will require `python manage.py makemigrations` to be run again, following by @python manage.py migrate" so Django can apply the model changes to the database.
18
19 6 amacdona@redhat.com
If you are using the vagrant environment this is done during provisioning. The `pclean` alias takes care of migrations after resting the db.
20 1 semyers
21
## Starting a Web Server
22
23
The Django development server can be started with `python manage.py runserver`. This will run a basic WSGI app that exposes the URLs routed in `urls.py`, allowing you to access the REST API.
24
25
If you're using the vagrant [hostmanager](https://rubygems.org/gems/vagrant-hostmanager) plugin, you can easily access the API from the host machine by explicitly binding the web server to all interfaces, e.g. `python manage.py runserver 0.0.0.0:8000`. This should make the API browseable at http://dev.example.com:8000/api/v3/
26
27
### Authentication
28
29 6 amacdona@redhat.com
We currently enable Basic HTTP Authentication on the REST API. This can be temporarily disabled by commenting out the `'DEFAULT_PERMISSION_CLASSES': ('rest_framework.permissions.IsAuthenticated',)` line in the `REST_FRAMEWORK` section in `app/pulp/app/settings.py`. Note that this doesn't disable authentication, it just authorizes unauthenticated users to take any action. Basic Authentication should still work.
30 2 bizhang
31 6 amacdona@redhat.com
## Tasks
32 1 semyers
33 6 amacdona@redhat.com
### Starting Services
34 1 semyers
35 6 amacdona@redhat.com
If using the vagrant environment, you can start the services with the alias `pstart`. Afterwards, use `prestart`.
36
37
To start the processes manually, if you are using a virtual environment, be sure that the path to celery matches the virtual environment that includes pulp, any plugins, and pulp dependencies.
38
39 2 bizhang
~~~
40
sudo -u apache /usr/bin/celery beat --app=pulp.tasking.celery_app:celery --scheduler=pulp.tasking.services.scheduler.Scheduler -l=INFO --pidfile=/var/run/pulp/scheduler.pid
41
42
sudo -u apache /usr/bin/celery worker -A pulp.tasking.celery_app:celery -n resource_manager@%%h\
43
            -Q resource_manager -c 1 --events --umask 18 --pidfile=/var/run/pulp/resource_manager.pid\
44
            --heartbeat-interval=5 -l=INFO
45
46
sudo -u apache /usr/bin/celery worker -n reserved_resource_worker-123s@h\
47
          -A pulp.tasking.celery_app:celery -c 1 --events --umask 18\
48 1 semyers
          --pidfile=/var/run/pulp/reserved_resource_worker-123s.pid\
49
          --heartbeat-interval=5 -l=INFO
50 2 bizhang
~~~
51
52 6 amacdona@redhat.com
### Deploy tasks from shell
53
54 2 bizhang
apply_async and apply_async_with_reservation tasks can be tested from a django shell `python manage.py shell_plus` I usually do the following to test tasks
55
56
~~~
57
from pulp.app.tasks import repository
58
from pulp.app.models import Repository
59
import uuid
60
repo_uuid=str(uuid.uuid4())
61
repo=Repository(name=repo_uuid)
62
repo.save()
63 1 semyers
64
repository.delete.apply_async(kwargs={'repo_name':repo_uuid})
65
repository.delete.apply_async_with_reservation("foo","bar",kwargs={'repo_name':repo_uuid})
66
~~~
67 6 amacdona@redhat.com
68
### Deploy sync task from REST API
69
70
1\. Make sure that you have the file plugin installed with a developer setup.  
71
2\. Define a `sync` method on the `FileImporter` model.  
72
3\. Create a repository on the browseable api:  
73
http://dev.example.com:8000/api/v3/repositories/  
74
4\. Create an importer. Note, you must specify the plugin in the URL.  
75
http://dev.example.com:8000/api/v3/importers/file/  
76
5\. Sync at the importer's url http://dev.example.com:8000/api/v3/importers/file/<uuid>/sync
77 7 bizhang
78
## PyPI
79
80
### Publishing to PyPI
81
82 8 bizhang
`python setup.py sdist bdist_wheel --python-tag py3`  
83 7 bizhang
`twine upload -s dist/{package}*`
84
85
### Installing from PyPI
86
87
`pip3 install pulpcore`  
88
`export DJANGO_SETTINGS_MODULE=pulpcore.app.settings`  
89
*set up database and migrations*  
90
`django-admin runserver`