Project

Profile

Help

Task #2479

closed

Update systemd tasking service files to use new Pulp 3 locations

Added by semyers over 7 years ago. Updated over 4 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Assignee:
Category:
-
Sprint/Milestone:
Start date:
Due date:
% Done:

100%

Estimated time:
Platform Release:
Groomed:
Yes
Sprint Candidate:
Yes
Tags:
Sprint:
Sprint 18
Quarter:

Description

Now that the tasking system is up and running, we'd like to get those services working automatically via systemd. In order to do that, we should take the existing systemd unit files and update them to use the new paths.

Here are the unit files related to the tasking system in pulp 2:
https://github.com/pulp/pulp/tree/3.0-dev/server/usr/lib/systemd/system

The reserved resource worker service files are created by the manage_workers script:
https://github.com/pulp/pulp/tree/3.0-dev/server/pulp/server/async/manage_workers.py

Here are the current updated app invocations in Pulp 3, which hopefully won't change before we start this task:

# celery beat
/usr/bin/celery beat -A pulp.tasking.celery_instance.celery -S pulp.tasking.services.scheduler.Scheduler

# resource manager worker
/usr/bin/celery worker -A pulp.tasking.celery_app -n resource_manager@<i> -Q resource_manager -c 1 --events --umask 18 --pidfile=/var/run/pulp/resource_manager.pid --heartbeat-interval=30

# reserved resource workers
/usr/bin/celery worker -n reserved_resource_worker-<i>@<hostname> -A pulp.tasking.celery_app:celery -c 1 --events --umask 18 --pidfile /var/run/pulp/reserved_resource_worker-<i>.pid --heartbeat-interval=30

Systemd provides an "instancing" mechanism that we could potentially use for the reserved resource workers, if we'd like get away from using the "manage_workers" script, documented here:
https://www.freedesktop.org/software/systemd/man/systemd.unit.html (look for getty.service@ and the meaning of the %i expansion in unit files)

Once these unit files are in place, the ansible dev playbook will need to be updated to install these unit files and start/stop these services using the aliases defined in its .bashrc file.


Related issues

Blocked by Pulp - Task #2413: Fix dev environment setup for Pulp 3.0CLOSED - CURRENTRELEASEsemyers

Actions
Actions #1

Updated by semyers over 7 years ago

  • Description updated (diff)

Some of the work has already been done on 3.0-dev, so I think this task is mainly about getting the service files into the right place and making the dev playbook use them correctly.

Actions #2

Updated by dkliban@redhat.com over 7 years ago

  • Groomed changed from No to Yes
  • Sprint Candidate changed from No to Yes
Actions #3

Updated by semyers over 7 years ago

  • Blocked by Task #2413: Fix dev environment setup for Pulp 3.0 added
Actions #4

Updated by mhrivnak almost 7 years ago

  • Priority changed from Normal to High
Actions #5

Updated by mhrivnak almost 7 years ago

  • Sprint/Milestone set to 37
Actions #6

Updated by fdobrovo almost 7 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to fdobrovo
Actions #7

Updated by dalley almost 7 years ago

I just want to note that the app invocations have, indeed, changed. Make sure to use the form of the ones in the current tree instead of the ones described in this issue. I believe the only difference is that the heartbeat interval is no longer specified.

re: "Here are the current updated app invocations in Pulp 3, which hopefully won't change before we start this task:"

Actions #8

Updated by bmbouter almost 7 years ago

I believe the --heartbeat-interval options should all be removed

Actions #9

Updated by fdobrovo almost 7 years ago

Yeah I think I have seen it removed from the current systemd files. Also one thing that came into my mind and I don't know how to solve it. It would be nice to specify requirements, such as when starting the worker ensure that the broker is started or resource manager is running. But I'm thinking in our dev environment we may want to not run such things.

Actions #10

Updated by bmbouter almost 7 years ago

We can't add those unit file dependencies because any installation could be a clustered installation and we wouldn't want a broker started on each machine for example.

Actions #12

Updated by bmbouter almost 7 years ago

With a PR available this should be at POST unless there are other PRs that still need to be made.

Actions #13

Updated by fdobrovo almost 7 years ago

It's waiting for pulp/devel PR.

Actions #14

Updated by fdobrovo almost 7 years ago

  • Status changed from ASSIGNED to POST

Added by fdobrovo almost 7 years ago

Revision 24714937 | View on GitHub

Update systemd tasking service files

closes #2479 https://pulp.plan.io/issues/2479

Added by fdobrovo almost 7 years ago

Revision 24714937 | View on GitHub

Update systemd tasking service files

closes #2479 https://pulp.plan.io/issues/2479

Actions #15

Updated by fdobrovo almost 7 years ago

As dalley pointed out pulp-dev.py already installs the systemd files is it used during vagrant up?

Added by fdobrovo almost 7 years ago

Revision 1f981a75 | View on GitHub

Ansible deploy pulp3 systemd services

re #2479 https://pulp.plan.io/issues/2479

Actions #16

Updated by fdobrovo almost 7 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100
Actions #17

Updated by bmbouter about 6 years ago

  • Sprint set to Sprint 18
Actions #18

Updated by bmbouter about 6 years ago

  • Sprint/Milestone deleted (37)
Actions #19

Updated by daviddavis almost 5 years ago

  • Sprint/Milestone set to 3.0.0
Actions #20

Updated by bmbouter almost 5 years ago

  • Tags deleted (Pulp 3)
Actions #21

Updated by bmbouter over 4 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

Also available in: Atom PDF