Story #282
closedAs a user, I have docs on how to cluster Pulp with NFS for httpd and worker scaling purposes
100%
Description
The scaling guide needs improvement to describe in more detail how to configure Pulp into a cluster for the purposes of scaling both httpd and pulp workers.
Deliverables:
0. Setup and test a Pulp clustered operation to know what is needed with a clustered installation
1. Document the requirements for an NFS clustered Pulp installation.
2. Revert/rewrite https://github.com/pulp/pulp/pull/1097/files since we and QE will have tested it
3. Make sure the docs work with SELinux (see below)
4. Add a release note about this change.
SELinux and NFS issues:
This documentation needs to describe a fix for running with SELinux
For Pulp to correctly operate, it expects the that /var/lib/pulp/* will have httpd_sys_rw_content_t file context. If you want to make /var/lib/pulp/ or some subdirectory of it hosted via NFS those files will receive the nfs_t label. This causes Pulp to not work correctly if you want to scale the /var/lib/pulp filesystem with NFS and be secure with SELinux in Enforcing.
The recommended way to fix this is by making NFS aware of the SELinux context to use when mounting /var/lib/pulp/ or a subsection of it using the context option on mount.
# mount -o context="system_u:object_r:httpd_sys_rw_content_t:s0" REMOTEHOST:/var/lib/pulp /var/lib/pulp
Updated by bmbouter almost 10 years ago
- Category deleted (
1) - Tags Documentation added
Documentation is now a Tag not a Category.
Updated by bmbouter over 9 years ago
- Subject changed from [RFE] Provide a way to move pulp content to NFS share with SELinux turned on to Provide a way to move pulp content to NFS share with SELinux turned on
- Description updated (diff)
- Private changed from Yes to No
- Tags Sprint Candidate added
Updated by bmbouter over 9 years ago
- Subject changed from Provide a way to move pulp content to NFS share with SELinux turned on to As a user, I can host /var/lib/pulp on an NFS share with SELinux turned on
- Description updated (diff)
Updated by bmbouter over 9 years ago
- Status changed from NEW to ASSIGNED
- Assignee set to bmbouter
Updated by bmbouter over 9 years ago
- Subject changed from As a user, I can host /var/lib/pulp on an NFS share with SELinux turned on to As a user, I have docs on how to cluster Pulp with NFS for httpd and worker scaling purposes
- Description updated (diff)
Updated by bmbouter over 9 years ago
PR available at: https://github.com/pulp/pulp/pull/1781
Added by bmbouter over 9 years ago
Added by bmbouter over 9 years ago
Revision e2a60d71 | View on GitHub
Adds a clustering requirements docs and a release note
closes #282
Updated by bmbouter over 9 years ago
- Status changed from ASSIGNED to MODIFIED
- % Done changed from 0 to 100
Applied in changeset pulp|e2a60d71d59c184afd9ceb8b496f9f21c7fe2441.
Updated by bmbouter over 9 years ago
- Status changed from MODIFIED to 5
- Platform Release set to 2.6.1
Updated by bmbouter over 9 years ago
QE, you can see the rendered clustering guide here: http://pulp.readthedocs.org/en/2.6-testing/user-guide/scaling.html#clustering-pulp
Updated by bmbouter over 9 years ago
For testing this setup a three node pulp-server with NFS sharing as described. You'll also need a separate consumer machine since clustered nodes can't be used as registered consumers themselves. You should use an HA proxy as the loadbalancer on also a separate machine. You can run Qpid and mongoDB on any of these machines. Run pulp_workers and httpd on all 3 of the clustered server machines. That's a total of 5 machines (3 pulp server, one load balancer, and one consumer).
Then using the load balacner hostname, do a full regression test. All consumer testing should involve the dedicated consumer.
Added by bmbouter over 9 years ago
Revision 3d4eec1a | View on GitHub
Adds logging section to clustering docs
re #282
Added by bmbouter over 9 years ago
Revision 3d4eec1a | View on GitHub
Adds logging section to clustering docs
re #282
Added by bmbouter over 9 years ago
Revision e00e8d5a | View on GitHub
Adds three updates to the clustering documentation.
-
A section on clustered monitoring which identifies issues and workarounds for the /status/ API in clustered environments.
-
A section on pulp-admin configuration for clustered environments.
-
Generalizes the load balancer docs to include DNS based load balancing in addition to TCP based load balancing.
https://pulp.plan.io/issues/915 https://pulp.plan.io/issues/282
Added by bmbouter over 9 years ago
Revision e00e8d5a | View on GitHub
Adds three updates to the clustering documentation.
-
A section on clustered monitoring which identifies issues and workarounds for the /status/ API in clustered environments.
-
A section on pulp-admin configuration for clustered environments.
-
Generalizes the load balancer docs to include DNS based load balancing in addition to TCP based load balancing.
https://pulp.plan.io/issues/915 https://pulp.plan.io/issues/282
Updated by pthomas@redhat.com over 9 years ago
verified
Setup cluster pulp and performed regression testing.
Updated by bmbouter over 9 years ago
- Groomed set to Yes
- Sprint Candidate set to No
- Tags deleted (
Groomed)
Updated by bmbouter over 9 years ago
- Sprint Candidate changed from No to Yes
- Tags deleted (
Sprint Candidate)
Updated by dkliban@redhat.com over 9 years ago
- Status changed from 6 to CLOSED - CURRENTRELEASE
Adds a clustering requirements docs and a release note
closes #282