Project

Profile

Help

Story #5762

closed

[Epic] CI Improvements

Added by mdepaulo@redhat.com over 4 years ago. Updated about 2 years ago.

Status:
CLOSED - DUPLICATE
Priority:
Normal
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
% Done:

100%

Estimated time:
(Total: 0:00 h)
Platform Release:
Groomed:
No
Sprint Candidate:
No
Tags:
CI/CD
Sprint:
Quarter:

Description

Ticket moved to GitHub: "pulp/pulpcore/1856":https://github.com/pulp/pulpcore/issues/1856


Tracking Epic for improvements to the CI, including for non-plugin-template CI like ansible-pulp & pulp-operator.

Problems

There are two problems I can see wit the testing and CI/CD situation for pulpcore and its plugins.

False Negatives

I estimate our tests have a 30% - 50% false negative rate. This is costly in several ways. It slows down throughput of work by having to rerun jobs. Also the jobs don't automatically rerun (and shouldn't) so it waits for a human to be involved. It also significantly reduces the value of our nightly jobs because we ignore them since they are unreliable already. Also it interrupts the release process as it did during the pulp_file 0.1.0 GA release.

Runtime Length

The pulpcore jobs take 22 minutes. The plugins also take many minutes. We need to find a way to shorten the runtime of jobs while still running everything.


Sub-issues 21 (0 open21 closed)

Task #5763: pulp-operator-check-and-wait.sh has repetitious logic that should be a functionCLOSED - COMPLETEfao89

Actions
Task #5764: pulp-operator and ansible-pulp CI should adopt some features from the plugin-templateCLOSED - COMPLETEfao89

Actions
Task #5765: pulp_rpm_prerequisites needs CICLOSED - CURRENTRELEASEfao89

Actions
Task #5766: ansible-pulp CI should test calling roles from dynamic "include_role" in addition to static "roles"CLOSED - COMPLETEfao89

Actions
Task #6071: ansible-pulp CI should test the calling roles from dynamic "include_role" with the source dirs of the branchCLOSED - COMPLETE

Actions
Task #5768: ansible-pulp CI needs a more time efficient test matrixCLOSED - COMPLETEfao89

Actions
Issue #5769: ansible-pulp molecule CI seems slower than it should beCLOSED - DUPLICATEActions
Issue #5817: ansible-pulp CI is slower than it should be due to a lack of ansible pipeliningCLOSED - CURRENTRELEASEmdepaulo@redhat.comActions
Issue #6046: ansible-pulp molecule CI does duplicate molecule stagesCLOSED - CURRENTRELEASEfao89Actions
Task #5775: pulp-operator CI outputs the several-MB .iso rather than downloading it to diskCLOSED - COMPLETEfao89

Actions
Task #5871: Pursue using libeatmydata / nosync to speed up TravisCLOSED - WONTFIXfao89

Actions
Task #5997: ansible-pulp CI should use Ubuntu 18.04 bionicCLOSED - COMPLETEmdepaulo@redhat.com

Actions
Issue #6047: ansible-pulp CI builds "creates" the base molecule container images for every runCLOSED - CURRENTRELEASEfao89Actions
Task #6231: No functional tests at all run at the end of ansible-pulp CICLOSED - DUPLICATE

Actions
Task #6232: Apache support for pulp-webserver is not tested in CICLOSED - DUPLICATE

Actions
Task #6273: pulp_rpm_prerequisites CI shold test upgrading from older versions of pulp_rpmCLOSED - COMPLETEmdepaulo@redhat.com

Actions
Story #6584: As a pulp_installer CI user, I see verification that pulp functions and was installed correctly at the endCLOSED - CURRENTRELEASEmdepaulo@redhat.com

Actions
Task #6585: Show the status page in pulp_installer CICLOSED - WONTFIXmdepaulo@redhat.com

Actions
Task #6588: Verify our systemd unit files in pulp_installer CICLOSED - WONTFIXmdepaulo@redhat.com

Actions
Story #7259: As a user, the pulp_installer will verify that the Pulp Services are up & listeningCLOSED - CURRENTRELEASEfao89

Actions
Story #7272: As a pulp_installer CI user, some verification tests are run at the endCLOSED - CURRENTRELEASEmdepaulo@redhat.com

Actions

Related issues

Related to Pulp - Task #6073: Adapt pulp_installer CI for pulp_installer branches CLOSED - COMPLETEmdepaulo@redhat.com

Actions
Actions #1

Updated by fao89 over 4 years ago

  • Tags CI/CD added
Actions #2

Updated by bmbouter over 4 years ago

  • Description updated (diff)
Actions #3

Updated by mdepaulo@redhat.com about 4 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to mdepaulo@redhat.com

I'm assigning it to myself, since I am coordinating much of this.

Actions #4

Updated by mdepaulo@redhat.com about 4 years ago

  • Related to Task #6073: Adapt pulp_installer CI for pulp_installer branches added
Actions #5

Updated by pulpbot about 2 years ago

  • Description updated (diff)
  • Status changed from ASSIGNED to CLOSED - DUPLICATE

Also available in: Atom PDF