Issue #2751
closed
Unittest builder for plugins fails if the minimum required platform version is unavailable
Description
When plugin requires Pulp core version to be >= X.Y, builder tries to install version X.Y which may not exist for certain boxes.
Example.
OSTree plugin requires Pulp core to be >= 2.10, so builder tries to install Pulp 2.10 on F25 system but fails [0] because we do not have pulp-2.10 build for F25.
The PR builder job for plugins should be modified to:
1) Install the latest GA core RPMs and test against those. If they pass then pass the PR[UPDATE] This is already done; see the first associated commit.
2) If there are failures, retest using packages from the nightly build of Pulp. It's possible that there is new code that is required from platform that is not yet released. If this passes, then pass the PR
[0]: https://pulpadmin.fedorapeople.org/jenkins/jobs/unittest-pulp_ostree-pr/builds/40/node-type=f25-np.txt
- Triaged changed from No to Yes
- Sprint/Milestone set to 39
- Description updated (diff)
- Sprint/Milestone deleted (
39)
- Sprint/Milestone set to 39
- Status changed from NEW to ASSIGNED
- Assignee set to dkliban@redhat.com
- Description updated (diff)
For the latest version of core that will get installed, I'm wondering if that is the GA release of core or the nightly. Yesterday when we were talking I suggested using the nightly, but now I'm thinking that the existing GA is probably the best. The reason you would want it to be the nightly is because of situations wituations where plugin code relies on core changes that are not part of the GA release yet. The reason not to use nightlies is that they could be unreliable. I'm favoring using the GA for two reasons:
1. plugin code changes on the pulp2 line that also require unreleased core changes doesn't happen a whole lot (but some).
2. It's probably a best practice to test one thing at a time. This is about testing the plugin code, so that means core should be stable. If we use the nightly for most failures we'll have to determine if platform OR the plugin code is broken. By always using the GA of core we know everytime that it's the plugin. It's also possible that the plugin needs not-yet-released code in core, but the plugin writer should know if they are in one of those cases at which point tests can be run locally to prove they work perhaps.
What do others think about ^?
- Status changed from ASSIGNED to MODIFIED
Applied in changeset commit:32687f052864c7dfd736cbd7011635d31c7eac27.
- Description updated (diff)
- Status changed from MODIFIED to ASSIGNED
I agree that it is best to test one change at a time. I updated the description based on this.
- Status changed from ASSIGNED to MODIFIED
- Status changed from MODIFIED to NEW
- Sprint/Milestone changed from 39 to 40
- Description updated (diff)
I rewrote some based on pulp-dev discussion about how to better handle the case when a plugin requires unreleased core code.
- Description updated (diff)
Updating to reflect the current state of completed work.
- Status changed from NEW to ASSIGNED
- Sprint/Milestone changed from 40 to 41
- Sprint/Milestone changed from 41 to 42
- Sprint/Milestone changed from 42 to 43
- Sprint/Milestone changed from 43 to 44
- Sprint/Milestone changed from 44 to 45
- Sprint/Milestone changed from 45 to 46
- Sprint/Milestone changed from 46 to 47
- Project changed from Packaging to Infrastructure
- Sprint/Milestone changed from 47 to 48
- Sprint/Milestone changed from 48 to 52
- Sprint/Milestone changed from 52 to 53
- Sprint/Milestone changed from 53 to 54
- Sprint/Milestone changed from 54 to 56
- Sprint/Milestone deleted (
56)
- Groomed changed from No to Yes
- Sprint Candidate changed from No to Yes
- Sprint deleted (
Sprint 33)
Clearing out sprint 33. This work was deferred so it's going back to the sprint candidate list for next time.
- Status changed from ASSIGNED to NEW
- Assignee deleted (
dkliban@redhat.com)
- Groomed changed from Yes to No
- Sprint Candidate changed from Yes to No
- Status changed from NEW to CLOSED - WONTFIX
Also available in: Atom
PDF
Problem: plugin PR builder uses older core RPMs
Solution: always install core from the latest GA build
closes #2751 https://pulp.plan.io/issues/2751