Pulp 2 12 Test Result Summary » History » Sprint/Milestone 1
pthomas@redhat.com, 02/01/2017 08:07 PM
1 | 1 | pthomas@redhat.com | # Pulp 2 12 Test Result Summary |
---|---|---|---|
2 | |||
3 | Summary |
||
4 | |||
5 | Status: \[ \] Not Started \[ \] In Progress \[ \] Paused \[ \] Blocked \[X \] Finished |
||
6 | Started On: January 12, 2017 |
||
7 | Finished On: January 30. 2017 |
||
8 | Beta/RC URL: https://repos.fedorapeople.org/pulp/pulp/beta/2.12/ |
||
9 | Redmine URL: http://https://pulp.plan.io/issues?query_id=61 |
||
10 | |||
11 | The number of new features/stories were limited.Automated tests have increased from 472 in 2.11 to 481 in 2.12 . The jobs were run nightly on EL6, EL7 , Fedora 23 and Fedora 24. Upgrade jobs were run on RC builds. The results were reported and failures were discussed. https://pulp.plan.io/issues/2545 was found during RC1. RC2 was built with the fix. Manual testing was limited to the scenarios that do not yet have pulp smash tests. All the new features have been added to pulp-smash backlog to automate or already automated. |
||
12 | |||
13 | Pulp QE team approves the release of the 2.13 RC to GA. |
||
14 | |||
15 | Beta History |
||
16 | Beta 1: January 12, 2017 |
||
17 | RC 1: January 24, 2017 |
||
18 | RC 2: January 25, 2017 |
||
19 | |||
20 | Automation |
||
21 | |||
22 | [[https://github.com/PulpQE/pulp-smash/issues?q=is%3Aopen+is%3Aissue+milestone%3A%22Coverage+for+2.12%22| Automation Work]] |
||
23 | \[\[Status: \[X\] PASSED \[ \] FAILED |
||
24 | System: x86_64 |
||
25 | RHEL 6.8 RHEL 7.3 |
||
26 | Installation PASS PASS |
||
27 | Smoke PASS PASS |
||
28 | API PASS PASS |
||
29 | CLI PASS PASS |
||
30 | Upgrade PASS PASS\]\] |
||
31 | |||
32 | NOTES: |
||
33 | |||
34 | 2.12 Features and Bugs |
||
35 | https://pulp.plan.io/issues?query_id=61 |
||
36 | |||
37 | New Features |
||
38 | \============ |
||
39 | |||
40 | Here are the specific stories done for 2.12: |
||
41 | |||
42 | ~~~ |
||
43 | Pulp |
||
44 | 2525 Failover events should be explicitly logged as such when they occur |
||
45 | 2509 Pulp process failure detection and any failover should occur within 30 seconds |
||
46 | 2186 As a user, pulp-manage-db refuses to run if other pulp processes are running locally |
||
47 | 1939 As a user, I would like to be able to profile Pulp tasks |
||
48 | 1268 As a user, orphan content delete reports how many units were deleted |
||
49 | Python Support |
||
50 | 1882 Rebuild model to support all package types |
||
51 | 140 As a user, I can sync Python packages from another Pulp server |
||
52 | 136 As a user, I can upload wheel packages to Pulp |
||
53 | 135 As a user, I can synchronize wheels from PyPI |
||
54 | RPM Support |
||
55 | 1976 As user, I can have packages sorted in "Packages/$x" directories when published |
||
56 | Docker Support |
||
57 | 2189 As a user, I can update docker_tag units without using sync |
||
58 | ~~~ |
||
59 | |||
60 | View this list in redmine: |
||
61 | http://bit.ly/2iMdYpK |
||
62 | |||
63 | Issues Addressed |
||
64 | \================ |
||
65 | |||
66 | Here are the bug fixes specific to 2.12: |
||
67 | |||
68 | ~~~ |
||
69 | Pulp |
||
70 | 2264 better error reporting during import/association |
||
71 | 1488 Deprecate nodes |
||
72 | 1321 Commit message requirements for Pulp contributions are out of date and could be better |
||
73 | 103 Document the commit message keywords that will interact with Redmine |
||
74 | RPM Support |
||
75 | 1823 RPMs partially downloaded |
||
76 | ~~~ |
||
77 | |||
78 | All bug fixes from Pulp 2.11.1 and earlier are also included in Pulp 2.12. |
||
79 | |||
80 | View this list in redmine: |
||
81 | http://bit.ly/2iMgzjJ |
||
82 | |||
83 | **Action Items** |
||
84 | The following process improvements will be made as a result of this release |
||
85 | |||
86 | Automation: Continue to Improve automation coverage. And add more matrix to automated upgrade testing. |
||
87 | Manual Testing: Organize manual testing efforts better. Identify areas for upgrade testing and feature testing for manual testing that are not covered in the automation. |