Project

Profile

Help

Pulp 2 12 Test Result Summary » History » Sprint/Milestone 3

pthomas@redhat.com, 02/02/2017 03:31 PM

1 1 pthomas@redhat.com
# Pulp 2 12 Test Result Summary
2
3
Summary
4
5
Status: \[ \] Not Started \[ \] In Progress \[ \] Paused \[ \] Blocked \[X \] Finished  
6
Started On: January 12, 2017  
7
Finished On: January 30. 2017  
8
Beta/RC URL: https://repos.fedorapeople.org/pulp/pulp/beta/2.12/  
9
Redmine URL: http://https://pulp.plan.io/issues?query_id=61
10
11
The number of new features/stories were limited.Automated tests have increased from 472 in 2.11 to 481 in 2.12 . The jobs were run nightly on EL6, EL7 , Fedora 23 and Fedora 24. Upgrade jobs were run on RC builds. The results were reported and failures were discussed. https://pulp.plan.io/issues/2545 was found during RC1. RC2 was built with the fix. Manual testing was limited to the scenarios that do not yet have pulp smash tests. All the new features have been added to pulp-smash backlog to automate or already automated.
12
13
Pulp QE team approves the release of the 2.13 RC to GA.
14
15
Beta History  
16
Beta 1: January 12, 2017  
17
RC 1: January 24, 2017  
18
RC 2: January 25, 2017
19
20
Automation
21
22 2 pthomas@redhat.com
[[https://github.com/PulpQE/pulp-smash/issues?q=is%3Aopen+is%3Aissue+milestone%3A%22Coverage+for+2.12%22]]  
23 1 pthomas@redhat.com
\[\[Status: \[X\] PASSED \[ \] FAILED  
24
System: x86_64  
25
RHEL 6.8 RHEL 7.3  
26
Installation PASS PASS  
27
Smoke PASS PASS  
28
API PASS PASS  
29
CLI PASS PASS  
30
Upgrade PASS PASS\]\]
31
32
NOTES:
33
34
2.12 Features and Bugs  
35
https://pulp.plan.io/issues?query_id=61
36
37
New Features  
38
\============
39
40
Here are the specific stories done for 2.12:
41
42
~~~
43
Pulp
44
      2525    Failover events should be explicitly logged as such when they occur
45
      2509    Pulp process failure detection and any failover should occur within 30 seconds
46
      2186    As a user, pulp-manage-db refuses to run if other pulp processes are running locally
47
      1939    As a user, I would like to be able to profile Pulp tasks
48
      1268    As a user, orphan content delete reports how many units were deleted
49
Python Support
50
      1882    Rebuild model to support all package types
51
      140     As a user, I can sync Python packages from another Pulp server
52
      136     As a user, I can upload wheel packages to Pulp
53
      135     As a user, I can synchronize wheels from PyPI
54
RPM Support
55
      1976    As user, I can have packages sorted in "Packages/$x" directories when published
56
Docker Support
57
      2189    As a user, I can update docker_tag units without using sync
58
~~~
59
60
View this list in redmine:  
61
http://bit.ly/2iMdYpK
62
63
Issues Addressed  
64
\================
65
66
Here are the bug fixes specific to 2.12:
67
68
~~~
69
Pulp
70
      2264    better error reporting during import/association
71
      1488    Deprecate nodes
72
      1321    Commit message requirements for Pulp contributions are out of date and could be better
73
      103     Document the commit message keywords that will interact with Redmine
74
RPM Support
75
      1823    RPMs partially downloaded
76
~~~
77
78
All bug fixes from Pulp 2.11.1 and earlier are also included in Pulp 2.12.
79
80
View this list in redmine:  
81
http://bit.ly/2iMgzjJ
82
83
**Action Items**  
84
The following process improvements will be made as a result of this release
85
86
Automation: Continue to Improve automation coverage. And add more matrix to automated upgrade testing.  
87
Manual Testing: Organize manual testing efforts better. Identify areas for upgrade testing and feature testing for manual testing that are not covered in the automation.