Project

Profile

Help

Pulp 2 12 Test Result Summary » History » Revision 2

Revision 1 (pthomas@redhat.com, 02/01/2017 08:07 PM) → Revision 2/3 (pthomas@redhat.com, 02/01/2017 09:13 PM)

# Pulp 2 12 Test Result Summary 

 Summary 

 Status: \[ \] Not Started \[ \] In Progress \[ \] Paused \[ \] Blocked \[X \] Finished   
 Started On: January 12, 2017   
 Finished On: January 30. 2017   
 Beta/RC URL: https://repos.fedorapeople.org/pulp/pulp/beta/2.12/   
 Redmine URL: http://https://pulp.plan.io/issues?query_id=61 

 The number of new features/stories were limited.Automated tests have increased from 472 in 2.11 to 481 in 2.12 . The jobs were run nightly on EL6, EL7 , Fedora 23 and Fedora 24. Upgrade jobs were run on RC builds. The results were reported and failures were discussed. https://pulp.plan.io/issues/2545 was found during RC1. RC2 was built with the fix. Manual testing was limited to the scenarios that do not yet have pulp smash tests. All the new features have been added to pulp-smash backlog to automate or already automated. 

 Pulp QE team approves the release of the 2.13 RC to GA. 

 Beta History   
 Beta 1: January 12, 2017   
 RC 1: January 24, 2017   
 RC 2: January 25, 2017 

 Automation 

 [[https://github.com/PulpQE/pulp-smash/issues?q=is%3Aopen+is%3Aissue+milestone%3A%22Coverage+for+2.12%22]] [[https://github.com/PulpQE/pulp-smash/issues?q=is%3Aopen+is%3Aissue+milestone%3A%22Coverage+for+2.12%22| Automation Work]]   
 \[\[Status: \[X\] PASSED \[ \] FAILED   
 System: x86_64   
 RHEL 6.8 RHEL 7.3   
 Installation PASS PASS   
 Smoke PASS PASS   
 API PASS PASS   
 CLI PASS PASS   
 Upgrade PASS PASS\]\] 

 NOTES: 

 2.12 Features and Bugs   
 https://pulp.plan.io/issues?query_id=61 

 New Features   
 \============ 

 Here are the specific stories done for 2.12: 

 ~~~ 
 Pulp 
       2525      Failover events should be explicitly logged as such when they occur 
       2509      Pulp process failure detection and any failover should occur within 30 seconds 
       2186      As a user, pulp-manage-db refuses to run if other pulp processes are running locally 
       1939      As a user, I would like to be able to profile Pulp tasks 
       1268      As a user, orphan content delete reports how many units were deleted 
 Python Support 
       1882      Rebuild model to support all package types 
       140       As a user, I can sync Python packages from another Pulp server 
       136       As a user, I can upload wheel packages to Pulp 
       135       As a user, I can synchronize wheels from PyPI 
 RPM Support 
       1976      As user, I can have packages sorted in "Packages/$x" directories when published 
 Docker Support 
       2189      As a user, I can update docker_tag units without using sync 
 ~~~ 

 View this list in redmine:   
 http://bit.ly/2iMdYpK 

 Issues Addressed   
 \================ 

 Here are the bug fixes specific to 2.12: 

 ~~~ 
 Pulp 
       2264      better error reporting during import/association 
       1488      Deprecate nodes 
       1321      Commit message requirements for Pulp contributions are out of date and could be better 
       103       Document the commit message keywords that will interact with Redmine 
 RPM Support 
       1823      RPMs partially downloaded 
 ~~~ 

 All bug fixes from Pulp 2.11.1 and earlier are also included in Pulp 2.12. 

 View this list in redmine:   
 http://bit.ly/2iMgzjJ 

 **Action Items**   
 The following process improvements will be made as a result of this release 

 Automation: Continue to Improve automation coverage. And add more matrix to automated upgrade testing.   
 Manual Testing: Organize manual testing efforts better. Identify areas for upgrade testing and feature testing for manual testing that are not covered in the automation.