Project

Profile

Help

Pulp 2 12 Test Result Summary

Summary

Status: [ ] Not Started [ ] In Progress [ ] Paused [ ] Blocked [X ] Finished
Started On: January 12, 2017
Finished On: January 30. 2017
Beta/RC URL: https://repos.fedorapeople.org/pulp/pulp/beta/2.12/
Redmine URL: http://https://pulp.plan.io/issues?query_id=61

The number of new features/stories were limited.Automated tests have increased from 472 in 2.11 to 481 in 2.12 . The jobs were run nightly on EL6, EL7 , Fedora 23 and Fedora 24. Upgrade jobs were run on RC builds. The results were reported and failures were discussed. https://pulp.plan.io/issues/2545 was found during RC1. RC2 was built with the fix. Manual testing was limited to the scenarios that do not yet have pulp smash tests. All the new features have been added to pulp-smash backlog to automate or already automated.

Pulp QE team approves the release of the 2.13 RC to GA.

Beta History
Beta 1: January 12, 2017
RC 1: January 24, 2017
RC 2: January 25, 2017

Automation

[[https://github.com/PulpQE/pulp-smash/issues?q=is%3Aopen+is%3Aissue+milestone%3A%22Coverage+for+2.12%22]]
[[Status: [X] PASSED [ ] FAILED
System: x86_64
RHEL 6.8 RHEL 7.3
Installation PASS PASS
Smoke PASS PASS
API PASS PASS
CLI PASS PASS
Upgrade PASS PASS]]

NOTES:

2.12 Features and Bugs
https://pulp.plan.io/issues?query_id=61

New Features ============

Here are the specific stories done for 2.12:

Pulp
2525 Failover events should be explicitly logged as such when they occur
2509 Pulp process failure detection and any failover should occur within 30 seconds
2186 As a user, pulp-manage-db refuses to run if other pulp processes are running locally
1939 As a user, I would like to be able to profile Pulp tasks
1268 As a user, orphan content delete reports how many units were deleted
Python Support
1882 Rebuild model to support all package types
140 As a user, I can sync Python packages from another Pulp server
136 As a user, I can upload wheel packages to Pulp
135 As a user, I can synchronize wheels from PyPI
RPM Support
1976 As user, I can have packages sorted in "Packages/$x" directories when published
Docker Support
2189 As a user, I can update docker_tag units without using sync

View this list in redmine:
http://bit.ly/2iMdYpK

Issues Addressed ================

Here are the bug fixes specific to 2.12:

Pulp
2264 better error reporting during import/association
1488 Deprecate nodes
1321 Commit message requirements for Pulp contributions are out of date and could be better
103 Document the commit message keywords that will interact with Redmine
RPM Support
1823 RPMs partially downloaded

All bug fixes from Pulp 2.11.1 and earlier are also included in Pulp 2.12.

View this list in redmine:
http://bit.ly/2iMgzjJ

Action Items
The following process improvements will be made as a result of this release

Automation: Continue to Improve automation coverage. And add more matrix to automated upgrade testing.
Manual Testing: Organize manual testing efforts better. Identify areas for upgrade testing and feature testing for manual testing that are not covered in the automation.

Also available in: PDF HTML ODT TXT