Pulp 2 15 Test Result Summary¶

Summary

Status: [ ] Not Started [ ] In Progress [ ] Paused [ ] Blocked [X ] Finished
Started On: November 28, 2017
Finished On: January 16. 2018
Beta/RC URL: https://repos.fedorapeople.org/pulp/pulp/beta/2.14/
Redmine URL: http://https://pulp.plan.io/issues?query_id=61

Automated tests have increased from 528 in 2.14 to 584 in 2.15. The jobs were run nightly on EL7, Fedora 25 and Fedora 26. Test run on Fedora 27 failed due to SELinux issues [1]. Upgrade jobs were run on RC builds. Upgrade test jobs passed for EL7, F25 and F26. Manual testing was limited to the scenarios that do not yet have pulp smash tests. All the issues have been added to pulp-smash backlog to automate or are already automated [2].

Pulp QE team approves the release of the 2.15 RC to GA.

Beta History
Beta 1: November 28, 2017
Beta2: December 5, 2017
Beta3: December 18, 2017
RC 1: January 10, 2017

Automation

[[Status: [X] PASSED [ ] FAILED
System: x86_64
RHEL 7.4
Installation PASS PASS
Smoke PASS PASS
API PASS PASS
CLI PASS PASS
Upgrade PASS PASS]]

NOTES:

New Features
============

Here are the specific stories done for 2.15:

Pulp
      3119    As a user, I can see in logs that force_full option for sync or publish is enabled
      1282    As an EC2 user, I would like to set up a RHUI as an alternate content source

Crane
      3110    As a user i can perform docker search of docker v2 content

Docker Support
      2993    As a user, I can upload a docker_manifest_list so that I can remove arches from a manifest list without performing a sync
      2810    As a user, I can upload a schema 2 manifest with blobs

RPM Support
      3055    As a user, I can publish a Yum repository that works with repo_gpgcheck=1
      2788    As a user i can configure removal of old published repodata

View this list in redmine:
http://bit.ly/2j1OeW9

Issues Addressed
================

Here are the bug fixes specific to 2.15:

Crane
    3111    Crane should continue to load rest of the metadata after corrupted data is encountered

Docker Support
    3122    config layer is served gzip-compressed to docker client
    3067    Document image manifest and manifest list peculiar behaviour during copy, remove and other actions
    3139    Sync from Crane fails with "Not Found"

RPM Support
    3130    Upgrade from Pulp 2.13.2- to Pulp 2.13.3+ can result in "duplicate key error index: pulp_database.erratum_pkglists.$errata_id_1_repo_id_1 dup key"
    3104    repomd.xml is empty

All bug fixes from Pulp 2.14.3 and earlier are also included in Pulp 2.15.

View this list in redmine:
http://bit.ly/2AieENo

*Action Items *

[1] https://pulp.plan.io/issues/3159
[2] https://github.com/PulpQE/pulp-smash/issues/766
[3] https://github.com/PulpQE/pulp-smash/issues/681
[4] https://github.com/PulpQE/pulp-smash/issues/829