Pulp

# Test Day for 2.14 and pulp deb plugin

## Join us on August 8, 2017 to test the 2.14 release and the new pulp_deb plugin!

## Contents

>   - How to join

>   - How to contribute

>   - Who is available for help

>   - Prerequisites for test day

>   - Resources ( where to get RPMs, fedora images, etc)

>   - How to test

>   - Confirming existing issues

>   - Filing new issues

>   - How to report results

### Can't make the date?

If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find here on https://pulp.plan.io, and report your results as detailed in "How to report results" section below.

## How to join

RSVP with this form to let us know you are coming and request help getting set up:  

[RSVP and request help](https://goo.gl/forms/eHzCGsRDzDVWse923)

If you don't get around to RSVPing, just show up!

Join the [#pulp channel on freenode](http://irc.netsplit.de/channels/details.php?room=%23pulp&net=freenode)  

You can join via your favorite IRC client, or either of the two web clients below:

[pulp channel on freenode webchat](http://webchat.freenode.net/?channels=%23pulp&uio=d4)

Specify a nickname that you would like to go by, and keep it safe for work please!  

Many people choose something close to their name, as in Elijah's nickname is "elijah_d".

## == How to contribute ==

The August 8th Pulp Test Day will focus on the [Pulp 2.14 beta release](http://docs.pulpproject.org/en/2.14/testing/user-guide/release-notes/2.14.x.html#pulp-2-14-release-notes) and the new [pulp debian plugin](https://github.com/pulp/pulp_deb/#debian-support)

Things you can do:

  - Collaborate with a Pulp QE member to provide a guide for installing on an cloud instance [ask in #pulp](http://webchat.freenode.net/?channels=%23pulp&uio=d4)

  - walk through a [manual upgrade from an existing pulp install](http://docs.pulpproject.org/en/nightly/user-guide/release-notes/2.14.x.html#upgrade-instructions), 

  - installing manually both "pulp":docs.pulpproject.org/en/2.14/nightly/user-guide/installation/f24+.html and the [pulp_debian plugin](https://github.com/pulp/pulp_deb/#installation) 

  - [Install using ansible](https://pulp.plan.io/projects/pulp/wiki/Virtualization_quickstart#SETTING-UP-ANSIBLE-on-the-VM) and moving on to confirming functionality of the project, that bugs that were fixed in the release are indeed fixed, or other exploratory testing.

  - Manually test user stories included in this release

  - Verify bug fixes in this release

  - Explore pulp functionality and provide feedback

## == Who's available ==

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion.

### Quality Engineering

  - Elijah DeLee (email: kdelee@redhat.com irc: elijah_d)

  - Preethi Thomas (email: pthomas@redhat.com irc: preethi) 

  - Kersom Oliveira (email: koliveir@redhat.com irc: kersom)

  - Jeremy Audet (email: jaudet@redhat.com irc: ichimonji10)

Specifically in the case of problem related to test day wiki, please reach out to Elijah DeLee at kdelee@redhat.com or on irc (nick: elijah_d)

## == Prerequisite for Test Day ==

  - Fedora 24, 25, or 26, RHEL 7, CentOS 7 system ( bare metal or VM )

  - Root access on the system

**Ansible [install on Fedora 26 is currently broken](https://pulp.plan.io/issues/2961). Rumor is, it is manually installable. Unless you want to battle install issues today, it is best to go with Fedora 25**

  - If Pulp was installed using Ansible, then "docs:" https://docs.pulpproject.org/user-guide/installation/index.html are not applicable.

<!-- end list -->

  - To confirm that Pulp was installed properly run:

<!-- end list -->

~~~

pulp-admin login -u admin -p admin

~~~

  - Then:

<!-- end list -->

~~~

pulp-admin status

~~~

For a guide on some ways to spin up a VM on your machine. see [[Virtualization quickstart]]  

For some information on how to provision a machine from a cloud provider such as digital ocean see [[Provisioning Test Machine from Cloud]]

## == Resources (where to get RPMs, fedora images, etc) ==

The Pulp 2.14 beta repository is included in the pulp repo files:  

[2.14 beta repo file for fedora 24 & 25](https://repos.fedorapeople.org/repos/pulp/pulp/fedora-pulp.repo)  

[2.14 beta repo file for RHEL7](https://repos.fedorapeople.org/repos/pulp/pulp/rhel-pulp.repo)

You can also find the packages themselves here:  

[2.14 beta RPMs](https://repos.fedorapeople.org/pulp/pulp/beta/2.14/)

Fedora images:  

You can find fedora "live" images here to install with:  

[Fedora 24](http://mirrors.mit.edu/fedora/linux/releases/24/Workstation/x86_64/iso/)  

[Fedora 25](http://mirrors.mit.edu/fedora/linux/releases/25/Workstation/x86_64/iso/)  

[Fedora 26](http://mirrors.mit.edu/fedora/linux/releases/26/Workstation/x86_64/iso/)

## == How to test? ==

### == Run the tests ==  

If you'd like to run the integration test suite, [pulp-smash](https://github.com/PulpQE/pulp-smash) or any individual tests, you can run them either locally on the pulp_server or remotely from any machine that can SSH into the pulp_server.

For docs on pulp-smash, see http://pulp-smash.readthedocs.io/en/latest/ where you can find instructions on how to install and configure pulp-smash to run against your pulp install.

If you have trouble, email us or ping us on IRC and we can help you get it set up!

### == Exploratory testing ==

You can help out by playing around with the tool in whatever ways you can think of: try out all the things you can find.  

Get creative! Any problems you find please file a bug, or report to the IRC channel. See [Filing new issues](https://pulp.plan.io/projects/pulp/wiki/Test_Day_on_August_8\_2017#Filing-new-issues)

Find the 2.14 User Guide [here.](http://docs.pulpproject.org/en/2.14/nightly/user-guide/index.html)  

Find the 2.14 RPM Quick Start Guide [here.](http://docs.pulpproject.org/en/2.14/nightly/plugins/pulp_rpm/user-guide/quick-start.html)

Look for other quick start guides among the plugin documentation. Note that the main docs.pulpproject.org may direct you to docs for 2.13, check the URL to make sure you are looking at the right version.

Think [CRUD](https://en.wikipedia.org/wiki/Create,\_read,\_update_and_delete)  

As a user, you should be able to Create, Read, Update, and Delete repositories and the data within. Is this the case? Where do you run into trouble?

## == Verifying existing issues ==

There are three different ways you can use existing issues.

### 1\. Verify that user stories marked "closed" work

[User stories closed in the 2.14 beta release](https://pulp.plan.io/issues?utf8=%E2%9C%93&set_filter=1&f%5B%5D=cf_4&op%5Bcf_4%5D=%3D&v%5Bcf_4%5D%5B%5D=2.14.0&f%5B%5D=tracker_id&op%5Btracker_id%5D=%3D&v%5Btracker_id%5D%5B%5D=3&f%5B%5D=&c%5B%5D=project&c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=cf_5&c%5B%5D=subject&c%5B%5D=author&c%5B%5D=assigned_to&c%5B%5D=cf_3&c%5B%5D=cf_4&group_by=project&t%5B%5D=)

### 2\. Verify that bugs fixed in the 2.14 release are indeed fixed!

[Bugs fixed in 2.14](https://pulp.plan.io/issues?c[]=tracker&c[]=status&c[]=priority&c[]=cf_5&c[]=subject&c[]=author&c[]=assigned_to&c[]=cf_3&f[]=cf_4&f[]=tracker_id&f[]=&group_by=&op[cf_4]=%3D&op[tracker_id]=%3D&set_filter=1&sort=priority%3Adesc%2Ccf_5%3Adesc%2Cid%3Adesc&utf8=%E2%9C%93&v[cf_4][]=2.14.0&v[tracker_id][]=1)

### 3\. Recreate outstanding bugs

Validate existence of [outstanding bugs in 2.14 beta.](https://pulp.plan.io/issues?utf8=%E2%9C%93&set_filter=1&f%5B%5D=tracker_id&op%5Btracker_id%5D=%3D&v%5Btracker_id%5D%5B%5D=1&f%5B%5D=status_id&op%5Bstatus_id%5D=o&f%5B%5D=cf_34&op%5Bcf_34%5D=%21\*&f%5B%5D=cf_8&op%5Bcf_8%5D=%3D&v%5Bcf_8%5D%5B%5D=2.14.0&v%5Bcf_8%5D%5B%5D=2.13.3&v%5Bcf_8%5D%5B%5D=2.13.2&v%5Bcf_8%5D%5B%5D=2.13.1&v%5Bcf_8%5D%5B%5D=2.13.0&v%5Bcf_8%5D%5B%5D=2.12.2&v%5Bcf_8%5D%5B%5D=2.12.1&v%5Bcf_8%5D%5B%5D=2.12.0&v%5Bcf_8%5D%5B%5D=2.11.1&v%5Bcf_8%5D%5B%5D=2.11.0&v%5Bcf_8%5D%5B%5D=2.10.3&v%5Bcf_8%5D%5B%5D=2.10.2&v%5Bcf_8%5D%5B%5D=2.10.1&v%5Bcf_8%5D%5B%5D=2.10.0&f%5B%5D=&c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=cf_5&c%5B%5D=subject&c%5B%5D=author&c%5B%5D=assigned_to&c%5B%5D=cf_3&group_by=cf_8&t%5B%5D=)

If the bug is replicable and seems suitable for for pulp-smash tests, file an issue on [pulp-smash github issues](https://github.com/PulpQE/pulp-smash/issues)

## == Filing new issues ==

If you have problems with any of the tests, first search for a issue related to the same bug and add a comment on the issue at https://pulp.plan.io.

Otherwise, report the bug to https://pulp.plan.io in the appropriate project section.

For example, you can file a new bug or find an existing issue for the debian plugin under the [Debain issues](https://pulp.plan.io/projects/pulp_deb/issues?utf8=%E2%9C%93&set_filter=1&f%5B%5D=status_id&op%5Bstatus_id%5D=o&f%5B%5D=tracker_id&op%5Btracker_id%5D=%3D&v%5Btracker_id%5D%5B%5D=1&f%5B%5D=&c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=cf_5&c%5B%5D=subject&c%5B%5D=author&c%5B%5D=assigned_to&c%5B%5D=cf_3&group_by=&t%5B%5D=)

Again, if you are having trouble finding where to file your issue or search for existing ones, join us on IRC to get help!

## == How to report results ==

### New bugs

If you found a new bug, then you can file a new issue as described above. Also, refer to [[Issue filing template]]

### Verified bugs

If you verified that a fix is correct or that a bug still exists, then comment on the issue with details about your system including all information pertinent to filing a new bug: [[Issue filing template]]

[More thoughts on what make a good bug report](https://stackoverflow.com/help/mcve)