Project

Profile

Help

Test Day on August 8 2017 » History » Sprint/Milestone 11

kdelee@redhat.com, 07/26/2017 05:02 PM

1 1 kdelee@redhat.com
# Test Day for 2.14 and pulp deb plugin
2
3 10 kdelee@redhat.com
## Join us on August 8, 2017 to test the 2.14 release and the new pulp_deb plugin!
4
5 1 kdelee@redhat.com
## Contents
6
7 11 kdelee@redhat.com
>   - [[How to join#how-to-join]]
8 1 kdelee@redhat.com
>   - What to test
9 4 kdelee@redhat.com
>   - Who is available for help
10 1 kdelee@redhat.com
>   - Prerequisites for test day
11
>   - Resources ( where to get RPMs, fedora images, etc)
12
>   - How to test
13
>   - Confirming existing issues
14
>   - Filing new issues
15
>   - How to report results
16
17
### Can't make the date?
18
19
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find here on https://pulp.plan.io, and report your results as detailed in "How to report results" section below.
20
21
## How to join
22
23
Join the [#pulp channel on freenode](http://irc.netsplit.de/channels/details.php?room=%23pulp&net=freenode)  
24
You can join via your favorite IRC client, or either of the two web clients below:
25
26
[pulp channel on irc2go](http://en.irc2go.com/webchat/?net=freenode&room=pulp)  
27
[freenode webchat](https://webchat.freenode.net/) (you will need to specify the channel as "#pulp")
28
29
Specify a nickname that you would like to go by, and keep it safe for work please!  
30
Many people choose something close to their name, as in Elijah's nickname is "elijah_d".
31
32
## == What to test? ==
33
34
The August 8th Pulp Test Day will focus on the [Pulp 2.14 beta release](http://docs.pulpproject.org/en/2.14/testing/user-guide/release-notes/2.14.x.html#pulp-2-14-release-notes) and the new [pulp debian plugin](https://github.com/pulp/pulp_deb/#debian-support)
35
36
Testers can walk through a manual upgrade from an existing pulp install, installing manually both pulp and the pulp_debian plugin,  
37
or can skip testing installation (and the documentation for that) by using ansible to install and moving on to confirming functionality of the product, that bugs that were fixed in the release are indeed fixed, or other exploratory testing.
38
39
## == Who's available ==
40
41
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion.
42
43
### Quality Engineering
44
45 7 kdelee@redhat.com
  - Elijah DeLee (email: kdelee@redhat.com irc: elijah_d)
46
  - Preethi Thomas (email: pthomas@redhat.com irc: preethi) 
47
  - Kersom Oliveira (email: koliveir@redhat.com irc: kersom)
48 1 kdelee@redhat.com
  - Jeremy Audet (email: jaudet@redhat.com irc: Ichimonji10)
49
50 6 kdelee@redhat.com
Specifically in the case of problem related to test day wiki, please reach out to Elijah DeLee at kdelee@redhat.com or on irc (nick: elijah_d)
51 1 kdelee@redhat.com
52 5 kdelee@redhat.com
## == Prerequisite for Test Day ==
53 1 kdelee@redhat.com
54
  - Fedora 24 or 25 or RHEL 7 machine (or VM)
55
  - Root access on the system
56
57 4 kdelee@redhat.com
If you would like to spin up a Fedora VM for testing, see [[Virtualization quickstart]] for a guide on some ways to spin up a VM on your machine for testing.
58 1 kdelee@redhat.com
59 7 kdelee@redhat.com
## == Resources (where to get RPMs, fedora images, etc) ==
60 1 kdelee@redhat.com
61
The Pulp 2.14 beta repository is included in the pulp repo files:  
62
https://repos.fedorapeople.org/repos/pulp/pulp/fedora-pulp.repo for fedora 24 & 25  
63 4 kdelee@redhat.com
https://repos.fedorapeople.org/repos/pulp/pulp/rhel-pulp.repo for RHEL 7
64 1 kdelee@redhat.com
65 4 kdelee@redhat.com
Fedora images:  
66
You can find fedora images here:  
67 1 kdelee@redhat.com
http://mirrors.mit.edu/fedora/linux/releases/
68
69 4 kdelee@redhat.com
## == How to test? ==
70 1 kdelee@redhat.com
71 7 kdelee@redhat.com
### == Run the tests ==  
72 9 kdelee@redhat.com
If you'd like to run the integration test suite, [pulp-smash](https://github.com/PulpQE/pulp-smash) or any individual tests, you can run them either locally on the pulp_server or remotely from any machine that can SSH into the pulp_server.
73 1 kdelee@redhat.com
74 7 kdelee@redhat.com
For docs on pulp-smash, see http://pulp-smash.readthedocs.io/en/latest/ where you can find instructions on how to install and configure pulp-smash to run against your pulp install.
75 1 kdelee@redhat.com
76 7 kdelee@redhat.com
If you have trouble, email us or ping us on IRC and we can help you get it set up!
77
78
### == Exploratory testing ==
79
80 1 kdelee@redhat.com
You can help out by playing around with the tool in whatever ways you can think of: try out all the things you can find.  
81
Get creative! Any problems you find please file a bug, or report to the IRC channel.
82
83 8 kdelee@redhat.com
Think [CRUD](https://en.wikipedia.org/wiki/Create,\_read,\_update_and_delete)  
84
As a user, you should be able to Create, Read, Update, and Delete repositories and the data within. Is this the case? Where do you run into trouble?
85
86 1 kdelee@redhat.com
## == Confirming existing issues ==
87
88 7 kdelee@redhat.com
There are three different ways you can use existing issues.
89
90
### 1\. Confirm that user stories marked "closed" work
91
92
You can find closed "user stories" [here](https://pulp.plan.io/issues?c%5B%5D=project&c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=subject&c%5B%5D=assigned_to&c%5B%5D=updated_on&f%5B%5D=status_id&f%5B%5D=tracker_id&f%5B%5D=&group_by=project&op%5Bstatus_id%5D=c&op%5Btracker_id%5D=%3D&page=1&set_filter=1&t%5B%5D=&utf8=%E2%9C%93&v%5Btracker_id%5D%5B%5D=3)
93
94
### 2\. Confirm that bugs fixed in the 2.14 release are indeed fixed!
95
96
[Bugs fixed in 2.14](https://pulp.plan.io/projects/pulp/issues?c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=cf_5&c%5B%5D=subject&c%5B%5D=author&c%5B%5D=assigned_to&c%5B%5D=cf_3&f%5B%5D=cf_4&f%5B%5D=tracker_id&f%5B%5D=&group_by=&op%5Bcf_4%5D=%3D&op%5Btracker_id%5D=%3D&set_filter=1&sort=priority%3Adesc%2Ccf_5%3Adesc%2Cid%3Adesc&utf8=%E2%9C%93&v%5Bcf_4%5D%5B%5D=2.14.0&v%5Btracker_id%5D%5B%5D=1)
97
98
### 3\. Validate existence of outstanding bugs
99
100
Validate existence of bugs, and if it seems suitable for for pulp-smash tests, file an issue on [pulp-smash github issues](https://github.com/PulpQE/pulp-smash/issues)
101
102
[Open issues with no pulp-smash issue filed](https://pulp.plan.io/projects/pulp/issues?utf8=%E2%9C%93&set_filter=1&f%5B%5D=tracker_id&op%5Btracker_id%5D=%3D&v%5Btracker_id%5D%5B%5D=1&f%5B%5D=status_id&op%5Bstatus_id%5D=o&f%5B%5D=cf_34&op%5Bcf_34%5D=%21\*&f%5B%5D=&c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=cf_5&c%5B%5D=subject&c%5B%5D=author&c%5B%5D=assigned_to&c%5B%5D=cf_3&group_by=&t%5B%5D=)
103
104 5 kdelee@redhat.com
## == Filing new issues ==
105 1 kdelee@redhat.com
106 7 kdelee@redhat.com
If you have problems with any of the tests, first search for a issue related to the same bug and add a comment on https://pulp.plan.io. Otherwise, report a bug to https://pulp.plan.io in the appropriate project section.  
107 4 kdelee@redhat.com
For example, you can find the issue for debian under the [Debain support](https://pulp.plan.io/projects/pulp_deb/) project.  
108
Find all projects here: [Projects](https://pulp.plan.io/projects/)
109 1 kdelee@redhat.com
110 5 kdelee@redhat.com
## == How to report results ==