RPM Support

https://bugzilla.redhat.com/show_bug.cgi?id=1794647

Notes from the BZ:

Grant Gainey 2020-09-01 17:23:16 UTC

I am working with Centos8 kickstart currently, and here's what I see on Pulp2, 2-master for pulp and pulp_rpm:

  #!/bin/bash -v                                                                               
  BASE='centos8-baseos-ks'                                                                     
  REMOTE1='http://centos.mirror.rafal.ca/8.2.2004/BaseOS/ppc64le/kickstart/'                   
  pulp-admin rpm repo create --serve-http=true --repo-id=$BASE --relative-url=$BASE --feed=$REMOTE1 --download-policy immediate
  pulp-admin rpm repo sync run --repo-id=$BASE 
  +----------------------------------------------------------------------+
                Synchronizing Repository [centos8-baseos-ks]
  +----------------------------------------------------------------------+
  blahblahblah
  ... completed

  Task Succeeded

If I look at the published trees I see the kickstart files where I would expect them:

  [root@pulp2 yum]# tree | grep -v rpm
  .
  ├── http
  │   └── repos
  │       ├── centos8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/centos8-baseos-ks/1598980046.23
  │       └── listing
  ├── https
  │   └── repos
  │       ├── centos8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/centos8-baseos-ks/1598980046.23
  │       └── listing
  └── master
      └── yum_distributor
          └── centos8-baseos-ks
              └── 1598980046.23
                  ├── images
                  │   ├── boot.iso -> /var/lib/pulp/content/units/distribution/7b/27380410b6008e50444acb8fdd69e351b7cbd4e4f398fa410457f39157e0b9/images/boot.iso
                  │   └── install.img -> /var/lib/pulp/content/units/distribution/7b/27380410b6008e50444acb8fdd69e351b7cbd4e4f398fa410457f39157e0b9/images/install.img
                  ├── Packages
                  │   ├── a
                  │   ...
                  │   ├── z
                  ├── ppc
                  │   └── ppc64
                  │       ├── initrd.img -> /var/lib/pulp/content/units/distribution/7b/27380410b6008e50444acb8fdd69e351b7cbd4e4f398fa410457f39157e0b9/ppc/ppc64/initrd.img
                  │       └── vmlinuz -> /var/lib/pulp/content/units/distribution/7b/27380410b6008e50444acb8fdd69e351b7cbd4e4f398fa410457f39157e0b9/ppc/ppc64/vmlinuz
                  └── repodata
                      ├── 4bce5e49d718a0f08800330740a8b6ae60e72f494ee4a096793abbdefffc93aa-filelists.xml.gz
                      ├── 549bdf78ee50c7c8d91304bdde84ac8d9e76d0b83fc66353725d4aee2b673e09-comps.xml
                      ├── 7b91eeafeffd01bd9f7cad8a64a2f1609ecfed9c6697ec9113b8d84c2949485f-updateinfo.xml.gz
                      ├── a99296cc5691e272ddc74415f3341891330300d001f6bba57e1bedff23b695e9-primary.xml.gz
                      ├── d797275dc5994c926ade087a3d435c23d5eaf52e96924ab0b7d3e91c6347d907-other.xml.gz
                      └── repomd.xml

  1 directories, 2528 files
  [root@pulp2 yum]# 

And when I try to access them, they get delivered:

  [root@pulp2 yum]# wget --no-check-certificate https://pulp2.dev/pulp/repos/centos8-baseos-ks/images/install.img
  Saving to: ‘install.img’
  100%[================================================================>] 527,413,248  451MB/s   in 1.1s   
  2020-09-01 17:19:44 (451 MB/s) - ‘install.img’ saved [527413248/527413248]
  [root@pulp2 yum]# wget --no-check-certificate http://pulp2.dev/pulp/repos/centos8-baseos-ks/images/install.img
  Saving to: ‘install.img.1’
  100%[================================================================>] 527,413,248  768MB/s   in 0.7s   
  2020-09-01 17:19:48 (768 MB/s) - ‘install.img.1’ saved [527413248/527413248]
  [vagrant@pulp2 1794647]

I am going to reset and retry with a RHEL8 kickstart repo, assuming I can find/gain access to such a thing - but so far, this looks ok from Pulp2's side.

@lzap, @rplevka, am I missing something here?

Grant Gainey 2020-09-01 19:18:47 UTC

Pulp2 directory structure looks fine (i.e., "matches what I expect from looking at the treeinfo file") after synching RHEL8-baseos-kickstart repo from https://cdn.redhat.com/content/dist/rhel8/8.2/ppc64le/baseos/kickstart/ as well:

  #!/bin/bash -v                                                                               
  BASE='rhel8-baseos-ks'                                                                       
  REMOTE1=https://cdn.redhat.com/content/dist/rhel8/8.2/ppc64le/baseos/kickstart/              
  pulp-admin rpm repo create --serve-http=true --repo-id=$BASE --relative-url=$BASE --feed=$REMOTE1 --download-policy immediate --feed-key ./cdn.pem --feed-cert ./cdn.pem --feed-ca-cert ./redhat-uep.pem
  pulp-admin rpm repo sync run --repo-id=$BASE

  [root@pulp2 yum]# pwd
  /var/www/pub/yum

  [root@pulp2 yum]# tree . | grep -v rpm
  .
  ├── http
  │   └── repos
  │       ├── centos8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/centos8-baseos-ks/1598980046.23
  │       ├── listing
  │       └── rhel8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/rhel8-baseos-ks/1598986776.13
  ├── https
  │   └── repos
  │       ├── centos8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/centos8-baseos-ks/1598980046.23
  │       ├── listing
  │       └── rhel8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/rhel8-baseos-ks/1598986776.13
  └── master
      └── yum_distributor
          ├── centos8-baseos-ks
          │   └── 1598980046.23
          │       ...
          └── rhel8-baseos-ks
              └── 1598986776.13
                  ├── images
                  │   ├── boot.iso -> /var/lib/pulp/content/units/distribution/51/695f7a47d2bb8f43cfee8eb12a711e735c5093c52b7260e105f764cbf13e67/images/boot.iso
                  │   └── install.img -> /var/lib/pulp/content/units/distribution/51/695f7a47d2bb8f43cfee8eb12a711e735c5093c52b7260e105f764cbf13e67/images/install.img
                  ├── install.img
                  ├── Packages
                  │   ├── a
                   ...
                  │   ├── z
                  ├── ppc
                  │   └── ppc64
                  │       ├── initrd.img -> /var/lib/pulp/content/units/distribution/51/695f7a47d2bb8f43cfee8eb12a711e735c5093c52b7260e105f764cbf13e67/ppc/ppc64/initrd.img
                  │       └── vmlinuz -> /var/lib/pulp/content/units/distribution/51/695f7a47d2bb8f43cfee8eb12a711e735c5093c52b7260e105f764cbf13e67/ppc/ppc64/vmlinuz
                  ├── repodata
                  │   ├── 3ea0cdd6c686aac3c2c3862b81ea7d9fa9a9d1e77a8c411ea4eb9f5a9dfc4991-filelists.xml.gz
                  │   ├── 4df08de286551a837c0da1088bda7f4c6c08bd7745ef2bf5173cbbf7a0a5f2fb-other.xml.gz
                  │   ├── 9b28aa4f2e4d9e018e13997182e1dd6a19f714f943605245cd45cd6e4c1eedc0-comps.xml
                  │   ├── 9cbea1d8ad5317e27521d78f729c68c1909b59f059b1b90f095eac83a657f895-productid.gz
                  │   ├── a41c1ebf9624fbd07f7d8e5b9ba91a3c60ae359d22de36db577333b8e4775abd-updateinfo.xml.gz
                  │   ├── cdf308b88cc57d936afcd37e6da6e70cbd97eef8c55d9628052c6507935f34c3-primary.xml.gz
                  │   └── repomd.xml
                  └── treeinfo -> /var/lib/pulp/content/units/distribution/51/695f7a47d2bb8f43cfee8eb12a711e735c5093c52b7260e105f764cbf13e67/treeinfo
  76 directories, 5071 files
  [root@pulp2 yum]# wget --no-check-certificate http://pulp2.dev/pulp/repos/rhel8-baseos-ks/images/install.img
  Length: 527704064 (503M) [application/octet-stream]
  Saving to: ‘install.img’
  100%[================================================================>] 527,704,064  839MB/s   in 0.6s   
  2020-09-01 19:14:55 (839 MB/s) - ‘install.img’ saved [527704064/527704064]
  [root@pulp2 yum]# wget --no-check-certificate https://pulp2.dev/pulp/repos/rhel8-baseos-ks/images/install.img
  Length: 527704064 (503M) [application/octet-stream]
  Saving to: ‘install.img.1’
  100%[================================================================>] 527,704,064  253MB/s   in 2.0s   
  2020-09-01 19:15:04 (253 MB/s) - ‘install.img.1’ saved [527704064/527704064]
  [root@pulp2 yum]#

Unless someone can show that Pulp is putting content in the wrong place, I'm going to say that whatever the problem is here, it isn't a Pulp2 problem.

Apologies this turned out to be an issue in Foreman core, Katello plugin actually overrides media provider so the patch in Foreman 2.0 was not working correctly.