Notes from the BZ:
Grant Gainey 2020-09-01 17:23:16 UTC
I am working with Centos8 kickstart currently, and here's what I see on Pulp2, 2-master for pulp and pulp_rpm:
#!/bin/bash -v
BASE='centos8-baseos-ks'
REMOTE1='http://centos.mirror.rafal.ca/8.2.2004/BaseOS/ppc64le/kickstart/'
pulp-admin rpm repo create --serve-http=true --repo-id=$BASE --relative-url=$BASE --feed=$REMOTE1 --download-policy immediate
pulp-admin rpm repo sync run --repo-id=$BASE
+----------------------------------------------------------------------+
Synchronizing Repository [centos8-baseos-ks]
+----------------------------------------------------------------------+
blahblahblah
... completed
Task Succeeded
If I look at the published trees I see the kickstart files where I would expect them:
[root@pulp2 yum]# tree | grep -v rpm
.
├── http
│ └── repos
│ ├── centos8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/centos8-baseos-ks/1598980046.23
│ └── listing
├── https
│ └── repos
│ ├── centos8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/centos8-baseos-ks/1598980046.23
│ └── listing
└── master
└── yum_distributor
└── centos8-baseos-ks
└── 1598980046.23
├── images
│ ├── boot.iso -> /var/lib/pulp/content/units/distribution/7b/27380410b6008e50444acb8fdd69e351b7cbd4e4f398fa410457f39157e0b9/images/boot.iso
│ └── install.img -> /var/lib/pulp/content/units/distribution/7b/27380410b6008e50444acb8fdd69e351b7cbd4e4f398fa410457f39157e0b9/images/install.img
├── Packages
│ ├── a
│ ...
│ ├── z
├── ppc
│ └── ppc64
│ ├── initrd.img -> /var/lib/pulp/content/units/distribution/7b/27380410b6008e50444acb8fdd69e351b7cbd4e4f398fa410457f39157e0b9/ppc/ppc64/initrd.img
│ └── vmlinuz -> /var/lib/pulp/content/units/distribution/7b/27380410b6008e50444acb8fdd69e351b7cbd4e4f398fa410457f39157e0b9/ppc/ppc64/vmlinuz
└── repodata
├── 4bce5e49d718a0f08800330740a8b6ae60e72f494ee4a096793abbdefffc93aa-filelists.xml.gz
├── 549bdf78ee50c7c8d91304bdde84ac8d9e76d0b83fc66353725d4aee2b673e09-comps.xml
├── 7b91eeafeffd01bd9f7cad8a64a2f1609ecfed9c6697ec9113b8d84c2949485f-updateinfo.xml.gz
├── a99296cc5691e272ddc74415f3341891330300d001f6bba57e1bedff23b695e9-primary.xml.gz
├── d797275dc5994c926ade087a3d435c23d5eaf52e96924ab0b7d3e91c6347d907-other.xml.gz
└── repomd.xml
1 directories, 2528 files
[root@pulp2 yum]#
And when I try to access them, they get delivered:
[root@pulp2 yum]# wget --no-check-certificate https://pulp2.dev/pulp/repos/centos8-baseos-ks/images/install.img
Saving to: ‘install.img’
100%[================================================================>] 527,413,248 451MB/s in 1.1s
2020-09-01 17:19:44 (451 MB/s) - ‘install.img’ saved [527413248/527413248]
[root@pulp2 yum]# wget --no-check-certificate http://pulp2.dev/pulp/repos/centos8-baseos-ks/images/install.img
Saving to: ‘install.img.1’
100%[================================================================>] 527,413,248 768MB/s in 0.7s
2020-09-01 17:19:48 (768 MB/s) - ‘install.img.1’ saved [527413248/527413248]
[vagrant@pulp2 1794647]
I am going to reset and retry with a RHEL8 kickstart repo, assuming I can find/gain access to such a thing - but so far, this looks ok from Pulp2's side.
@lzap, @rplevka, am I missing something here?
Grant Gainey 2020-09-01 19:18:47 UTC
Pulp2 directory structure looks fine (i.e., "matches what I expect from looking at the treeinfo file") after synching RHEL8-baseos-kickstart repo from https://cdn.redhat.com/content/dist/rhel8/8.2/ppc64le/baseos/kickstart/ as well:
#!/bin/bash -v
BASE='rhel8-baseos-ks'
REMOTE1=https://cdn.redhat.com/content/dist/rhel8/8.2/ppc64le/baseos/kickstart/
pulp-admin rpm repo create --serve-http=true --repo-id=$BASE --relative-url=$BASE --feed=$REMOTE1 --download-policy immediate --feed-key ./cdn.pem --feed-cert ./cdn.pem --feed-ca-cert ./redhat-uep.pem
pulp-admin rpm repo sync run --repo-id=$BASE
[root@pulp2 yum]# pwd
/var/www/pub/yum
[root@pulp2 yum]# tree . | grep -v rpm
.
├── http
│ └── repos
│ ├── centos8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/centos8-baseos-ks/1598980046.23
│ ├── listing
│ └── rhel8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/rhel8-baseos-ks/1598986776.13
├── https
│ └── repos
│ ├── centos8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/centos8-baseos-ks/1598980046.23
│ ├── listing
│ └── rhel8-baseos-ks -> /var/lib/pulp/published/yum/master/yum_distributor/rhel8-baseos-ks/1598986776.13
└── master
└── yum_distributor
├── centos8-baseos-ks
│ └── 1598980046.23
│ ...
└── rhel8-baseos-ks
└── 1598986776.13
├── images
│ ├── boot.iso -> /var/lib/pulp/content/units/distribution/51/695f7a47d2bb8f43cfee8eb12a711e735c5093c52b7260e105f764cbf13e67/images/boot.iso
│ └── install.img -> /var/lib/pulp/content/units/distribution/51/695f7a47d2bb8f43cfee8eb12a711e735c5093c52b7260e105f764cbf13e67/images/install.img
├── install.img
├── Packages
│ ├── a
...
│ ├── z
├── ppc
│ └── ppc64
│ ├── initrd.img -> /var/lib/pulp/content/units/distribution/51/695f7a47d2bb8f43cfee8eb12a711e735c5093c52b7260e105f764cbf13e67/ppc/ppc64/initrd.img
│ └── vmlinuz -> /var/lib/pulp/content/units/distribution/51/695f7a47d2bb8f43cfee8eb12a711e735c5093c52b7260e105f764cbf13e67/ppc/ppc64/vmlinuz
├── repodata
│ ├── 3ea0cdd6c686aac3c2c3862b81ea7d9fa9a9d1e77a8c411ea4eb9f5a9dfc4991-filelists.xml.gz
│ ├── 4df08de286551a837c0da1088bda7f4c6c08bd7745ef2bf5173cbbf7a0a5f2fb-other.xml.gz
│ ├── 9b28aa4f2e4d9e018e13997182e1dd6a19f714f943605245cd45cd6e4c1eedc0-comps.xml
│ ├── 9cbea1d8ad5317e27521d78f729c68c1909b59f059b1b90f095eac83a657f895-productid.gz
│ ├── a41c1ebf9624fbd07f7d8e5b9ba91a3c60ae359d22de36db577333b8e4775abd-updateinfo.xml.gz
│ ├── cdf308b88cc57d936afcd37e6da6e70cbd97eef8c55d9628052c6507935f34c3-primary.xml.gz
│ └── repomd.xml
└── treeinfo -> /var/lib/pulp/content/units/distribution/51/695f7a47d2bb8f43cfee8eb12a711e735c5093c52b7260e105f764cbf13e67/treeinfo
76 directories, 5071 files
[root@pulp2 yum]# wget --no-check-certificate http://pulp2.dev/pulp/repos/rhel8-baseos-ks/images/install.img
Length: 527704064 (503M) [application/octet-stream]
Saving to: ‘install.img’
100%[================================================================>] 527,704,064 839MB/s in 0.6s
2020-09-01 19:14:55 (839 MB/s) - ‘install.img’ saved [527704064/527704064]
[root@pulp2 yum]# wget --no-check-certificate https://pulp2.dev/pulp/repos/rhel8-baseos-ks/images/install.img
Length: 527704064 (503M) [application/octet-stream]
Saving to: ‘install.img.1’
100%[================================================================>] 527,704,064 253MB/s in 2.0s
2020-09-01 19:15:04 (253 MB/s) - ‘install.img.1’ saved [527704064/527704064]
[root@pulp2 yum]#
Unless someone can show that Pulp is putting content in the wrong place, I'm going to say that whatever the problem is here, it isn't a Pulp2 problem.