RPM Support

A katello user reported an issue with an on_demand repository. During kickstart he gets the error:

 16:45:42,449 INFO packaging: 323 packages selected totalling 1179.47 MiB
 16:45:42,496 INFO packaging: Running anaconda-yum to install packages
 16:45:42,996 INFO packaging:  populate transaction set
 16:54:15,002 ERR packaging:  error populating transaction after 10 retries: failure: tar-1.26-29.el7.x86_64.rpm from anaconda:

Watching the apache logs, the requests from anaconda look a bit strange:

        172.16.246.118 - - [21/Sep/2016:11:46:46 -0500] "GET /pulp/repos/Centric_Group/Library/custom/oel/o7ks/tar-1.26-29.el7.x86_64.rpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3"
        172.16.246.118 - - [21/Sep/2016:11:46:46 -0500] "GET /streamer/var/lib/pulp/content/units/rpm/9d/01dcf30886eea92cb007017bdb36159cddd565cd2a6d1cc9174eefadb63b86/tar-1.26-29.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMTgifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9ycG0vOWQvMDFkY2YzMDg4NmVlYTkyY2IwMDcwMTdiZGIzNjE1OWNkZGQ1NjVjZDJhNmQxY2M5MTc0ZWVmYWRiNjNiODYvdGFyLTEuMjYtMjkuZWw3Lng4Nl82NC5ycG0iLCAiZXhwaXJhdGlvbiI6IDE0NzQ0NzY0OTZ9;signature=CFuH5ePYDRkMqH4SEqdhisEE4eZo7ojCTVPpU7d96TRRXPPgl7p03yjs7jHKITZeoxHpnd2RMEyoTCWkmoq7RDMG419TJvjtisJ4N5-6BiXXz1DgCoyROxTIIWXI5LpM0ZAAZHY8Bv37IlY1jkrHz4Efwzx5bZYlENG7ylDiLjhwjiJ-eQzOTnzHPV_2zvwaFsYv2MmlCYhhzWTrX7IQZRxOSWRg5Wmn52tPpE7gnWFsOtwh51CUATIvpDJ_AEm0Y1R0TfeWMWy-riRYv9cWehMrOdXwGnY3eSjastmrhpVzU8P-tNhLTFbXhsfvXVHMu6UmrpTTfh-RB87eV8cwQg%3D%3D HTTP/1.1" 200 253952 "-" "urlgrabber/3.10 yum/3.4.3"

mainly the '253952' part. Every time a kickstart is attempted it seems to be a different size. All these sizes have been observed:

57344 143360 208896 282624 237568 262144 135168 73728 57344 49152 73728

curl'ing the rpm results in the file properly downloading and it being the correct size:

$ curl -vvvv -L http://katello.domain.com/pulp/repos/domain_Group/Library/custom/oel/o7ks/tar-1.26-29.el7.x86_64.rpm > /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0*   Trying 172.16.246.31...
* Connected to katello.domain.com (172.16.246.31) port 80 (#0)
> GET /pulp/repos/Domain_Group/Library/custom/oel/o7ks/tar-1.26-29.el7.x86_64.rpm HTTP/1.1
> Host: katello.domain.com
> User-Agent: curl/7.47.1
> Accept: */*
> 
< HTTP/1.1 302 FOUND
< Date: Wed, 21 Sep 2016 21:39:51 GMT
< Server: Apache/2.4.6 (CentOS)
< Content-Length: 0
< Location: http://katello.domain.com:80/streamer/var/lib/pulp/content/units/rpm/9d/01dcf30886eea92cb007017bdb36159cddd565cd2a6d1cc9174eefadb63b86/tar-1.26-29.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4yNDIifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9ycG0vOWQvMDFkY2YzMDg4NmVlYTkyY2IwMDcwMTdiZGIzNjE1OWNkZGQ1NjVjZDJhNmQxY2M5MTc0ZWVmYWRiNjNiODYvdGFyLTEuMjYtMjkuZWw3Lng4Nl82NC5ycG0iLCAiZXhwaXJhdGlvbiI6IDE0NzQ0OTQwODF9;signature=ccIk_3mWKbBQgY04tX7QW2Ns6F_9Uh6i_Uz1wAv1Vg_Vg3rvjZQ2LIXBq3cncjgLww-JA4nzcEJTX05hENClivxKKiQEOfWWlLZpdeyK7o4XLTf041whrpWa1xdYC8zwO99mIhKGxXsUuNozJ7c66ZrSy22h4YAgsS9-twBuzeqeI6a2D_MoIa9Z0G9IGN6zvYz7vsD_XCrEqfHEbYIE7UQiUm3zy5XvwM-kmiAHiIs3Fir8WZ4CBA_e1V_UhNgheXAmH5C7VLEkCi0f_PtB3jixtGdmH3oVlM9W1OtSyNOXuVmErWsgIBq-awLUWJ5S57DAvUyfmn56ug8U--zvKw%3D%3D
< Content-Type: text/html; charset=utf-8
< 
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
* Connection #0 to host katello.domain.com left intact
* Issue another request to this URL: 'http://katello.domain.com:80/streamer/var/lib/pulp/content/units/rpm/9d/01dcf30886eea92cb007017bdb36159cddd565cd2a6d1cc9174eefadb63b86/tar-1.26-29.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4yNDIifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9ycG0vOWQvMDFkY2YzMDg4NmVlYTkyY2IwMDcwMTdiZGIzNjE1OWNkZGQ1NjVjZDJhNmQxY2M5MTc0ZWVmYWRiNjNiODYvdGFyLTEuMjYtMjkuZWw3Lng4Nl82NC5ycG0iLCAiZXhwaXJhdGlvbiI6IDE0NzQ0OTQwODF9;signature=ccIk_3mWKbBQgY04tX7QW2Ns6F_9Uh6i_Uz1wAv1Vg_Vg3rvjZQ2LIXBq3cncjgLww-JA4nzcEJTX05hENClivxKKiQEOfWWlLZpdeyK7o4XLTf041whrpWa1xdYC8zwO99mIhKGxXsUuNozJ7c66ZrSy22h4YAgsS9-twBuzeqeI6a2D_MoIa9Z0G9IGN6zvYz7vsD_XCrEqfHEbYIE7UQiUm3zy5XvwM-kmiAHiIs3Fir8WZ4CBA_e1V_UhNgheXAmH5C7VLEkCi0f_PtB3jixtGdmH3oVlM9W1OtSyNOXuVmErWsgIBq-awLUWJ5S57DAvUyfmn56ug8U--zvKw%3D%3D'
* Found bundle for host katello.domain.com: 0x55abc3b5d4c0 [can pipeline]
* Re-using existing connection! (#0) with host katello.domain.com
* Connected to katello.domain.com (172.16.246.31) port 80 (#0)
> GET /streamer/var/lib/pulp/content/units/rpm/9d/01dcf30886eea92cb007017bdb36159cddd565cd2a6d1cc9174eefadb63b86/tar-1.26-29.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4yNDIifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9ycG0vOWQvMDFkY2YzMDg4NmVlYTkyY2IwMDcwMTdiZGIzNjE1OWNkZGQ1NjVjZDJhNmQxY2M5MTc0ZWVmYWRiNjNiODYvdGFyLTEuMjYtMjkuZWw3Lng4Nl82NC5ycG0iLCAiZXhwaXJhdGlvbiI6IDE0NzQ0OTQwODF9;signature=ccIk_3mWKbBQgY04tX7QW2Ns6F_9Uh6i_Uz1wAv1Vg_Vg3rvjZQ2LIXBq3cncjgLww-JA4nzcEJTX05hENClivxKKiQEOfWWlLZpdeyK7o4XLTf041whrpWa1xdYC8zwO99mIhKGxXsUuNozJ7c66ZrSy22h4YAgsS9-twBuzeqeI6a2D_MoIa9Z0G9IGN6zvYz7vsD_XCrEqfHEbYIE7UQiUm3zy5XvwM-kmiAHiIs3Fir8WZ4CBA_e1V_UhNgheXAmH5C7VLEkCi0f_PtB3jixtGdmH3oVlM9W1OtSyNOXuVmErWsgIBq-awLUWJ5S57DAvUyfmn56ug8U--zvKw%3D%3D HTTP/1.1
> Host: katello.domain.com
> User-Agent: curl/7.47.1
> Accept: */*
> 
< HTTP/1.1 200 OK
< Date: Wed, 21 Sep 2016 21:39:51 GMT
< Server: TwistedWeb/12.2.0
< Content-Type: text/html; charset=UTF-8
< X-Cache: MISS from katello.domain.com
< X-Cache-Lookup: MISS from katello.domain.com:3128
< Via: 1.1 katello.domain.com (squid/3.3.8)
< Via: 1.1 katello.domain.com
< Vary: Accept-Encoding
< Transfer-Encoding: chunked
< 
{ [12312 bytes data]
100  841k    0  841k    0     0  20.2M      0 --:--:-- --:--:-- --:--:-- 20.2M
* Connection #0 to host katello.domain.com left intact

Notice that the Content-Type coming from the server is 'Content-Type: text/html; charset=UTF-8'. Which does not seem correct. When i try it on my server I get "Content-Type: application/x-rpm".

In addition I have a tcpdump of the kickstart starting. Its ~270 MB in size, so i won't upload it here. I am uploading a trimmed version showing just this one file request (at least the initial part).

The kickstart in question is Oracle Linux 7.2