Project

Profile

Help

Story #4196

Updated by dkliban@redhat.com almost 4 years ago

Pulp needs to allow users to upload doesn't accept artifacts that are even somewhat large files in chunks. There is already a django project[0] out there that helps solve this problem. (nginx installation [from Pulp should integrate this into it's REST API.  

 django-chunked-upload does not currently work source](https://github.com/pulp/ansible-pulp3/blob/master/source-install.yml) doesn't even allow 1MB files!) 

 Reproduce: 

 http --form -a $AUTH POST $PULP_SRV/pulp/api/v3/artifacts/ file@/tmp/bigfile.txt 

 Actual: 
 <pre> 
 HTTP/1.1 413 Request Entity Too Large 
 Connection: close 
 Content-Length: 199 
 Content-Type: text/html 
 Date: Tue, 27 Nov 2018 18:41:55 GMT 
 Server: nginx/1.12.2 

 <html> 
 <head><title>413 Request Entity Too Large</title></head> 
 <body bgcolor="white"> 
 <center><h1>413 Request Entity Too Large</h1></center> 
 <hr><center>nginx/1.12.2</center> 
 </body> 
 </html> 
 </pre> 

 Expected (shown with S3, but there is a relatively small PR[1] to make it possible.  

 It would also be nice if the chunks could be uploaded in parallel, but that is not currently possible[2] with django-chunked-upload. 


 [0] https://github.com/juliomalegria/django-chunked-upload 512KB file): 
 [1] https://github.com/juliomalegria/django-chunked-upload/pull/39 <pre> 
 [2] https://github.com/juliomalegria/django-chunked-upload/issues/45 HTTP/1.1 201 Created 
 Allow: GET, POST, HEAD, OPTIONS 
 Connection: keep-alive 
 Content-Length: 672 
 Content-Type: application/json 
 Date: Tue, 27 Nov 2018 18:55:44 GMT 
 Location: /pulp/api/v3/artifacts/3/ 
 Server: nginx/1.12.2 
 Vary: Accept, Cookie 
 X-Frame-Options: SAMEORIGIN 

 { 
     "_href": "/pulp/api/v3/artifacts/3/", 
     "created": "2018-11-27T18:55:44.138585Z", 
     "file": "/var/lib/pulp/artifact/88/0b7d38ad800c590b76a2c55facac9eae7c3c531a76ae4390c91f332ce63d10", 
     "md5": "9a0e58b60fc16895249f59512953758d", 
     "sha1": "e5369613df3aad10c08ad2cfc9fa3c7533ad1804", 
     "sha224": "78596389d4e395a10c19ca4feeb05f447c98413efbaf5811b56288f1", 
     "sha256": "880b7d38ad800c590b76a2c55facac9eae7c3c531a76ae4390c91f332ce63d10", 
     "sha384": "e8c9e7385c1d8ce3e7bbe8f10ebb2c3ac5b6a4018ccd53e496163fe0b3c2e37fc3946ce7d748aa8864d4aa7b5901c17b", 
     "sha512": "d627b37f7eaa1b56cd1696efedddc959d4e8b18b4ee4edbdb1dba41215e4ffe397872f45178e9664a1a0de92f3258c1e5df0f5cd9d7e44efb0ef1d9d1ab17f9d", 
     "size": 524288 
 } 
 </pre>

Back