|
15:13 < bmbouter> ByteSore: not sure if you got an answer but on-demand causes the download to occur when a client is actually requesting it from pulp
|
|
15:14 < bmbouter> I don't expect it to be in /run/pulpcore-content though, I expect it to temporarily be stored in a working directory of /var/lib/pulp/... and then moved into it's final location in /var/lib/pulp/artifacts/...
|
|
15:15 < ByteSore> bmbouter: if i print the value of self.path in http.py it tells me it saves it in the /run/pulp-content/tmp<randomnr> file
|
|
15:16 < bmbouter> interesting ... what version of pulpcore do you have?
|
|
15:16 < ByteSore> What i'm trying to do is preventing the move of the file from whatever the tmp dir is to the artifact folder
|
|
15:16 < ByteSore> when a virus is found obviously..
|
|
15:20 < ByteSore> uh let me check.. hang on
|
|
15:20 < bmbouter> ByteSore: yup that makes sense ... unfortunately we'v enot considered a "user step" there so it's difficult to prevent pulp from making that content live right away
|
|
15:20 < bmbouter> aaaaaalso fyi the pulpcore content app streams the file immediately to the client so this filesystem business is for the "next" client request
|
|
15:21 < bmbouter> this is the difference of on-demand versus streamed, both serve immedaitely to this client, but on-demand also "saves it for next time"
|
|
15:21 < bmbouter> maybe we should look at some kind of a hook for your virus scanning?
|
|
15:21 < ByteSore> Uh yeah.. that would be nice
|
|
15:21 < bmbouter> but the issue is that for large files we need to hand out the bits to clients "streaming" as they arrive because otherwise a) we have to buffer large files in memory and b) it's slow
|
|
15:22 < bmbouter> slow meaning we can't handle the first bit until all bits are received
|
|
15:22 < bmbouter> one option you could very much do today is to use the immediate policy but you'll have to store everything locally
|
|
15:22 < bmbouter> you could sync it with immediate, have it not available to any clients, then virus scan all files, then have it made available to clients
|
|
15:23 < ByteSore> That's the whole reason we're moved to Pulp. Having 13TB of pypi data times 2 (1 for point in time + virusscan, 1 for live environment)
|
.