You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Feb 25, 2022. It is now read-only.
@trieloff's idea to store (larger) data directly in the underlying storage would make the data processing faster, especially for larger data-sets.
suggest to:
content-bus generates a presigned url for the respective destination object
send request to content-proxy, including a presignedStorageUrl parameter
content-proxy sends along the presignedStorageUrl to data-embed, ideally using a PUT1
data-embed stores the .json directly in the storage using the presignedStorageUrl
data-embeds responds with a 3072, including a location header to the location of the stored object (if possible)
content-proxy returns the same
1 I'm not sure about using PUT or GET, but writing content on GET feels wrong 2 I'm not sure about the redirect response. maybe a 200 when using PUT is better.
The text was updated successfully, but these errors were encountered:
How do we handle multi-cloud? Run the trigger twice, in both clouds or have it generate multiple URLs?
for helix3, the content-bus needs to store the json into the s3/cs when requested (e.g. on preview). since the content-bus is the intitiator, the corresponding content-bus will invoke content-proxy/data-embed on the corresponding cloud which will store it in the corresponding storage.
so who ever trigger content-bus, needs to trigger it in all clouds...probably helix-admin or admin.hlx3.page
@trieloff's idea to store (larger) data directly in the underlying storage would make the data processing faster, especially for larger data-sets.
suggest to:
presignedStorageUrl
parameterpresignedStorageUrl
to data-embed, ideally using aPUT
1.json
directly in the storage using thepresignedStorageUrl
307
2, including alocation
header to the location of the stored object (if possible)1 I'm not sure about using
PUT
orGET
, but writing content onGET
feels wrong2 I'm not sure about the redirect response. maybe a
200
when usingPUT
is better.The text was updated successfully, but these errors were encountered: