Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

hlx admin #1973

Open
kptdobe opened this issue Apr 4, 2022 · 4 comments
Open

hlx admin #1973

kptdobe opened this issue Apr 4, 2022 · 4 comments
Labels
enhancement New feature or request

Comments

@kptdobe
Copy link
Contributor

kptdobe commented Apr 4, 2022

As part of the import process, there is the need to bulk preview / publish a lot of pages. Ideally we could do:

hlx admin --preview urls.xlsx // preview all urls from the URL column of the spreadsheet
hlx admin --preview --publish urls.xlsx // preview and publish all urls from the URL column of the spreadsheet
hlx admin --index 450 --preview --publish urls.xlsx // preview and publish all urls from the URL column of the spreadsheet starting at row 451 (row 1 = heading)

The cli would then deal with the concurrency (run 8 in parallel ?).

@kptdobe kptdobe added the enhancement New feature or request label Apr 4, 2022
@catalan-adobe
Copy link

catalan-adobe commented Mar 12, 2023

Hello, as a follow-up to a Slack thread about issues with https://thinktanked.org/tools/bulk/bulk.html (where too many API requests were done in parallel, causing 503s) I started working on some scripting for bulk preview/live operations and I ended up doing a node.js CLI: franklin-bulk.

Here is a demo:

franklin-bulk-cli-demo.mp4

Would there be an interest to get this feature contributed as new commands of the helix-cli?

Remark:

  • Concurrency is implemented using Node.js native threads

@tripodsan
Copy link
Contributor

tripodsan commented Mar 12, 2023

Concurrency is implemented using Node.js native threads

wow...looks complicated for something that is anyways async ;-)
you could use https://github.com/adobe/helix-shared/tree/main/packages/helix-shared-process-queue, which is a bit simpler to use ;-)

@morrisonjk
Copy link

What is the meaning of all this I don't really get it

@tripodsan
Copy link
Contributor

in the meantime we have the admin bulk api:
https://www.aem.live/docs/admin.html#tag/preview/operation/bulkPreview

@catalan-adobe I suggest you improve your tool to use that api. it drastically reduces the load on sharepoint

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants