Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make automatic process for the weekly dates parameters generation. #28

Open
zimzoom opened this issue Apr 24, 2023 · 2 comments
Open

Make automatic process for the weekly dates parameters generation. #28

zimzoom opened this issue Apr 24, 2023 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@zimzoom
Copy link
Collaborator

zimzoom commented Apr 24, 2023

Context:

  • Once a week, the Logic App calls the scraper by iterating over a list of parameters. The scraper is called with "start date" and "end date" parameters -- the Logic App calls it using 2 week increments, going back 5 years. This means that this list of date parameters needs to be re-generated every week.
  • Currently, the Python script that generates the array of data parameters is run manually on a dev's computer. It creates a json file, which is then manually uploaded to a specific container that the Logic App reads from.

Goal:

  • This needs to be an automated process rather than something that is run manually. The recommended way is: create a new Azure Function with a "timer trigger", set to go off once a week, that generates logic-app-dates.json and writes it to the container "logic-app-resource" (next to "case-html").
  • No changes need to be made to the Logic App, as long as it results in a json file with the same name, in the same container, with the same structure. ( [["2018-04-25", "2018-05-01"], ["2018-05-02", "2018-05-08"], ...(etc to present)... ]
  • Contact Luci for the dates generator python script and example json file.
@DevTrav DevTrav added the enhancement New feature or request label Apr 24, 2023
@tpadmanabhan
Copy link
Collaborator

Is this needed?

@tpadmanabhan
Copy link
Collaborator

@lianilychee need more background on this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: No status
Development

When branches are created from issues, their pull requests are automatically linked.

4 participants