Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Design data sample management #1150

Open
jrobinAV opened this issue Apr 10, 2024 · 1 comment
Open

Design data sample management #1150

jrobinAV opened this issue Apr 10, 2024 · 1 comment
Labels
🖧 Devops Operations, monitoring, maintenance, deployment, packaging 📄 Documentation Internal or public documentation ✨New feature 🟨 Priority: Medium Not blocking but should be addressed 🔒 Staff only Can only be assigned to the Taipy R&D team 🧪Testing Related to tests and other QA activities.

Comments

@jrobinAV
Copy link
Member

jrobinAV commented Apr 10, 2024

Taipy uses data sets for many purposes (documentation, templates, demos, tests, etc...).
With the blueprint functionality, the usage of data samples will increase.

Taipy must store, manage, expose, document, and maintain many datasets.

This issue aims to define, describe, and design this functionality into the following document:
https://docs.google.com/document/d/1NE5FJc3un1OCqHCzpmb9tYiPXBve-VXatm55WsmSivs/edit

@jrobinAV jrobinAV added ✨New feature 🧪Testing Related to tests and other QA activities. 🖧 Devops Operations, monitoring, maintenance, deployment, packaging 📄 Documentation Internal or public documentation labels Apr 10, 2024
@trgiangdo
Copy link
Member

We can store the dataset in Azure, along side its MD5.

When a dataset is pulled, the code needs to check if the dataset has existed, and its MD5 matches the one on cloud or not.

@jrobinAV jrobinAV added 🟨 Priority: Medium Not blocking but should be addressed 🔒 Staff only Can only be assigned to the Taipy R&D team labels May 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🖧 Devops Operations, monitoring, maintenance, deployment, packaging 📄 Documentation Internal or public documentation ✨New feature 🟨 Priority: Medium Not blocking but should be addressed 🔒 Staff only Can only be assigned to the Taipy R&D team 🧪Testing Related to tests and other QA activities.
Projects
None yet
Development

No branches or pull requests

2 participants