Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dandi-derived instance of DANDI? #172

Open
yarikoptic opened this issue Mar 27, 2024 · 4 comments
Open

dandi-derived instance of DANDI? #172

yarikoptic opened this issue Mar 27, 2024 · 4 comments

Comments

@yarikoptic
Copy link
Member

Given that there could be a multiverse (large number) of derived dandisets, especially if we automate that, would it make sense to create an explicitly separate DANDI instance with/for them?

attn @satra - let's discuss on some use cases (e.g. spike sorting for all ephys data on dandi)

@kabilar
Copy link
Member

kabilar commented May 2, 2024

Thanks Yarik. I would prefer to build this functionality into the DANDI Archive instance.

From a user perspective, having the data on the same platform would make it easier to navigate the original and derived Dandisets. We would need to spend time on the UI/UX to ensure that storing and navigating these derived Dandisets is streamlined.

@kabilar
Copy link
Member

kabilar commented May 3, 2024

OpenNeuro mentioned that they are going to follow the GitHub model and allow users to fork datasets. Do we want to consider a similar model?

@satra
Copy link
Member

satra commented May 3, 2024

this bit has a lot of different implications, and unlike openneuro datasets are much larger. this probably requires some discussion.

@yarikoptic
Copy link
Member Author

OpenNeuro mentioned that they are going to follow the GitHub model and allow users to fork datasets. Do we want to consider a similar model?

note that in their case, their underlying dataset model is a git repository on github: https://github.com/OpenNeuroDatasets are the "source" (not just replica like we have for https://github.com/dandisets). So they can allow forking and merging "natively" . Moreover people already do that (e.g. those on https://github.com/OpenNeuroDatasets-JSONLD). The question becomes for them just to facilitate that forking on github, track available forks, and possibly allow for accepting "patches" back.

For us it would be an entire new development and figuring out what it would mean and how to organize the flow of contributions back.... But in principle we could also enable something like that in the scope of

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants