Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature request/proposal: store backup #8

Open
fili opened this issue Oct 3, 2017 · 4 comments
Open

feature request/proposal: store backup #8

fili opened this issue Oct 3, 2017 · 4 comments

Comments

@fili
Copy link
Contributor

fili commented Oct 3, 2017

Can be interesting to also connect this to Google Cloud Storage and store all downloaded data into a Google Cloud Storage Bucket for later importing by other tools.

@TKorr
Copy link
Collaborator

TKorr commented Oct 4, 2017

good practice would be to directly store the queried data into a csv file, compress and store in Google Cloud Storage...then transfer the data into BigQuery.

This way there is always a backup and the data is separated from the DB solution which could be a saviour for when, inevitably Google decide to "change" something.

@fili
Copy link
Contributor Author

fili commented Oct 4, 2017

Agreed!

@jroakes
Copy link
Owner

jroakes commented Oct 4, 2017

I love that idea.

@jroakes
Copy link
Owner

jroakes commented Oct 5, 2017

I added both of you as collaborators. I normally write code for random SEO projects so could use some help with structuring the best process for organizing this repo for improvements (if you are able).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants