Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reactivate provider DAGs #1661

Closed
18 of 20 tasks
AetherUnbound opened this issue Feb 3, 2022 · 1 comment
Closed
18 of 20 tasks

Reactivate provider DAGs #1661

AetherUnbound opened this issue Feb 3, 2022 · 1 comment
Assignees
@AetherUnbound @stacimc
Labels
🕹 aspect: interface Concerns end-users' experience with the software 🛠 goal: fix Bug fix 🟧 priority: high Stalls work on the project or its dependents 🔧 tech: airflow Involves Apache Airflow
Projects
Openverse

Comments

@AetherUnbound
Copy link
Contributor

AetherUnbound commented Feb 3, 2022 •
edited by stacimc

Description

Since migrating from Creative Commons, we have had very few providers running consistently. We would like to get these DAGs in a consistently operational state so that we are regularly ingesting data.

Providers

Edit: Providers are checked off when they have been reactivated. Failures/errors are tracked in the provider audit in #283

  • Jamendo
  • WordPress Photo Directory
  • Stocksnap
  • Freesound
  • Wikimedia commons
  • Brooklyn Museum
  • Cleveland Museum
  • Finnish Museums
  • Metropolitan Museum
  • Museum Victoria
  • NYPL
  • Phylopic
  • Raw Pixel
  • Science Museum
  • Smithsonian
  • Staten Museum
  • Walters
  • (DO NOT ENABLE) Europeana
  • (DO NOT ENABLE) Flickr

Additional context

This work is currently blocked pending WordPress/openverse-catalog#285

Implementation

  • 🙋 I would be interested in implementing this feature.
@AetherUnbound AetherUnbound added 🔧 tech: airflow Involves Apache Airflow 🕹 aspect: interface Concerns end-users' experience with the software 🛠 goal: fix Bug fix 🟧 priority: high Stalls work on the project or its dependents labels Feb 3, 2022
@AetherUnbound AetherUnbound mentioned this issue Apr 17, 2023
Closed
@AetherUnbound
Copy link
Contributor Author

I think we can close this for now - Flickr and Europeana will likely take some non-trivial extra work. Thank you @stacimc for your assistance with this!

@obulat obulat transferred this issue from WordPress/openverse-catalog Apr 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@AetherUnbound AetherUnbound

@stacimc stacimc

Labels
🕹 aspect: interface Concerns end-users' experience with the software 🛠 goal: fix Bug fix 🟧 priority: high Stalls work on the project or its dependents 🔧 tech: airflow Involves Apache Airflow
Projects
Openverse Backlog
Archived in project
Openverse
  
Done!
Milestone
No milestone
Development

No branches or pull requests
2 participants
@AetherUnbound @stacimc