Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support training continuation (pretrained models) for teacher ensembles #542

Open
gregtatum opened this issue Apr 29, 2024 · 0 comments
Open
Labels
taskcluster Issues related to the Taskcluster implementation of the training pipeline

Comments

@gregtatum
Copy link
Member

The training_continuation.py doesn't correctly handle multiple URLs.

Steps to reproduce:

Set the config

experiment:
  pretrained-models:
    train-teacher:
      urls:
        - https://example.com/a
        - https://example.com/b
      mode: use
      type: default

Run task preflight-check

Open artifacts/full-task-graph.json.

Search for both example.com/a and example.com/b in the generated tasks. train-teacher-XX-XX-1/2 and train-teacher-XX-XX-2/2 both contain the same files, and the URLs aren't split between them.

@eu9ene eu9ene added the taskcluster Issues related to the Taskcluster implementation of the training pipeline label May 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
taskcluster Issues related to the Taskcluster implementation of the training pipeline
Projects
None yet
Development

No branches or pull requests

2 participants