-
Notifications
You must be signed in to change notification settings - Fork 41
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
AI: hyperparameter, metric, metricDecisionThreshold - can be multiple. Property talks about only one. #769
Comments
We decided for first release of AI BOM to keep it relatively simple, but true we should consider this functionality in 3.1. Do you have an use case / example of multiple hyperparameters in use (ideally an open source project).
On Thursday, May 9, 2024 at 07:13:23 a.m. EDT, VenkatTechnologist ***@***.***> wrote:
There could be multiple hyperparameters while training an AI model.
The property 'hyperparameter' talks about one value, and it's data type
is dictionary, which has minValue as 1 and maxValue as 1. How can we
accommodate multiple hyperparameters of an AI model in the AI profile
of SPDX?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>
|
Some real world, open source examples where multiple hyperparameters are used at once: Machine Learning:
Generative-AI:
|
Metrics used to assess and their associated thresholds can be multiple in machine learning as well as generative AI algorithms. Real world, Open source examples: Generative AI: StyleGAN2 - PyTorch (Generative Adversarial Networks): Fréchet Inception Distance (FID), Inception Score (IS), Human Evaluation Machine Learning: Scikit-learn Multi-Class Classification: Accuracy, Confusion Matrix, Precision and Recall, F1-Score |
On that note, it looks like we need a class called 'Dictionary' to list multiple hyperparameters, metrics, and metric thresholds. See #773. |
There could be multiple hyperparameters, metrics, and metricDecisionThresholds for an AI model.
The properties 'hyperparameter', 'metric' and 'metricDecisionThreshold' talk about only one value, and their class
is DictionaryEntry, which can hold only one key-pair. How can we accommodate multiple hyperparameters,
metrics, and metricDecisionThresholds of an AI model in the AI profile of SPDX?
The text was updated successfully, but these errors were encountered: