What is the best way to implement nestested configs with Pydantic Settings?

[matt3o]

Hey guys!
I am trying to move my current config code to Pydantic settings. However when trying it out I realized I have to create at least 3 submodels even for the small example above. This makes the code extremly complicated and does not really simplify the process since I now have ultra small data classes.
Is there any good way to solve this all within the Setttings class?

Current solution:

Settings:
    litellm: LiteLLMSettings
...
LiteLLMSettings:
    model_list: List[Model]
...
Model:
    model_name: str
    litellm_params: LiteLLMParams

LiteLLMParams:
    model: str
...

Preferred solution something like

Settings:
    litellm:
        model_list: List[Model]

Model:
    model_name: str
    litellm_params:
        model: ...
        api_key: ...

Thanks and have a great weekend,
Matthias

[krrishdholakia]

Hey @matt3o - litellm maintainer here - how can we help simplify this ?

[matt3o]

Hey Krish, most of this issue so far is outside of the scope of LiteLLM.
However, there is one thing we could talk about in the context of Pydantic, which is the naming of the settings. model_ is by default a protected name for all settings since Pydantic, see here for details.
As it is, model_name and model_list only raise warnings and don't lead to any crashes, still it might be good to change that to names which are fully compatible to LiteLLM.