Skip to content

Add Model Captability class #3103

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
markpollack opened this issue May 11, 2025 · 0 comments
Open

Add Model Captability class #3103

markpollack opened this issue May 11, 2025 · 0 comments

Comments

@markpollack
Copy link
Member

Both #2787 and #2863 would benefit from having a Model Capability class that describes what functionality the model supports.

For the case of the reasoning models, this capability would enable one to copy the current systemMessage into a 'developerMessage' (as required by the o series of openai models) and for structured output one can switch to use the JSON mode vs. the current strategy of adding to the prompt the 'please convert my json` message.

There is a wide range of features that fall under this umbrella, so a good design is need. Multimodality is another one, we can proactively know that a request with Media would not be supported by a given model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant