Skip to content

LanguageModelExtraDataPart #246980

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
roblourens opened this issue Apr 19, 2025 · 0 comments
Open

LanguageModelExtraDataPart #246980

roblourens opened this issue Apr 19, 2025 · 0 comments
Assignees
@roblourens
Labels
api-proposal chat
Milestone
April 2025

Comments

@roblourens
Copy link
Member

This is a language model response part containing arbitrary model-specific data, returned from a LanguageModelChatResponse. It can be used to store data for prompt caching, thinking tokens, or anything else.

Maybe need a better name.

  • It's a bit similar to LanguageModelChatRequestOptions.modelOptions, but LanguageModelModelData is not very good
  • LanguageModelOpaqueData, as in prompt-tsx?
  • We use metadata for this sort of concept in some places?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@roblourens roblourens

Labels
api-proposal chat
Projects
None yet
Milestone
April 2025
Development

No branches or pull requests
1 participant
@roblourens