[pull] 0.x from laravel:0.x#81
Merged
Merged
Conversation
* Add video file type Provide a Video file abstraction with base64, local, stored, and remote variants, mirroring the existing image, audio, and document types. This lets video content be handed to providers that accept it, using the same factory and serialization conventions as the other file types. * Add multimodal embeddings support Allow embeddings to be generated from non-text inputs such as images, audio, documents, and video, not just strings. Inputs are validated up front and normalized into deterministic cache keys so mixed and repeated requests cache correctly. Individual providers opt in to the media types they support in later changes. * Support multimodal embeddings for Gemini Route image, provider-file, and remote inputs through Gemini's embedContent endpoint so multimodal content can be embedded with the Embedding 2 models, while text continues to use batchEmbedContents. Provider files are resolved to their Gemini file URIs, which requires exposing the URI on file responses. * Support multimodal embeddings for Voyage AI Send image and video inputs to Voyage AI's multimodal embeddings endpoint, enforcing multimodal-capable models and requiring a single media source type per request as the API demands. Text-only requests keep using the standard embeddings endpoint. * Fix and simplify multimodal embeddings for Gemini and Voyage AI * Credit original multimodal embeddings implementation Co-Authored-By: Virgil Nilson <virgilnilson@gmail.com> --------- Co-authored-by: Pushpak Chhajed <pushpak1300@gmail.com> Co-authored-by: Virgil Nilson <virgilnilson@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot] (v2.0.0-alpha.4)
Can you help keep this open source service alive? 💖 Please sponsor : )