{ "id": "resp_5810813e-99b9-427a-8736-23cf34573627", "object": "completion", "model": "gemini:gemini-2.5-flash", "created_at": 1767093284, "status": "completed", "choices": [ { "text": "This video demonstrates the effects of vacuum on three different states of oranges.\n\n1. **Setup**: Three orange-related items are placed in a vacuum chamber: a whole orange", "index": 0 } ], "usage": { "input_tokens": 16983, "output_tokens": 37, "total_tokens": 17020 }, "meta": { "provider": "gemini", "provider_model": "gemini-2.5-flash" }}
Video Model APIs
Gemini Video
Generate chat completions using Gemini VLM model with text, video, and image inputs.
{ "id": "resp_5810813e-99b9-427a-8736-23cf34573627", "object": "completion", "model": "gemini:gemini-2.5-flash", "created_at": 1767093284, "status": "completed", "choices": [ { "text": "This video demonstrates the effects of vacuum on three different states of oranges.\n\n1. **Setup**: Three orange-related items are placed in a vacuum chamber: a whole orange", "index": 0 } ], "usage": { "input_tokens": 16983, "output_tokens": 37, "total_tokens": 17020 }, "meta": { "provider": "gemini", "provider_model": "gemini-2.5-flash" }}
Product: Visual Intelligence — Video Model APIs (atomic)
Use case: Call a Video Language Model (Gemini / Nova / Qwen) directly with your own prompt. Full control over model selection, prompt, and parameters. For ready-made tasks (no prompt needed), see Video Task APIs.
Host: https://mavi-backend.memories.ai/serve/api/v2Auth: Authorization: sk-mavi-... (no Bearer prefix)
This endpoint allows you to generate chat completions with text, video, and image inputs using Gemini VLM model.
Endpoint:POST https://mavi-backend.memories.ai/serve/api/v2/vu/chat/completionsVideo Understanding (VLM) endpoints use the /vu path prefix. Image Understanding (ILM) endpoints use /iu instead.
Array of message objects. Each message contains: - role: Role type, values: system, user, assistant - content: Message content. A plain string is accepted for text-only turns, but must be an array as soon as you include a video or image — passing a bare string with an input_file intent silently drops the media and the upstream model rejects the call with status: "errored". Array items can contain: - type: Content type, text or input_file - text: Text content (when type is text) - file_uri: File URL or base64 encoded file (when type is input_file). Note: video does not support base64 - mime_type: MIME type of the file (e.g., image/jpeg, video/mp4)
temperature
number
No
0.7
Controls randomness: 0.0-2.0, higher = more random
max_tokens
integer
No
1000
Maximum number of tokens to generate
top_p
number
No
1.0
Nucleus sampling: 0.0-1.0, consider tokens with top_p probability mass
frequency_penalty
number
No
0.0
Reduces repetition of frequent tokens: -2.0 to 2.0
presence_penalty
number
No
0.0
Increases likelihood of new topics: -2.0 to 2.0
n
integer
No
1
Number of completions to generate
stream
boolean
No
false
Whether to stream the response
stop
string | array | null
No
null
Stop sequences. Can be a string, array of strings, or null
extra_body
object
No
-
Additional body parameters. Contains: - metadata: Metadata object - thinking_config: Thinking configuration - thinking_budget: Integer value for thinking budget - response_mime_type: Response MIME type (application/json or json_schema) - responseSchema: JSON schema object for structured output
from openai import OpenAIclient = OpenAI( api_key="sk-mavi-...", base_url="https://mavi-backend.memories.ai/serve/api/v2/vu")def call_my_vlm(): resp = client.chat.completions.create( model="gemini:gemini-2.5-flash", # e.g. gemini:gemini-3-flash-preview or gemini:gemini-2.5-flash messages=[ {"role": "system", "content": "You are a multimodal assistant. Keep your answers concise."}, { "role": "user", "content": [ { "type": "text", "text": "Please summarize the content of this video and image" }, { "type": "input_file", "file_uri": "https://storage.googleapis.com/memories-test-data/gun5.png", # base64 or url, video does not support base64 "mime_type": "image/jpeg" }, { "type": "input_file", "file_uri": "https://storage.googleapis.com/memories-test-data/test_1min.mp4", # base64 or url, video does not support base64 "mime_type": "video/mp4" } ] } ], temperature=0.7, # Controls randomness: 0.0-2.0, higher = more random max_tokens=1000, # Maximum number of tokens to generate top_p=1.0, # Nucleus sampling: 0.0-1.0, consider tokens with top_p probability mass frequency_penalty=0.0, # -2.0 to 2.0, reduces repetition of frequent tokens presence_penalty=0.0, # -2.0 to 2.0, increases likelihood of new topics n=1, # Number of completions to generate stream=False, # Whether to stream the response stop=None, # Stop sequences (list of strings) extra_body={ "metadata": { "thinking_config": { "thinking_budget": 1024 }, "response_mime_type": "application/json", # application/json, json_schema "responseSchema": { "type": "OBJECT", "properties": { "video_summary": { "type": "STRING", "description": "Summary of the video content from 1 second to 8 seconds." }, "image_summary": { "type": "STRING", "description": "Summary of the image content." } }, "required": [ "video_summary", "image_summary" ] } } } ) return resp# Usage exampleresult = call_my_vlm()print(result)
Returns the chat completion response with structured output.
{ "id": "resp_5810813e-99b9-427a-8736-23cf34573627", "object": "completion", "model": "gemini:gemini-2.5-flash", "created_at": 1767093284, "status": "completed", "choices": [ { "text": "This video demonstrates the effects of vacuum on three different states of oranges.\n\n1. **Setup**: Three orange-related items are placed in a vacuum chamber: a whole orange", "index": 0 } ], "usage": { "input_tokens": 16983, "output_tokens": 37, "total_tokens": 17020 }, "meta": { "provider": "gemini", "provider_model": "gemini-2.5-flash" }}
Two real behaviours to handle when you use extra_body.metadata.response_mime_type = "application/json":
Gemini frequently wraps its JSON output in ```json ... ``` markdown code fences. Strip them before json.loads.
On long videos with a strict schema, Gemini occasionally loops — emitting the same set of entries repeatedly until it hits max_tokens and the JSON is left unclosed. Tolerate this by closing the array at the last complete } and deduplicating client-side.
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"Memories.ai API","colors":{"primary":"#5026A4","light":"#A78BFA","dark":"#5026A4"},"logo":{"light":"https://mintcdn.com/memories/xyhRN3OJaXxxzcxh/logo/logo.png?fit=max\u0026auto=format\u0026n=xyhRN3OJaXxxzcxh\u0026q=85\u0026s=77ec93feefafd5196ff9c2b10130af40","dark":"https://mintcdn.com/memories/xyhRN3OJaXxxzcxh/logo/logo.png?fit=max\u0026auto=format\u0026n=xyhRN3OJaXxxzcxh\u0026q=85\u0026s=77ec93feefafd5196ff9c2b10130af40"},"favicon":"https://mintcdn.com/memories/OotoxKsfqNLDNzcT/favicon.svg?fit=max\u0026auto=format\u0026n=OotoxKsfqNLDNzcT\u0026q=85\u0026s=bc23cbb454306f09fc68c20f6551c691","api":{"openapi":["datalake/openapi.json","visual-intelligence/openapi.json","visual-intelligence/base/openapi.json","visual-intelligence/transcript/openapi.json","visual-intelligence/embeddings/openapi.json","visual-intelligence/stream/openapi.json","visual-intelligence/stream/understanding-openapi.json","visual-intelligence/scraper/openapi.json","visual-intelligence/video-metadata-transcript/openapi.json","visual-intelligence/gemini/openapi.json","visual-intelligence/gpt/openapi.json","visual-intelligence/nova/openapi.json","visual-intelligence/qwen/openapi.json","visual-search/openapi.json","visual-agents/openapi.json","visual-agents/screenplay/openapi.json"],"playground":{"display":"interactive","proxy":false}},"navbar":{"links":[{"href":"mailto:support@memories.ai","label":"Tech Support"},{"href":"https://memories.ai/contact-sales","label":"Contact Sales"},{"href":"https://discord.gg/kStNGZ7Q","label":"Discord"},{"href":"https://github.com/Memories-ai-labs/memories-cli","label":"Memories CLI"},{"href":"https://console.memories.ai","label":"Console"}]},"footer":{"socials":{"twitter":"https://twitter.com/memories_ai","github":"https://github.com/memories-ai","linkedin":"https://www.linkedin.com/company/memories-ai"}},"fonts":{"heading":{"family":"Manrope"},"body":{"family":"Manrope"}},"icons":{"library":"lucide"},"contextual":{"options":["copy","view","chatgpt","claude"],"display":"header"},"styling":{"latex":true},"navigation":{"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"memories","hasAudioNarration":false,"actualSubdomain":"memories","customDomains":["docs.memories.ai"],"gitSource":{"type":"github","owner":"memories-ai-official","repo":"mintlify-docs","deployBranch":"main","contentDirectory":"","isPrivate":true,"mountPath":"","label":""},"entitlements":{},"buildId":"6aee8cd47e56ae076de71b34","clientVersion":"0.0.4117","searchFilterCounts":[{"language":"default","tag":"Visual Intelligence","count":61},{"language":"default","tag":"API Reference","count":41},{"language":"default","tag":"Visual Search","count":39},{"language":"default","tag":"Visual Agents","count":24},{"language":"default","tag":"Social Media Scraping","count":19},{"language":"default","tag":"Search","count":11},{"language":"default","tag":"Get Started","count":10},{"language":"default","tag":"Index Upload","count":10},{"language":"default","tag":"Moments \u0026 Derived Content","count":9},{"language":"default","tag":"Videos","count":9}]},"assistantConfig":{"enableAskAiButton":false,"enableStarterQuestions":false,"enableAskAiSearchBar":true},"basePath":"","hasChatPermissions":false,"hasWebMcpPermissions":false,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-rbac-roles","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"rbac-expansion","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-metadata","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-serve","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"live-agents","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":true},"customCss":[{"filePath":"style.css","content":"@layer properties, theme, base, components, utilities;.mdx-content a.link{color:rgb(var(--primary))}.dark .mdx-content a.link{color:rgb(var(--primary-light))}ul.sidebar-group li[data-active=\"true\"]>a,ul.sidebar-group a[aria-current=\"page\"]{background-color:rgb(24 24 27 / 0.05);color:#18181b;text-shadow:none;font-weight:600}.dark ul.sidebar-group li[data-active=\"true\"]>a,.dark ul.sidebar-group a[aria-current=\"page\"]{background-color:rgb(250 250 250 / 0.06);color:#fafafa}.mobile-nav-tabs-item[data-active=\"true\"],.mobile-nav-tabs-item[data-active=\"true\"] svg{color:#18181b}.dark .mobile-nav-tabs-item[data-active=\"true\"],.dark .mobile-nav-tabs-item[data-active=\"true\"] svg{color:#fafafa}ul.sidebar-group,ul.sidebar-group ul{border-left:1px solid rgb(24 24 27 / 0.15);margin-left:0.5rem;padding-left:0.5rem}.dark ul.sidebar-group,.dark ul.sidebar-group ul{border-left-color:rgb(250 250 250 / 0.18)}.eyebrow{display:none}@media (min-width: 1280px){html[data-current-path=\"/home/overview\"] nav:has(ul.sidebar-group),html[data-current-path=\"/home/overview\"] div[class*=\"w-[18rem]\"]:has(ul.sidebar-group){display:none}html[data-current-path=\"/home/overview\"] .flex-row-reverse{flex-direction:row;column-gap:0}html[data-current-path=\"/home/overview\"] .flex-row-reverse>div:last-child{padding-left:2.7rem;margin-left:0;width:100%}}html[data-current-path=\"/home/overview\"] div.pl-10:has(ul.toc){padding-left:0.5rem;width:18rem}html[data-current-path=\"/home/overview\"] div.sticky:has(ul.toc){top:calc(\n var(--mintlify-slot-header-height, calc(4rem + var(--topbar-tabs-height, 0rem))) + 2rem\n );height:calc(100vh - 9rem);margin-top:-0.5rem}html[data-current-path=\"/home/overview\"] div[class*=\"w-[16.5rem]\"]:has(ul.toc){width:15.5rem}html[data-current-path=\"/home/overview\"] ul.toc{--toc-pad: 0.5rem;border-left-color:rgb(24 24 27 / 0.15)}html.dark[data-current-path=\"/home/overview\"] ul.toc{border-left-color:rgb(250 250 250 / 0.18)}html[data-current-path=\"/home/overview\"] ul.toc li.toc-item>a{padding:0.375rem 0.75rem 0.375rem 1rem!important}html[data-current-path=\"/home/overview\"] ul.toc li.toc-item+li.toc-item,html[data-current-path=\"/home/overview\"] ul.toc ul li.toc-item:first-child{margin-top:1px}html[data-current-path=\"/home/overview\"] ul.toc ul li.toc-item>a{margin-left:1rem}html[data-current-path=\"/home/overview\"] ul.toc ul ul li.toc-item>a{margin-left:2rem}html[data-current-path=\"/home/overview\"] li.toc-item[data-active]::before{display:none}html[data-current-path=\"/home/overview\"] li.toc-item[data-active]:not(:has(.toc-item[data-active]))>a{background-color:rgb(24 24 27 / 0.05);border-radius:0.75rem;color:#18181b;font-weight:600}html.dark[data-current-path=\"/home/overview\"] li.toc-item[data-active]:not(:has(.toc-item[data-active]))>a{background-color:rgb(250 250 250 / 0.06);color:#fafafa}html[data-current-path=\"/home/overview\"] [data-mai-toc-heading]{padding-left:0.5rem;margin-bottom:0.625rem;font-weight:600;color:rgb(25 23 27)}html.dark[data-current-path=\"/home/overview\"] [data-mai-toc-heading]{color:rgb(224 223 227)}.nav-tabs-item,.nav-tabs-item *,ul.toc li.toc-item>a{text-shadow:none}.nav-tabs-item[aria-current=\"page\"],.nav-tabs-item[data-active=\"true\"],.nav-tabs-item:has(div[class*=\"bg-primary\"]){font-weight:600}.nav-tabs-item div[class*=\"bg-primary\"]{background-color:#1a1a1e}.dark .nav-tabs-item div[class*=\"bg-primary\"]{background-color:#fafafa}ul.toc{--toc-pad: 1rem;border-left:1px solid rgb(24 24 27 / 0.15);padding-left:var(--toc-pad);margin-left:0}.dark ul.toc{border-left-color:rgb(250 250 250 / 0.18)}li.toc-item{position:relative}li.toc-item[data-active]:not(:has(.toc-item[data-active]))::before{content:\"\";position:absolute;left:calc(-1 * var(--toc-pad) - 1px);top:0.15rem;bottom:0.15rem;width:2px;border-radius:2px;background-color:#18181b}.dark li.toc-item[data-active]:not(:has(.toc-item[data-active]))::before{background-color:#fafafa}li.toc-item[data-active]:not(:has(.toc-item[data-active]))>a,ul.toc a[aria-current=\"location\"]{color:#18181b;font-weight:600}.dark li.toc-item[data-active]:not(:has(.toc-item[data-active]))>a,.dark ul.toc a[aria-current=\"location\"]{color:#fafafa}li.toc-item[data-active]:has(.toc-item[data-active])>a{color:rgb(82 81 85);text-shadow:none}.dark li.toc-item[data-active]:has(.toc-item[data-active])>a{color:rgb(160 159 163)}[data-mai-toc-heading] svg{display:none}[data-mai-toc-heading]>:not(svg){margin-left:0!important}@layer components{.card.card:hover,.card.card:focus,.card.card:focus-within,.card.card:focus-visible,.card.card[data-active]{border-color:rgb(24 24 27 / 0.25)!important}.dark .card.card:hover,.dark .card.card:focus,.dark .card.card:focus-within,.dark .card.card:focus-visible,.dark .card.card[data-active]{border-color:rgb(250 250 250 / 0.25)!important}}.card [style*=\"mask-image\"]{background-color:#27272a}.dark .card [style*=\"mask-image\"]{background-color:#d4d4d8}[style*=\"mask-image\"]{-webkit-mask-size:contain!important;mask-size:contain!important}details.accordion>summary:hover{background-color:rgb(24 24 27 / 0.05)}.dark details.accordion>summary:hover{background-color:rgb(250 250 250 / 0.06)}.card:hover [class*=\"group-hover:text-primary\"],.card:hover [class*=\"group-hover:fill-primary\"]{color:#27272a;fill:#27272a}.dark .card:hover [class*=\"group-hover:text-primary\"],.dark .card:hover [class*=\"group-hover:fill-primary\"]{color:#d4d4d8;fill:#d4d4d8}code:not(pre *){background-color:rgb(24 24 27 / 0.06);border-color:rgb(24 24 27 / 0.10)}.dark code:not(pre *){background-color:rgb(250 250 250 / 0.08);border-color:rgb(250 250 250 / 0.14)}.code-group{border-color:transparent;background-color:rgb(24 24 27 / 0.05)}.dark .code-group{border-color:transparent;background-color:rgb(250 250 250 / 0.05)}.code-group [role=\"tab\"][aria-selected=\"true\"]{color:#18181b}.dark .code-group [role=\"tab\"][aria-selected=\"true\"]{color:#fafafa}.code-group [role=\"tab\"]:hover>div{background-color:rgb(24 24 27 / 0.05);color:#18181b}.dark .code-group [role=\"tab\"]:hover>div{background-color:rgb(250 250 250 / 0.06);color:#fafafa}.code-group [role=\"tab\"] div[class*=\"bg-primary\"]{background-color:#18181b}.dark .code-group [role=\"tab\"] div[class*=\"bg-primary\"]{background-color:#fafafa}.callout[class*=\"border-yellow\"]{border-color:#e8930c;background-color:color-mix(in oklab, #e8930c 8%, var(--background, #fff))}.dark .callout[class*=\"border-yellow\"]{background-color:color-mix(in oklab, #e8930c 20%, transparent)}.callout[class*=\"border-green\"]{border-color:#17a34a;background-color:color-mix(in oklab, #17a34a 8%, var(--background, #fff))}.dark .callout[class*=\"border-green\"]{background-color:color-mix(in oklab, #17a34a 20%, transparent)}.callout[class*=\"border-red\"]{border-color:#e11d2e;background-color:color-mix(in oklab, #e11d2e 8%, var(--background, #fff))}.dark .callout[class*=\"border-red\"]{background-color:color-mix(in oklab, #e11d2e 20%, transparent)}[role=\"menuitemradio\"][aria-checked=\"true\"],[role=\"menuitem\"][data-active=\"true\"],[role=\"menuitem\"][aria-selected=\"true\"]{color:#18181b}.dark [role=\"menuitemradio\"][aria-checked=\"true\"],.dark [role=\"menuitem\"][data-active=\"true\"],.dark [role=\"menuitem\"][aria-selected=\"true\"]{color:#fafafa}[role=\"menuitemradio\"][aria-checked=\"true\"] svg[class*=\"text-primary\"],[role=\"menuitem\"][data-active=\"true\"] svg[class*=\"text-primary\"],[role=\"menuitem\"][aria-selected=\"true\"] svg[class*=\"text-primary\"]{color:#18181b}.dark [role=\"menuitemradio\"][aria-checked=\"true\"] svg[class*=\"text-primary\"],.dark [role=\"menuitem\"][data-active=\"true\"] svg[class*=\"text-primary\"],.dark [role=\"menuitem\"][aria-selected=\"true\"] svg[class*=\"text-primary\"]{color:#fafafa}[role=\"menuitemradio\"][aria-checked=\"true\"] svg[class*=\"text-primary\"],[role=\"menuitemradio\"][aria-checked=\"true\"] svg[class*=\"text-primary\"] *,[role=\"menuitem\"][data-active=\"true\"] svg[class*=\"text-primary\"],[role=\"menuitem\"][data-active=\"true\"] svg[class*=\"text-primary\"] *,[role=\"menuitem\"][aria-selected=\"true\"] svg[class*=\"text-primary\"],[role=\"menuitem\"][aria-selected=\"true\"] svg[class*=\"text-primary\"] *{stroke-width:1.75}.code-group [class*=\"hover:text-primary\"]:hover{color:#18181b}.dark .code-group [class*=\"hover:text-primary\"]:hover{color:#fafafa}[role=\"menuitemradio\"]:not(.contact-dropdown-item):hover,[role=\"menuitem\"]:not(.contact-dropdown-item):hover{color:#18181b;background-color:rgb(24 24 27 / 0.05)}.dark [role=\"menuitemradio\"]:not(.contact-dropdown-item):hover,.dark [role=\"menuitem\"]:not(.contact-dropdown-item):hover{color:#fafafa;background-color:rgb(250 250 250 / 0.06)}button.tryit-button{background-color:#1a1a1e;color:#ffffff}.dark button.tryit-button{background-color:#fafafa;color:#1a1a1e}.contact-dropdown{position:relative}@media (min-width: 1024px){li.navbar-link:has(>a[href^=\"mailto:support@memories.ai\"]),li.navbar-link:has(>a[href*=\"memories.ai/contact-sales\"]),li.navbar-link:has(>a[href*=\"discord.gg\"]),li.navbar-link:not(.cli-nav):has(>a[href*=\"github.com/Memories-ai-labs/memories-cli\"]),li.navbar-link:not(.console-nav):has(>a[href*=\"console.memories.ai\"]){display:none}}div[role=\"presentation\"][class~=\"lg:hidden\"] [role=\"dialog\"] button[class~=\"top-1.5\"][class~=\"right-1.5\"]{display:none}li.contact-dropdown,li.cli-nav,li.console-nav{margin-left:0!important;margin-inline-start:0!important;margin-right:0.5rem!important;margin-inline-end:0.5rem!important}.cli-button{display:inline-flex;align-items:center;gap:0.4rem;padding:0.3125rem 0.75rem;border-radius:0.75rem;border:1px solid rgb(24 24 27 / 0.15);font-size:0.875rem;font-weight:500;white-space:nowrap;color:#27272a;text-decoration:none;transition:background-color 0.12s ease, border-color 0.12s ease, color 0.12s ease}.cli-button:hover{background-color:rgb(24 24 27 / 0.05);border-color:rgb(24 24 27 / 0.25);color:#18181b}.dark .cli-button{border-color:rgb(250 250 250 / 0.18);color:#d4d4d8}.dark .cli-button:hover{background-color:rgb(250 250 250 / 0.06);border-color:rgb(250 250 250 / 0.3);color:#fafafa}@property --cli-border-angle{syntax:\"\u003cangle>\";initial-value:0deg;inherits:false}@keyframes cli-border-spin{to{--cli-border-angle: 360deg}}.cli-button:not(.console-button){position:relative;border-color:transparent}.cli-button:not(.console-button)::before{content:\"\";position:absolute;inset:0;border-radius:inherit;padding:1px;background:conic-gradient(\n from var(--cli-border-angle),\n #8f77e8 0deg,\n #7b8fe8 60deg,\n #6d8ce8 120deg,\n #74c9a6 150deg,\n #cfe6cf 170deg,\n #f0ddc9 190deg,\n #f2cdbe 205deg,\n #9fd6c8 222deg,\n #7b9be8 300deg,\n #8f77e8 360deg\n );-webkit-mask:linear-gradient(#000 0 0) content-box,\n linear-gradient(#000 0 0);-webkit-mask-composite:xor;mask:linear-gradient(#000 0 0) content-box,\n linear-gradient(#000 0 0);mask-composite:exclude;animation:cli-border-spin 4s linear infinite;pointer-events:none}.cli-button:not(.console-button):hover{border-color:transparent}.cli-button:not(.console-button):hover::before{filter:saturate(1.25) brightness(1.05)}@media (prefers-reduced-motion: reduce){.cli-button:not(.console-button)::before{animation:none}}.pagination-chevron-btn{display:inline-flex;align-items:center;justify-content:center;flex-shrink:0;width:2rem;height:2rem;border:1px solid rgb(24 24 27 / 0.15);border-radius:0.75rem;color:#52525b;transition:background-color 0.12s ease, border-color 0.12s ease, color 0.12s ease}.group:hover .pagination-chevron-btn{background-color:rgb(24 24 27 / 0.05);border-color:rgb(24 24 27 / 0.25);color:#18181b}.dark .pagination-chevron-btn{border-color:rgb(250 250 250 / 0.18);color:#a1a1aa}.dark .group:hover .pagination-chevron-btn{background-color:rgb(250 250 250 / 0.06);border-color:rgb(250 250 250 / 0.3);color:#fafafa}.contact-dropdown-trigger{display:inline-flex;align-items:center;gap:0.3rem;margin:0;padding:0.3125rem 0.75rem;border:1px solid transparent;border-radius:0.75rem;background:transparent;font-size:0.875rem;font-weight:500;line-height:1.25rem;color:#27272a;cursor:pointer;transition:background-color 0.12s ease, color 0.12s ease}.contact-dropdown-trigger:hover,.contact-dropdown.is-open .contact-dropdown-trigger{background-color:rgb(24 24 27 / 0.05);color:#18181b}.dark .contact-dropdown-trigger{color:#d4d4d8}.dark .contact-dropdown-trigger:hover,.dark .contact-dropdown.is-open .contact-dropdown-trigger{background-color:rgb(250 250 250 / 0.06);color:#fafafa}.theme-preference-menu-trigger,button[data-component-name=\"theme-toggle\"]{border-radius:0.75rem;transition:background-color 0.12s ease, color 0.12s ease}.theme-preference-menu-trigger:hover,button[data-component-name=\"theme-toggle\"]:hover{background-color:rgb(24 24 27 / 0.05)}.dark .theme-preference-menu-trigger:hover,.dark button[data-component-name=\"theme-toggle\"]:hover{background-color:rgb(250 250 250 / 0.06)}.contact-dropdown-chevron{transition:transform 0.15s ease}.contact-dropdown.is-open .contact-dropdown-chevron{transform:rotate(180deg)}.contact-dropdown-menu{display:none;position:absolute;top:calc(100% + 0.5rem);left:0;z-index:50;min-width:12rem;padding:0.375rem;border-radius:0.75rem;background-color:#ffffff;border:1px solid rgb(24 24 27 / 0.1);box-shadow:0 0 2px rgb(24 24 27 / 0.08), 0 0 10px rgb(24 24 27 / 0.08)}.contact-dropdown.is-open .contact-dropdown-menu{display:block}.dark .contact-dropdown-menu{background-color:#18181b;border-color:rgb(250 250 250 / 0.1);box-shadow:0 0 0 1px rgb(255 255 255 / 0.04), 0 0 10px rgb(0 0 0 / 0.4)}.contact-dropdown-item{display:flex;align-items:center;gap:0.5rem;padding:0.5rem 0.625rem;border-radius:0.5rem;font-size:0.875rem;font-weight:500;white-space:nowrap;color:#27272a;text-decoration:none;transition:background-color 0.12s ease, color 0.12s ease}.contact-dropdown-item:hover{background-color:rgb(24 24 27 / 0.06);color:#18181b}.dark .contact-dropdown-item{color:#d4d4d8}.dark .contact-dropdown-item:hover{background-color:rgb(250 250 250 / 0.08);color:#fafafa}.contact-dropdown-icon{flex-shrink:0;opacity:0.7}.contact-dropdown-item:hover .contact-dropdown-icon{opacity:1}[data-component-part=\"version-select-content\"]{border-radius:0.875rem;border-color:rgb(24 24 27 / 0.1);box-shadow:0 0 2px rgb(24 24 27 / 0.08), 0 0 10px rgb(24 24 27 / 0.08)}.dark [data-component-part=\"version-select-content\"]{background-color:#18181b;border-color:rgb(250 250 250 / 0.1);box-shadow:0 0 0 1px rgb(255 255 255 / 0.04), 0 0 10px rgb(0 0 0 / 0.4)}[data-component-part=\"version-select-item\"][aria-selected=\"true\"]{background-color:rgb(24 24 27 / 0.05)}.dark [data-component-part=\"version-select-item\"][aria-selected=\"true\"]{background-color:rgb(250 250 250 / 0.06)}[data-component-part=\"version-select-item\"][aria-selected=\"true\"] [class*=\"text-primary\"]{color:#18181b;font-weight:600}.dark [data-component-part=\"version-select-item\"][aria-selected=\"true\"] [class*=\"text-primary\"]{color:#fafafa}[data-component-part=\"version-select-tag\"]{background-color:rgb(24 24 27 / 0.06);color:#52525b}.dark [data-component-part=\"version-select-tag\"]{background-color:rgb(250 250 250 / 0.08);color:#a1a1aa}@layer components{[data-component-part=\"version-select-tag\"]{border-radius:0.375rem!important}}"}],"page":{"pagePath":"visual-intelligence/gemini/gemini-vlm","slug":"/visual-intelligence/gemini/gemini-vlm","pageMetadata":{"title":"Gemini Video","openapi":"visual-intelligence/gemini/openapi.json POST /vu/chat/completions","description":"Generate chat completions using Gemini VLM model with text, video, and image inputs.","href":"/visual-intelligence/gemini/gemini-vlm"},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsx(_components.p, {\n children: \"Generate chat completions using Gemini VLM model with text, video, and image inputs.\"\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,code:`code`,li:`li`,ol:`ol`,p:`p`,pre:`pre`,span:`span`,strong:`strong`,tbody:`tbody`,td:`td`,th:`th`,thead:`thead`,tr:`tr`,ul:`ul`,..._provideComponents(),...props.components},{CodeBlock,CodeGroup,Heading,Info,Note,Table,Warning}=_components;if(!CodeBlock)_missingMdxReference(`CodeBlock`,true);if(!CodeGroup)_missingMdxReference(`CodeGroup`,true);if(!Heading)_missingMdxReference(`Heading`,true);if(!Info)_missingMdxReference(`Info`,true);if(!Note)_missingMdxReference(`Note`,true);if(!Table)_missingMdxReference(`Table`,true);if(!Warning)_missingMdxReference(`Warning`,true);return _jsxs(_Fragment,{children:[_jsx(Info,{children:_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Product`}),`: Visual Intelligence — Video Model APIs (atomic)\n`,_jsx(_components.strong,{children:`Use case`}),`: Call a Video Language Model (Gemini / Nova / Qwen) directly with your own prompt. Full control over model selection, prompt, and parameters. For ready-made tasks (no prompt needed), see Video Task APIs.\n`,_jsx(_components.strong,{children:`Host`}),`: `,_jsx(_components.code,{children:`https://mavi-backend.memories.ai/serve/api/v2`}),`\n`,_jsx(_components.strong,{children:`Auth`}),`: `,_jsx(_components.code,{children:`Authorization: sk-mavi-...`}),` (no `,_jsx(_components.code,{children:`Bearer`}),` prefix)`]})}),`\n`,_jsx(_components.p,{children:`This endpoint allows you to generate chat completions with text, video, and image inputs using Gemini VLM model.`}),`\n`,_jsxs(Info,{children:[_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Endpoint:`}),` `,_jsx(_components.code,{children:`POST https://mavi-backend.memories.ai/serve/api/v2/vu/chat/completions`})]}),_jsxs(_components.p,{children:[`Video Understanding (VLM) endpoints use the `,_jsx(_components.code,{children:`/vu`}),` path prefix. Image Understanding (ILM) endpoints use `,_jsx(_components.code,{children:`/iu`}),` instead.`]})]}),`\n`,_jsx(Heading,{level:`2`,id:`supported-models`,children:`Supported Models`}),`\n`,_jsxs(_components.p,{children:[`All models require the `,_jsx(_components.code,{children:`gemini:`}),` prefix when used in the `,_jsx(_components.code,{children:`model`}),` parameter (e.g., `,_jsx(_components.code,{children:`gemini:gemini-2.5-flash`}),`).`]}),`\n`,_jsx(Heading,{level:`3`,id:`premium-models`,children:`Premium Models`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Model`}),_jsx(_components.th,{children:`Input Price`}),_jsx(_components.th,{children:`Output Price`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`gemini-3-pro-preview`})}),_jsx(_components.td,{children:`$2/1M (≤200K), $4/1M (>200K)`}),_jsx(_components.td,{\"data-numeric\":`true`,children:`$12/1M (≤200K), $18/1M (>200K)`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`gemini-2.5-pro`})}),_jsx(_components.td,{\"data-numeric\":`true`,children:`$1.25/1M (≤200K), $2.5/1M (>200K)`}),_jsx(_components.td,{\"data-numeric\":`true`,children:`$10/1M (≤200K), $15/1M (>200K)`})]})]})]}),`\n`,_jsx(Heading,{level:`3`,id:`flash-models-high-performance`,children:`Flash Models (High Performance)`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Model`}),_jsx(_components.th,{children:`Input Price`}),_jsx(_components.th,{children:`Output Price`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`gemini-3-flash-preview`})}),_jsx(_components.td,{children:`$0.5/1M tokens`}),_jsx(_components.td,{children:`$3/1M tokens`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`gemini-2.5-flash`})}),_jsx(_components.td,{children:`$0.30/1M tokens`}),_jsx(_components.td,{children:`$2.5/1M tokens`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`gemini-2.5-flash-preview-09-2025`})}),_jsx(_components.td,{children:`$0.30/1M tokens`}),_jsx(_components.td,{children:`$2.5/1M tokens`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`gemini-2.0-flash`})}),_jsx(_components.td,{children:`$0.1/1M tokens`}),_jsx(_components.td,{children:`$0.4/1M tokens`})]})]})]}),`\n`,_jsx(Heading,{level:`3`,id:`lite-models-cost-effective`,children:`Lite Models (Cost-Effective)`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Model`}),_jsx(_components.th,{children:`Input Price`}),_jsx(_components.th,{children:`Output Price`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`gemini-2.5-flash-lite`})}),_jsx(_components.td,{children:`$0.1/1M tokens`}),_jsx(_components.td,{children:`$0.4/1M tokens`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`gemini-2.5-flash-lite-preview-09-2025`})}),_jsx(_components.td,{children:`$0.1/1M tokens`}),_jsx(_components.td,{children:`$0.4/1M tokens`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`gemini-2.0-flash-lite`})}),_jsx(_components.td,{children:`$0.075/1M tokens`}),_jsx(_components.td,{children:`$0.3/1M tokens`})]})]})]}),`\n`,_jsxs(Note,{children:[_jsxs(_components.p,{children:[`When using these models, remember to include the `,_jsx(_components.code,{children:`gemini:`}),` prefix in your API calls:`]}),_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[`✅ Correct: `,_jsx(_components.code,{children:`\"model\": \"gemini:gemini-2.5-flash\"`})]}),`\n`,_jsxs(_components.li,{children:[`❌ Incorrect: `,_jsx(_components.code,{children:`\"model\": \"gemini-2.5-flash\"`})]}),`\n`]})]}),`\n`,_jsx(Heading,{level:`3`,id:`request-body`,children:`Request Body`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Parameter`}),_jsx(_components.th,{children:`Type`}),_jsx(_components.th,{children:`Required`}),_jsx(_components.th,{children:`Default`}),_jsx(_components.th,{children:`Description`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`model`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Yes`}),_jsx(_components.td,{\"data-numeric\":`true`,children:`-`}),_jsxs(_components.td,{children:[`The model to use (e.g., `,_jsx(_components.code,{children:`gemini:gemini-2.5-flash`}),`)`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`messages`}),_jsx(_components.td,{children:`array`}),_jsx(_components.td,{children:`Yes`}),_jsx(_components.td,{\"data-numeric\":`true`,children:`-`}),_jsxs(_components.td,{children:[`Array of message objects. Each message contains:`,_jsx(`br`,{}),`- `,_jsx(_components.code,{children:`role`}),`: Role type, values: `,_jsx(_components.code,{children:`system`}),`, `,_jsx(_components.code,{children:`user`}),`, `,_jsx(_components.code,{children:`assistant`}),_jsx(`br`,{}),`- `,_jsx(_components.code,{children:`content`}),`: Message content. A plain string is accepted for `,_jsx(_components.strong,{children:`text-only`}),` turns, but `,_jsx(_components.strong,{children:`must be an array`}),` as soon as you include a video or image — passing a bare string with an `,_jsx(_components.code,{children:`input_file`}),` intent silently drops the media and the upstream model rejects the call with `,_jsx(_components.code,{children:`status: \"errored\"`}),`. Array items can contain:`,_jsx(`br`,{}),` - `,_jsx(_components.code,{children:`type`}),`: Content type, `,_jsx(_components.code,{children:`text`}),` or `,_jsx(_components.code,{children:`input_file`}),_jsx(`br`,{}),` - `,_jsx(_components.code,{children:`text`}),`: Text content (when type is text)`,_jsx(`br`,{}),` - `,_jsx(_components.code,{children:`file_uri`}),`: File URL or base64 encoded file (when type is input_file). Note: video does not support base64`,_jsx(`br`,{}),` - `,_jsx(_components.code,{children:`mime_type`}),`: MIME type of the file (e.g., image/jpeg, video/mp4)`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`temperature`}),_jsx(_components.td,{children:`number`}),_jsx(_components.td,{children:`No`}),_jsx(_components.td,{\"data-numeric\":`true`,children:`0.7`}),_jsx(_components.td,{children:`Controls randomness: 0.0-2.0, higher = more random`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`max_tokens`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`No`}),_jsx(_components.td,{\"data-numeric\":`true`,children:`1000`}),_jsx(_components.td,{children:`Maximum number of tokens to generate`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`top_p`}),_jsx(_components.td,{children:`number`}),_jsx(_components.td,{children:`No`}),_jsx(_components.td,{\"data-numeric\":`true`,children:`1.0`}),_jsx(_components.td,{children:`Nucleus sampling: 0.0-1.0, consider tokens with top_p probability mass`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`frequency_penalty`}),_jsx(_components.td,{children:`number`}),_jsx(_components.td,{children:`No`}),_jsx(_components.td,{\"data-numeric\":`true`,children:`0.0`}),_jsx(_components.td,{children:`Reduces repetition of frequent tokens: -2.0 to 2.0`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`presence_penalty`}),_jsx(_components.td,{children:`number`}),_jsx(_components.td,{children:`No`}),_jsx(_components.td,{\"data-numeric\":`true`,children:`0.0`}),_jsx(_components.td,{children:`Increases likelihood of new topics: -2.0 to 2.0`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`n`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`No`}),_jsx(_components.td,{\"data-numeric\":`true`,children:`1`}),_jsx(_components.td,{children:`Number of completions to generate`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`stream`}),_jsx(_components.td,{children:`boolean`}),_jsx(_components.td,{children:`No`}),_jsx(_components.td,{children:`false`}),_jsx(_components.td,{children:`Whether to stream the response`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`stop`}),_jsx(_components.td,{children:`string | array | null`}),_jsx(_components.td,{children:`No`}),_jsx(_components.td,{children:`null`}),_jsx(_components.td,{children:`Stop sequences. Can be a string, array of strings, or null`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`extra_body`}),_jsx(_components.td,{children:`object`}),_jsx(_components.td,{children:`No`}),_jsx(_components.td,{\"data-numeric\":`true`,children:`-`}),_jsxs(_components.td,{children:[`Additional body parameters. Contains:`,_jsx(`br`,{}),`- `,_jsx(_components.code,{children:`metadata`}),`: Metadata object`,_jsx(`br`,{}),` - `,_jsx(_components.code,{children:`thinking_config`}),`: Thinking configuration`,_jsx(`br`,{}),` - `,_jsx(_components.code,{children:`thinking_budget`}),`: Integer value for thinking budget`,_jsx(`br`,{}),` - `,_jsx(_components.code,{children:`response_mime_type`}),`: Response MIME type (`,_jsx(_components.code,{children:`application/json`}),` or `,_jsx(_components.code,{children:`json_schema`}),`)`,_jsx(`br`,{}),` - `,_jsx(_components.code,{children:`responseSchema`}),`: JSON schema object for structured output`]})]})]})]}),`\n`,_jsx(Heading,{level:`3`,id:`code-example`,children:`Code Example`}),`\n`,_jsx(CodeGroup,{children:_jsx(CodeBlock,{filename:`Python`,numberOfLines:`71`,language:`python`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`python`,children:_jsxs(_components.code,{language:`python`,numberOfLines:`71`,children:[_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:`from`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` openai `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:`import`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` OpenAI`})]}),`\n`,_jsx(_components.span,{className:`line`}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`client `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` OpenAI(`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` api_key`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"sk-mavi-...\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` base_url`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"https://mavi-backend.memories.ai/serve/api/v2/vu\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`)`})}),`\n`,_jsx(_components.span,{className:`line`}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`def`}),_jsx(_components.span,{style:{color:`#8250DF`,\"--shiki-dark\":`#DCDCAA`},children:` call_my_vlm`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`():`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` resp `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` client.chat.completions.create(`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` model`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"gemini:gemini-2.5-flash\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# e.g. gemini:gemini-3-flash-preview or gemini:gemini-2.5-flash`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` messages`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`[`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"role\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"system\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"content\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"You are a multimodal assistant. Keep your answers concise.\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`},`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"role\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"user\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"content\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"text\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"text\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"Please summarize the content of this video and image\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"input_file\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"file_uri\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"https://storage.googleapis.com/memories-test-data/gun5.png\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# base64 or url, video does not support base64`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"mime_type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"image/jpeg\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"input_file\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"file_uri\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"https://storage.googleapis.com/memories-test-data/test_1min.mp4\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# base64 or url, video does not support base64`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"mime_type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"video/mp4\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ]`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ],`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` temperature`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.7`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# Controls randomness: 0.0-2.0, higher = more random`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` max_tokens`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`1000`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# Maximum number of tokens to generate`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` top_p`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`1.0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# Nucleus sampling: 0.0-1.0, consider tokens with top_p probability mass`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` frequency_penalty`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# -2.0 to 2.0, reduces repetition of frequent tokens`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` presence_penalty`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# -2.0 to 2.0, increases likelihood of new topics`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` n`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`1`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# Number of completions to generate`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` stream`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:`False`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# Whether to stream the response`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` stop`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:`None`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# Stop sequences (list of strings)`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` extra_body`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`{`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"metadata\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"thinking_config\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"thinking_budget\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`1024`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"response_mime_type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"application/json\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# application/json, json_schema`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"responseSchema\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"OBJECT\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"properties\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"video_summary\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"STRING\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"description\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"Summary of the video content from 1 second to 8 seconds.\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"image_summary\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"STRING\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"description\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"Summary of the image content.\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"required\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"video_summary\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"image_summary\"`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ]`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` )`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:` return`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` resp`})]}),`\n`,_jsx(_components.span,{className:`line`}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#6E7781`,\"--shiki-dark\":`#6A9955`},children:`# Usage example`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`result `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` call_my_vlm()`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#DCDCAA`},children:`print`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`(result)`})]}),`\n`]})})})}),`\n`,_jsx(Heading,{level:`3`,id:`response`,children:`Response`}),`\n`,_jsx(_components.p,{children:`Returns the chat completion response with structured output.`}),`\n`,`\n`,_jsx(Heading,{level:`3`,id:`response-parameters`,children:`Response Parameters`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Parameter`}),_jsx(_components.th,{children:`Type`}),_jsx(_components.th,{children:`Description`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`id`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Unique identifier for the completion`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`object`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Object type, always “completion”`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`model`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`The model used for the completion`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`created_at`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`Unix timestamp of when the completion was created`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`status`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Status of the completion (e.g., “completed”)`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`choices`}),_jsx(_components.td,{children:`array`}),_jsx(_components.td,{children:`Array of completion choices`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`choices[].text`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Text content of the completion`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`choices[].index`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`Index of the choice in the choices array`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`usage`}),_jsx(_components.td,{children:`object`}),_jsx(_components.td,{children:`Token usage information`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`usage.input_tokens`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`Number of input tokens used`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`usage.output_tokens`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`Number of output tokens generated`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`usage.total_tokens`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`Total number of tokens used`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`meta`}),_jsx(_components.td,{children:`object`}),_jsx(_components.td,{children:`Metadata about the completion`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`meta.provider`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Provider name (e.g., “gemini”)`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`meta.provider_model`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Provider-specific model name`})]})]})]}),`\n`,_jsx(Heading,{level:`3`,id:`error-responses`,children:`Error Responses`}),`\n`,_jsxs(Warning,{children:[_jsxs(_components.p,{children:[_jsxs(_components.strong,{children:[`Upstream errors are returned with `,_jsx(_components.code,{children:`HTTP 200`})]}),` — not a 4xx/5xx. Check `,_jsx(_components.code,{children:`status`}),` and look for a top-level `,_jsx(_components.code,{children:`error`}),` object before parsing `,_jsx(_components.code,{children:`choices`}),`.`]}),_jsx(CodeBlock,{filename:``,numberOfLines:`19`,language:`json`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`json`,children:_jsxs(_components.code,{language:`json`,numberOfLines:`19`,children:[_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`{`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"resp_...\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"object\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"completion\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"model\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"gemini:gemini-2.0-flash-lite\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"errored\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"choices\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [],`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"usage\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"input_tokens\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"output_tokens\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"total_tokens\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`},`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"error\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"code\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"INVALID_ARGUMENT\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"message\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"Unable to submit request because Model input cannot be empty. ...\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"http_status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`400`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"meta\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"provider\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"gemini\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"provider_model\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"gemini-2.0-flash-lite\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"provider_http_status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`400`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"provider_error\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: { `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"error\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: { `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"code\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`400`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"message\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"...\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"INVALID_ARGUMENT\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` } }`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})}),`\n`]})})}),_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Field`}),_jsx(_components.th,{children:`Type`}),_jsx(_components.th,{children:`Description`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`status`}),_jsx(_components.td,{children:`string`}),_jsxs(_components.td,{children:[_jsx(_components.code,{children:`\"completed\"`}),` on success, `,_jsx(_components.code,{children:`\"errored\"`}),` when the upstream model rejected the request.`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`error`}),_jsx(_components.td,{children:`object`}),_jsxs(_components.td,{children:[`Present only when `,_jsx(_components.code,{children:`status == \"errored\"`}),`. Contains the upstream error normalized.`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`error.code`}),_jsx(_components.td,{children:`string`}),_jsxs(_components.td,{children:[`Provider-defined error code (e.g. `,_jsx(_components.code,{children:`INVALID_ARGUMENT`}),`).`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`error.message`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Human-readable failure reason from the provider.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`error.http_status`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`The HTTP status the upstream provider would have returned (the mavi response is still 200).`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`meta.provider_http_status`}),_jsx(_components.td,{children:`integer`}),_jsxs(_components.td,{children:[`Mirror of `,_jsx(_components.code,{children:`error.http_status`}),`.`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`meta.provider_error`}),_jsx(_components.td,{children:`object`}),_jsx(_components.td,{children:`Raw provider error envelope, in case you need its native shape.`})]})]})]}),_jsxs(_components.p,{children:[`Callers should always verify `,_jsx(_components.code,{children:`status == \"completed\"`}),` (or that `,_jsx(_components.code,{children:`choices`}),` is non-empty) before reading `,_jsx(_components.code,{children:`choices[0].text`}),`.`]})]}),`\n`,_jsx(Heading,{level:`3`,id:`gemini-structured-output-quirks`,children:`Gemini structured-output quirks`}),`\n`,_jsxs(_components.p,{children:[`Two real behaviours to handle when you use `,_jsx(_components.code,{children:`extra_body.metadata.response_mime_type = \"application/json\"`}),`:`]}),`\n`,_jsxs(_components.ol,{children:[`\n`,_jsxs(_components.li,{children:[`Gemini frequently wraps its JSON output in `,_jsx(_components.code,{children:\"```json ... ```\"}),` markdown code fences. Strip them before `,_jsx(_components.code,{children:`json.loads`}),`.`]}),`\n`,_jsxs(_components.li,{children:[`On long videos with a strict schema, Gemini occasionally `,_jsx(_components.strong,{children:`loops`}),` — emitting the same set of entries repeatedly until it hits `,_jsx(_components.code,{children:`max_tokens`}),` and the JSON is left unclosed. Tolerate this by closing the array at the last complete `,_jsx(_components.code,{children:`}`}),` and deduplicating client-side.`]}),`\n`]}),`\n`,_jsxs(_components.p,{children:[`See `,_jsx(_components.a,{href:`https://github.com/Memories-ai-labs/api-docs/blob/main/examples/agent/02_restaurant_service_quality.py`,children:_jsx(_components.code,{children:`examples/agent/02_restaurant_service_quality.py`})}),` (`,_jsx(_components.code,{children:`extract_json`}),` and `,_jsx(_components.code,{children:`_dedup_events`}),`) for a worked example.`]})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"title":"Gemini Video","openapi":"visual-intelligence/gemini/openapi.json POST /vu/chat/completions","description":"Generate chat completions using Gemini VLM model with text, video, and image inputs.","href":"/visual-intelligence/gemini/gemini-vlm"}}},"mdxSourceWithNoJs":null,"noJsSplices":[[403,407,"ResponseExample,Tabl"],[675,690,"ResponseExample)_missingMdxReference(`ResponseExample`,true);if(!Table)_missingM"],[35500,39222,"_jsx(ResponseExample,{children:_jsx(CodeBlock,{filename:``,numberOfLines:`22`,la"],[39512,39532,"22`,children:[_jsx(_"],[39987,39994,"5810813e-99b9-427a-8736-23cf34573627\"`})"],[40849,40874,"5-flash\"`}),_jsx(_co"],[41096,41112,"created_at\"`}),_jsx("],[41234,42092,""],[42135,42146,"1767093284`}),_jsx(_"],[42223,42951,""],[43098,44265,""],[44403,45124,""],[45168,45185,"completed\"`}),_jsx(_"],[45408,45437,"\"choices\"`}),_jsx(_c"],[45514,45730,"[`})]}),`\n`,_jsx(_co"],[45771,45884,""],[45966,46160," {`})}),`\n`,_jsxs"],[46292,46320," \"text\"`}),_jsx(_co"],[46396,46398,""],[46440,47163,""],[47208,47487,"This video demonstrates the effects of vacuum on three different states of oranges.`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D7BA7D`},children:`\\\\n\\\\n`}),_"],[47568,47598,"1. **Setup**: Three orange-related items are placed in a vacuum chamber: a whole orange\"`}),_jsx(_co"],[47672,47694,",`})]}),`\n`,_jsxs(_c"],[47736,47736,"[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"index\"`}),"],[47818,47831,": `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`})]}),`\n`,"],[47962,47989," }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ],`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"usage\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"input_tokens\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`16983`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"output_tokens\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`37`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"total_tokens\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`17020`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"meta\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"provider\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"gemini\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"provider_model\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"gemini-2.5-flash\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})}),`\n`]})})})}),`\n`,_jsx(Heading,{level:`3`,id:`response-parameters`,children:`Response Parameters`}),`\n`,_jsxs(Tab"],[48099,48115,"Parameter`}),_jsx(_c"],[48296,49161,"id`}),_jsx(_componen"],[49219,49271,"Unique identifier for the completion`})]"],[49337,49889,""],[49930,52100,"string`}),_jsx(_components.td,{children:`Object type, always “completion”`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`model`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`The model used for the completion`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`created_at`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`Unix timestamp of when the completion was created`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`status`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Status of the completion (e.g., “completed”)`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`choices`}),_jsx(_components.td,{children:`array`}),_jsx(_components.td,{children:`Array of completion choices`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`choices[].text`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Text content of the completion`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`choices[].index`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`Index of the choice in the choices array`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`usage`}),_jsx(_components.td,{children:`object`}),_jsx(_components.td,{children:`Token usage information`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`usage.input_tokens`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`Number of input tokens used`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`usage.output_tokens`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`Number of output tokens generated`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`usage.total_tokens`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`Total number of tokens used`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`meta`}),_jsx(_components.td,{children:`object`}),_jsx(_components.td,{children:`Metadata about the completion`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`meta.provider`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Provider name (e.g., “gemini”)`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`meta.provider_model`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Provider-specific model name`})]})]})]}),`\n`,_jsx(Heading,{level:`3`,id:`error-responses`,children:`Error Responses`}),`\n`,_jsxs(Warning,{children:[_jsxs(_components.p,{children:[_jsxs(_components.strong,{children:[`Upstream errors are returned with `,_jsx(_components.code,{children:`HTTP 200`})]}),` — not a 4xx/5xx. Check `,_jsx(_components.code,{children:`status`}),` and look for a top-level `,_jsx(_components.code,{children:`error`}),` object before parsing `,_jsx(_components.code,{children:`choices`}),`.`]}),_jsx(CodeBlock,{filename:``,numberOfLines:`19`,language:`json`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`json`,children:_jsxs(_components.code,{language:`json`,numberOfLines:`19`,children:[_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`{`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"resp_...\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"object\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"completion\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"model\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"gemini:gemini-2.0-flash-lite\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"errored\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"choices\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [],`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"usage\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"input_tokens\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"output_tokens\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"total_tokens\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`},`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"error\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"code\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"INVALID_ARGUMENT\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"message\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"Unable to submit request because Model input cannot be empty. ...\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"http_status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`400`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"meta\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"provider\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"gemini\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"provider_model\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"gemini-2.0-flash-lite\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"provider_http_status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`400`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"provider_error\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: { `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"error\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: { `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"code\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`400`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"message\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"...\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"INVALID_ARGUMENT\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` } }`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})}),`\n`]})})}),_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Field`}),_jsx(_components.th,{children:`Type`}),_jsx(_components.th,{children:`Description`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`status`}),_jsx(_components.td,{children:`string`}),_jsxs(_components.td,{children:[_jsx(_components.code,{children:`\"completed\"`}),` on success, `,_jsx(_components.code,{children:`\"errored\"`}),` when the upstream model rejected the request.`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`error`}),_jsx(_components.td,{children:`object`}),_jsxs(_components.td,{children:[`Present only when `,_jsx(_components.code,{children:`status == \"errored\"`}),`. Contains the upstream error normalized.`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`error.code`}),_jsx(_components.td,{children:`string`}),_jsxs(_components.td,{children:[`Provider-defined error code (e.g. `,_jsx(_components.code,{children:`INVALID_ARGUMENT`}),`).`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`error.message`}),_jsx(_components.td,{children:`string`}),_jsx(_components.td,{children:`Human-readable failure reason from the provider.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`error.http_status`}),_jsx(_components.td,{children:`integer`}),_jsx(_components.td,{children:`The HTTP status the upstream provider would have returned (the mavi response is still 200).`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`meta.provider_http_status`}),_jsx(_components.td,{children:`integer`}),_jsxs(_components.td,{children:[`Mirror of `,_jsx(_components.code,{children:`error.http_status`}),`.`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`meta.provider_error`}),_jsx(_components.td,{children:`object`}),_jsx(_components.td,{children:`Raw provider error envelope, in case you need its native shape.`})]})]})]}),_jsxs(_components.p,{children:[`Callers should always verify `,_jsx(_components.code,{children:`status == \"completed\"`}),` (or that `,_jsx(_components.code,{children:`choices`}),` is non-empty) before reading `,_jsx(_components.code,{children:`choices[0].text`}),`.`]})]}),`\n`,_jsx(Heading,{level:`3`,id:`gemini-structured-output-quirks`,children:`Gemini structured-output quirks`}),`\n`,_jsxs(_components.p,{children:[`Two real behaviours to handle when you use `,_jsx(_components.code,{children:`extra_body.metadata.response_mime_type = \"application/json\"`}),`:`]}),`\n`,_jsxs(_components.ol,{children:[`\n`,_jsxs(_components.li,{children:[`Gemini frequently wraps its JSON output in `,_jsx(_components.code,{children:\"```json ... ```\"}),` markdown code fences. Strip them before `,_jsx(_components.code,{children:`json.loads`}),`.`]}),`\n`,_jsxs(_components.li,{children:[`On long videos with a strict schema, Gemini occasionally `,_jsx(_components.strong,{children:`loops`}),` — emitting the same set of entries repeatedly until it hits `,_jsx(_components.code,{children:`max_tokens`}),` and the JSON is left unclosed. Tolerate this by closing the array at the last complete `,_jsx(_components.code,{children:`}`}),` and deduplicating client-side.`]}),`\n`]}),`\n`,_jsxs(_components.p,{children:[`See `,_jsx(_components.a,{href:`https://github.com/Memories-ai-labs/api-docs/blob/main/examples/agent/02_restaurant_service_quality.py`,children:_jsx(_components.code,{children:`examples/agent/02_restaurant_service_quality.py`})}),` (`,_jsx(_components.code,{children:`extract_json`}),` and `,_jsx(_components.code,{children:`_dedup_events`}),`) for a worked example.`]})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}"]]},"mdxExtracts":{"tableOfContents":[{"title":"Supported Models","slug":"supported-models","depth":2,"children":[{"title":"Premium Models","slug":"premium-models","depth":3,"children":[]},{"title":"Flash Models (High Performance)","slug":"flash-models-high-performance","depth":3,"children":[]},{"title":"Lite Models (Cost-Effective)","slug":"lite-models-cost-effective","depth":3,"children":[]},{"title":"Request Body","slug":"request-body","depth":3,"children":[]},{"title":"Code Example","slug":"code-example","depth":3,"children":[]},{"title":"Response","slug":"response","depth":3,"children":[]},{"title":"Response Parameters","slug":"response-parameters","depth":3,"children":[]},{"title":"Error Responses","slug":"error-responses","depth":3,"children":[]},{"title":"Gemini structured-output quirks","slug":"gemini-structured-output-quirks","depth":3,"children":[]}]}],"codeExamples":{"response":{"type":"ResponseExample","children":[{"filename":"","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"json\">\u003ccode language=\"json\" numberOfLines=\"22\">\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">{\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"resp_5810813e-99b9-427a-8736-23cf34573627\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"object\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"completion\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"model\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"gemini:gemini-2.5-flash\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"created_at\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">1767093284\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"status\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"completed\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"choices\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"text\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"This video demonstrates the effects of vacuum on three different states of oranges.\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D7BA7D\">\\n\\n\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">1. **Setup**: Three orange-related items are placed in a vacuum chamber: a whole orange\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"index\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> ],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"usage\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"input_tokens\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">16983\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"output_tokens\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">37\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"total_tokens\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">17020\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> },\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"meta\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"provider\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"gemini\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"provider_model\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"gemini-2.5-flash\"\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"}],"attributes":[]}}},"jsLinks":["/_mintlify/custom/memories/972cc1cc2414ba25/script.js"],"openApiReferenceData":{"operation":{"summary":"Chat Completions Gemini","operationId":"chat_completions_gemini","description":"Generate chat completions using Gemini VLM model with text, video, and image inputs.","requestBody":"68e3c5bc-2931-47eb-85ca-60fc38a52538","responses":{"200":"8973bbac-6588-4310-a6f6-2c3c89040cad"},"method":"post","type":"path","servers":["7ef3c717-28f9-4099-a30c-a830b95bc131"],"security":["26b4bf67-67a9-4b17-a575-4c19e5665b14"],"path":"/vu/chat/completions","baseUrlOptions":["https://mavi-backend.memories.ai/serve/api/v2"],"title":"Chat Completions Gemini","codeSamples":[],"requiredOnlyExamples":false,"requestExampleType":"generated","responseExamples":[{"dropdown":false,"language":"json","code":{"type":"pre","key":null,"ref":null,"props":{"className":"shiki shiki-themes github-light-default dark-plus","style":{"backgroundColor":"#ffffff","--shiki-dark-bg":"#0B0C0E","color":"#1f2328","--shiki-dark":"#D4D4D4"},"language":"json","children":{"type":"code","key":null,"ref":null,"props":{"language":"json","numberOfLines":"22","children":[{"type":"span","key":"0","ref":null,"props":{"className":"line","children":{"type":"span","key":null,"ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":"{"}}}},"\n",{"type":"span","key":"2","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"id\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0A3069","--shiki-dark":"#CE9178"},"children":"\"resp_5810813e-99b9-427a-8736-23cf34573627\""}},{"type":"span","key":"3","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":","}}]}},"\n",{"type":"span","key":"4","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"object\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0A3069","--shiki-dark":"#CE9178"},"children":"\"completion\""}},{"type":"span","key":"3","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":","}}]}},"\n",{"type":"span","key":"6","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"model\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0A3069","--shiki-dark":"#CE9178"},"children":"\"gemini:gemini-2.5-flash\""}},{"type":"span","key":"3","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":","}}]}},"\n",{"type":"span","key":"8","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"created_at\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0550AE","--shiki-dark":"#B5CEA8"},"children":"1767093284"}},{"type":"span","key":"3","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":","}}]}},"\n",{"type":"span","key":"10","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"status\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0A3069","--shiki-dark":"#CE9178"},"children":"\"completed\""}},{"type":"span","key":"3","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":","}}]}},"\n",{"type":"span","key":"12","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"choices\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": ["}}]}},"\n",{"type":"span","key":"14","ref":null,"props":{"className":"line","children":{"type":"span","key":null,"ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":" {"}}}},"\n",{"type":"span","key":"16","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"text\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0A3069","--shiki-dark":"#CE9178"},"children":"\"This video demonstrates the effects of vacuum on three different states of oranges."}},{"type":"span","key":"3","ref":null,"props":{"style":{"color":"#CF222E","--shiki-dark":"#D7BA7D"},"children":"\\n\\n"}},{"type":"span","key":"4","ref":null,"props":{"style":{"color":"#0A3069","--shiki-dark":"#CE9178"},"children":"1. **Setup**: Three orange-related items are placed in a vacuum chamber: a whole orange\""}},{"type":"span","key":"5","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":","}}]}},"\n",{"type":"span","key":"18","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"index\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0550AE","--shiki-dark":"#B5CEA8"},"children":"0"}}]}},"\n",{"type":"span","key":"20","ref":null,"props":{"className":"line","children":{"type":"span","key":null,"ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":" }"}}}},"\n",{"type":"span","key":"22","ref":null,"props":{"className":"line","children":{"type":"span","key":null,"ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":" ],"}}}},"\n",{"type":"span","key":"24","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"usage\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": {"}}]}},"\n",{"type":"span","key":"26","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"input_tokens\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0550AE","--shiki-dark":"#B5CEA8"},"children":"16983"}},{"type":"span","key":"3","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":","}}]}},"\n",{"type":"span","key":"28","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"output_tokens\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0550AE","--shiki-dark":"#B5CEA8"},"children":"37"}},{"type":"span","key":"3","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":","}}]}},"\n",{"type":"span","key":"30","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"total_tokens\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0550AE","--shiki-dark":"#B5CEA8"},"children":"17020"}}]}},"\n",{"type":"span","key":"32","ref":null,"props":{"className":"line","children":{"type":"span","key":null,"ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":" },"}}}},"\n",{"type":"span","key":"34","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"meta\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": {"}}]}},"\n",{"type":"span","key":"36","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"provider\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0A3069","--shiki-dark":"#CE9178"},"children":"\"gemini\""}},{"type":"span","key":"3","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":","}}]}},"\n",{"type":"span","key":"38","ref":null,"props":{"className":"line","children":[{"type":"span","key":"0","ref":null,"props":{"style":{"color":"#116329","--shiki-dark":"#9CDCFE"},"children":" \"provider_model\""}},{"type":"span","key":"1","ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":": "}},{"type":"span","key":"2","ref":null,"props":{"style":{"color":"#0A3069","--shiki-dark":"#CE9178"},"children":"\"gemini-2.5-flash\""}}]}},"\n",{"type":"span","key":"40","ref":null,"props":{"className":"line","children":{"type":"span","key":null,"ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":" }"}}}},"\n",{"type":"span","key":"42","ref":null,"props":{"className":"line","children":{"type":"span","key":null,"ref":null,"props":{"style":{"color":"#1F2328","--shiki-dark":"#D4D4D4"},"children":"}"}}}},"\n"]}}}},"filename":""}],"responseExampleType":"mdx","disableProxy":true},"dependencies":{"parameters":{},"requestBody":{"required":true,"content":{"application/json":{"schema":{"type":"object","properties":{"model":{"type":"string","description":"The model to use (e.g., gemini:gemini-2.5-flash)","example":"gemini:gemini-2.5-flash","isRequired":true,"uniqueKey":"model","typeLabel":"string"},"messages":{"type":"array","description":"Array of message objects","items":{"type":"object","properties":{"role":{"type":"string","enum":["system","user","assistant"],"isRequired":true,"uniqueKey":"messages.items.[INDEX].role","typeLabel":"enum\u003cstring>"},"content":{"oneOf":[{"type":"string","isRequired":true,"uniqueKey":"messages.items.[INDEX].content.oneOf.0","typeLabel":"string"},{"type":"array","items":{"type":"object","properties":{"type":{"type":"string","enum":["text","input_file"],"uniqueKey":"messages.items.[INDEX].content.oneOf.1.items.[INDEX].type","typeLabel":"enum\u003cstring>"},"text":{"type":"string","uniqueKey":"messages.items.[INDEX].content.oneOf.1.items.[INDEX].text","typeLabel":"string"},"file_uri":{"type":"string","description":"URL or base64 encoded file","uniqueKey":"messages.items.[INDEX].content.oneOf.1.items.[INDEX].file_uri","typeLabel":"string"},"mime_type":{"type":"string","description":"MIME type of the file (e.g., image/jpeg, video/mp4)","uniqueKey":"messages.items.[INDEX].content.oneOf.1.items.[INDEX].mime_type","typeLabel":"string"}},"uniqueKey":"messages.items.[INDEX].content.oneOf.1.items.[INDEX]","typeLabel":"object"},"isRequired":true,"uniqueKey":"messages.items.[INDEX].content.oneOf.1","typeLabel":"object[]"}],"isRequired":true,"uniqueKey":"messages.items.[INDEX].content","typeLabel":"string | object[]"}},"required":["role","content"],"uniqueKey":"messages.items.[INDEX]","typeLabel":"object"},"isRequired":true,"uniqueKey":"messages","typeLabel":"object[]"},"temperature":{"type":"number","description":"Controls randomness: 0.0-2.0, higher = more random","minimum":0,"maximum":2,"default":0.7,"uniqueKey":"temperature","typeLabel":"number"},"max_tokens":{"type":"integer","description":"Maximum number of tokens to generate","default":1000,"uniqueKey":"max_tokens","typeLabel":"integer"},"top_p":{"type":"number","description":"Nucleus sampling: 0.0-1.0","minimum":0,"maximum":1,"default":1,"uniqueKey":"top_p","typeLabel":"number"},"frequency_penalty":{"type":"number","description":"Reduces repetition of frequent tokens: -2.0 to 2.0","minimum":-2,"maximum":2,"default":0,"uniqueKey":"frequency_penalty","typeLabel":"number"},"presence_penalty":{"type":"number","description":"Increases likelihood of new topics: -2.0 to 2.0","minimum":-2,"maximum":2,"default":0,"uniqueKey":"presence_penalty","typeLabel":"number"},"n":{"type":"integer","description":"Number of completions to generate","default":1,"uniqueKey":"n","typeLabel":"integer"},"stream":{"type":"boolean","description":"Whether to stream the response","default":false,"uniqueKey":"stream","typeLabel":"boolean"},"stop":{"oneOf":[{"type":"string","description":"Stop sequences","uniqueKey":"stop.oneOf.0","typeLabel":"string"},{"type":"array","items":{"type":"string","uniqueKey":"stop.oneOf.1.items.[INDEX]","typeLabel":"string"},"description":"Stop sequences","uniqueKey":"stop.oneOf.1","typeLabel":"string[]"},{"type":"null","description":"Stop sequences","uniqueKey":"stop.oneOf.2","typeLabel":"null"}],"uniqueKey":"stop","typeLabel":"string | string[] | null"},"extra_body":{"type":"object","properties":{"metadata":{"type":"object","properties":{"thinking_config":{"type":"object","properties":{"thinking_budget":{"type":"integer","uniqueKey":"extra_body.metadata.thinking_config.thinking_budget","typeLabel":"integer"}},"uniqueKey":"extra_body.metadata.thinking_config","typeLabel":"object"},"response_mime_type":{"type":"string","enum":["application/json","json_schema"],"uniqueKey":"extra_body.metadata.response_mime_type","typeLabel":"enum\u003cstring>"},"responseSchema":{"type":"object","properties":{"type":{"type":"string","enum":["OBJECT"],"uniqueKey":"extra_body.metadata.responseSchema.type","typeLabel":"enum\u003cstring>"},"properties":{"type":"object","uniqueKey":"extra_body.metadata.responseSchema.properties","typeLabel":"object"},"required":{"type":"array","items":{"type":"string","uniqueKey":"extra_body.metadata.responseSchema.required.items.[INDEX]","typeLabel":"string"},"uniqueKey":"extra_body.metadata.responseSchema.required","typeLabel":"string[]"}},"uniqueKey":"extra_body.metadata.responseSchema","typeLabel":"object"}},"uniqueKey":"extra_body.metadata","typeLabel":"object"}},"uniqueKey":"extra_body","typeLabel":"object"}},"required":["model","messages"],"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"model":"gemini:gemini-2.5-flash","messages":[{"content":"\u003cstring>"}],"temperature":0.7,"max_tokens":1000,"top_p":1,"frequency_penalty":0,"presence_penalty":0,"n":1,"stream":false,"stop":"\u003cstring>","extra_body":{"metadata":{"thinking_config":{"thinking_budget":123},"responseSchema":{"type":"OBJECT","properties":{},"required":["\u003cstring>"]}}}}}},"exampleType":"generated"}},"exampleType":"generated"},"responses":{"8973bbac-6588-4310-a6f6-2c3c89040cad":{"description":"Chat completion response","content":{"application/json":{"schema":{"type":"object","properties":{"id":{"type":"string","example":"resp_5810813e-99b9-427a-8736-23cf34573627","description":"Unique identifier for the completion","isRequired":true,"uniqueKey":"id","typeLabel":"string"},"object":{"type":"string","example":"completion","description":"Object type, always 'completion'","isRequired":true,"uniqueKey":"object","typeLabel":"string"},"model":{"type":"string","example":"gemini:gemini-2.5-flash","description":"The model used for the completion","isRequired":true,"uniqueKey":"model","typeLabel":"string"},"created_at":{"type":"integer","example":1767093284,"description":"Unix timestamp of when the completion was created","isRequired":true,"uniqueKey":"created_at","typeLabel":"integer"},"status":{"type":"string","example":"completed","description":"Status of the completion","isRequired":true,"uniqueKey":"status","typeLabel":"string"},"choices":{"type":"array","items":{"type":"object","properties":{"text":{"type":"string","description":"Text content of the completion","example":"This video demonstrates the effects of vacuum on three different states of oranges.","isRequired":true,"uniqueKey":"choices.items.[INDEX].text","typeLabel":"string"},"index":{"type":"integer","description":"Index of the choice in the choices array","example":0,"isRequired":true,"uniqueKey":"choices.items.[INDEX].index","typeLabel":"integer"}},"required":["text","index"],"uniqueKey":"choices.items.[INDEX]","typeLabel":"object"},"isRequired":true,"uniqueKey":"choices","typeLabel":"object[]"},"usage":{"type":"object","properties":{"input_tokens":{"type":"integer","description":"Number of input tokens used","example":16983,"isRequired":true,"uniqueKey":"usage.input_tokens","typeLabel":"integer"},"output_tokens":{"type":"integer","description":"Number of output tokens generated","example":37,"isRequired":true,"uniqueKey":"usage.output_tokens","typeLabel":"integer"},"total_tokens":{"type":"integer","description":"Total number of tokens used","example":17020,"isRequired":true,"uniqueKey":"usage.total_tokens","typeLabel":"integer"}},"required":["input_tokens","output_tokens","total_tokens"],"isRequired":true,"uniqueKey":"usage","typeLabel":"object"},"meta":{"type":"object","properties":{"provider":{"type":"string","description":"Provider name","example":"gemini","isRequired":true,"uniqueKey":"meta.provider","typeLabel":"string"},"provider_model":{"type":"string","description":"Provider-specific model name","example":"gemini-2.5-flash","isRequired":true,"uniqueKey":"meta.provider_model","typeLabel":"string"}},"required":["provider","provider_model"],"isRequired":true,"uniqueKey":"meta","typeLabel":"object"}},"required":["id","object","model","created_at","status","choices","usage","meta"],"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"id":"resp_5810813e-99b9-427a-8736-23cf34573627","object":"completion","model":"gemini:gemini-2.5-flash","created_at":1767093284,"status":"completed","choices":[{"text":"This video demonstrates the effects of vacuum on three different states of oranges.","index":0}],"usage":{"input_tokens":16983,"output_tokens":37,"total_tokens":17020},"meta":{"provider":"gemini","provider_model":"gemini-2.5-flash"}}}},"exampleType":"generated"}},"exampleType":"generated"}},"security":{"26b4bf67-67a9-4b17-a575-4c19e5665b14":{"ApiKeyAuth":{"type":"apiKey","in":"header","name":"Authorization","scopes":[]}}},"servers":{"7ef3c717-28f9-4099-a30c-a830b95bc131":{"url":"https://mavi-backend.memories.ai/serve/api/v2"}},"processedSecurityOptions":[{"schemes":[{"scheme":{"type":"apiKey","in":"header","name":"Authorization","scopes":[]},"schema":{"title":"Authorization","type":"string","isRequired":true,"typeLabel":"string","deprecated":false},"schemeName":"ApiKeyAuth","name":"Authorization"}],"title":"ApiKeyAuth"}]},"originalFileLocation":"visual-intelligence/gemini/openapi.json"},"subdomain":"memories","siteName":"Memories.ai API","title":"Gemini Video - Memories.ai API","navMaps":{"firstHrefInVersion":{"2.0":{"href":"/overview","matchLevel":3},"1.0":{"href":"/visual-intelligence/gemini/gemini-vlm","matchLevel":0}},"firstHrefInLanguage":{}},"lastModified":"2026-05-18T03:16:39.379Z","originalFileLocation":"visual-intelligence/gemini/gemini-vlm.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Generate chat completions using Gemini VLM model with text, video, and image inputs.\">\u003cmeta data-mint-head name=\"application-name\" content=\"Memories.ai API\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/memories/5j8WL483Yysza6QZ/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/memories/5j8WL483Yysza6QZ/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/memories/5j8WL483Yysza6QZ/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/memories/5j8WL483Yysza6QZ/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/memories/5j8WL483Yysza6QZ/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/memories/5j8WL483Yysza6QZ/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/memories/5j8WL483Yysza6QZ/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/memories/5j8WL483Yysza6QZ/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/memories/5j8WL483Yysza6QZ/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Gemini Video - Memories.ai API\">\u003cmeta data-mint-head property=\"og:description\" content=\"Generate chat completions using Gemini VLM model with text, video, and image inputs.\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"Memories.ai API\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.memories.ai/visual-intelligence/gemini/gemini-vlm\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://memories.mintlify.site/_mintlify/api/og/v2?division=Video+Model+APIs\u0026amp;title=Gemini+Video\u0026amp;description=Generate+chat+completions+using+Gemini+VLM+model+with+text%2C+video%2C+and+image+inputs.\u0026amp;theme=95f96f5d29bb2d358170d12a\u0026amp;signature=f82139e2e1534858acca1f92a7b4b7e077bd0c2599a63c921cf250c0e7f3fdc4\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Gemini Video - Memories.ai API\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Generate chat completions using Gemini VLM model with text, video, and image inputs.\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://memories.mintlify.site/_mintlify/api/og/v2?division=Video+Model+APIs\u0026amp;title=Gemini+Video\u0026amp;description=Generate+chat+completions+using+Gemini+VLM+model+with+text%2C+video%2C+and+image+inputs.\u0026amp;theme=95f96f5d29bb2d358170d12a\u0026amp;signature=f82139e2e1534858acca1f92a7b4b7e077bd0c2599a63c921cf250c0e7f3fdc4\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/memories/5j8WL483Yysza6QZ/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"Memories.ai API\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#5026A4\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.memories.ai/visual-intelligence/gemini/gemini-vlm\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/visual-intelligence/gemini/gemini-vlm.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.memories.ai/#organization\",\"name\":\"Memories.ai API\",\"url\":\"https://docs.memories.ai\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/memories/xyhRN3OJaXxxzcxh/logo/logo.png?fit=max\u0026auto=format\u0026n=xyhRN3OJaXxxzcxh\u0026q=85\u0026s=77ec93feefafd5196ff9c2b10130af40\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.memories.ai#website\",\"name\":\"Memories.ai API\",\"url\":\"https://docs.memories.ai\",\"publisher\":{\"@id\":\"https://docs.memories.ai/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.memories.ai/visual-intelligence/gemini/gemini-vlm#webpage\",\"url\":\"https://docs.memories.ai/visual-intelligence/gemini/gemini-vlm\",\"name\":\"Gemini Video\",\"description\":\"Generate chat completions using Gemini VLM model with text, video, and image inputs.\",\"dateModified\":\"2026-05-18T03:16:39.379Z\",\"isPartOf\":{\"@id\":\"https://docs.memories.ai#website\"},\"breadcrumb\":{\"@id\":\"https://docs.memories.ai/visual-intelligence/gemini/gemini-vlm#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.memories.ai/visual-intelligence/gemini/gemini-vlm#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Video Model APIs\",\"item\":\"https://docs.memories.ai/visual-intelligence/video-model-selection\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Gemini Video\",\"item\":\"https://docs.memories.ai/visual-intelligence/gemini/gemini-vlm\"}]},{\"@type\":[\"TechArticle\",\"APIReference\"],\"@id\":\"https://docs.memories.ai/visual-intelligence/gemini/gemini-vlm#apireference\",\"headline\":\"Gemini Video\",\"name\":\"Gemini Video\",\"description\":\"Generate chat completions using Gemini VLM model with text, video, and image inputs.\",\"url\":\"https://docs.memories.ai/visual-intelligence/gemini/gemini-vlm\",\"mainEntityOfPage\":{\"@id\":\"https://docs.memories.ai/visual-intelligence/gemini/gemini-vlm#webpage\"},\"dateModified\":\"2026-05-18T03:16:39.379Z\",\"publisher\":{\"@id\":\"https://docs.memories.ai/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.memories.ai#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"Memories.ai API\",\"publisher\":{\"@type\":\"Organization\",\"name\":\"Memories.ai API\"},\"provider\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","agentPointerHref":"/visual-intelligence/gemini/gemini-vlm.md","siteName":"Memories.ai API","nav":{"global":null,"versions":[{"version":"2.0","default":true,"pages":[{"title":"2.0","href":"/overview"}]},{"version":"1.0","tag":"Deprecated","tabs":[{"tab":"Overview","pages":[{"title":"Overview","href":"/home/overview"}]},{"tab":"Visual Intelligence","groups":[{"group":"Get Started","pages":[{"title":"Introduction","href":"/visual-intelligence/getting-started/introduction"},{"title":"API Overview","href":"/visual-intelligence/getting-started/overview"},{"title":"Create Your API Key","href":"/visual-intelligence/getting-started/create-your-key"}]},{"group":"Asset Management","pages":[{"openapi":"POST /upload","title":"Upload File","href":"/visual-intelligence/base/upload"},{"openapi":"POST /upload/signed-url","title":"Get Upload Signed URL","href":"/visual-intelligence/base/upload-by-signed-url/get-upload-signed-url"},{"title":"Upload File Using Signed URL","href":"/visual-intelligence/base/upload-by-signed-url/upload-file-using-signed-url"},{"openapi":"POST /video/extract-frames","title":"Extract Video Frames","href":"/visual-intelligence/base/extract-frames"},{"openapi":"GET /{asset_id}/metadata","title":"Get Asset Metadata","href":"/visual-intelligence/base/get-metadata"},{"title":"Download Asset","href":"/visual-intelligence/base/download"},{"title":"Download by Bucket and Blob","href":"/visual-intelligence/base/download-by-bucket-blob"},{"openapi":"DELETE /{asset_id}","title":"Delete Asset","href":"/visual-intelligence/base/delete"}]},{"group":"Social Media Scraping","pages":[{"title":"Social Media Scraping Overview","href":"/visual-intelligence/social-media-scraping-overview"},{"group":"YouTube","pages":[{"openapi":"POST /youtube/video/metadata","title":"YouTube Video Metadata","href":"/visual-intelligence/video-metadata-transcript/youtube-video-metadata"},{"openapi":"POST /youtube/video/transcript","title":"YouTube Video Transcript","href":"/visual-intelligence/video-metadata-transcript/youtube-video-transcript"},{"openapi":"POST /youtube/video/mai/transcript","title":"YouTube Video Caption","href":"/visual-intelligence/video-metadata-transcript/youtube-video-caption"},{"openapi":"POST /youtube/video/detail","title":"YouTube Video Detail","href":"/visual-intelligence/scraper/youtube-video-detail"},{"openapi":"POST /youtube/video/comment","title":"YouTube Video Comment","href":"/visual-intelligence/scraper/youtube-video-comment"},{"openapi":"POST /youtube/video/comment/reply","title":"YouTube Video Comment Reply","href":"/visual-intelligence/scraper/youtube-video-comment-reply"}]},{"group":"Instagram","pages":[{"openapi":"POST /instagram/video/metadata","title":"Instagram Video Metadata","href":"/visual-intelligence/video-metadata-transcript/instagram-video-metadata"},{"openapi":"POST /instagram/video/transcript","title":"Instagram Video Transcript","href":"/visual-intelligence/video-metadata-transcript/instagram-video-transcript"},{"openapi":"POST /instagram/video/mai/transcript","title":"Instagram Video Caption","href":"/visual-intelligence/video-metadata-transcript/instagram-video-caption"}]},{"group":"TikTok","pages":[{"openapi":"POST /tiktok/video/metadata","title":"TikTok Video Metadata","href":"/visual-intelligence/video-metadata-transcript/tiktok-video-metadata"},{"openapi":"POST /tiktok/video/transcript","title":"TikTok Video Transcript","href":"/visual-intelligence/video-metadata-transcript/tiktok-video-transcript"},{"openapi":"POST /tiktok/video/mai/transcript","title":"TikTok Video Caption","href":"/visual-intelligence/video-metadata-transcript/tiktok-video-caption"},{"openapi":"POST /tiktok/video/detail","title":"TikTok Video Detail","href":"/visual-intelligence/scraper/tiktok-video-detail"},{"openapi":"POST /tiktok/video/comment","title":"TikTok Video Comment","href":"/visual-intelligence/scraper/tiktok-video-comment"},{"openapi":"POST /tiktok/video/comment/reply","title":"TikTok Video Comment Reply","href":"/visual-intelligence/scraper/tiktok-video-comment-reply"}]},{"group":"Twitter","pages":[{"openapi":"POST /twitter/video/metadata","title":"Twitter Video Metadata","href":"/visual-intelligence/video-metadata-transcript/twitter-video-metadata"},{"openapi":"POST /twitter/video/transcript","title":"Twitter Video Transcript","href":"/visual-intelligence/video-metadata-transcript/twitter-video-transcript"},{"openapi":"POST /twitter/video/mai/transcript","title":"Twitter Video Caption","href":"/visual-intelligence/video-metadata-transcript/twitter-video-caption"}]}]},{"group":"Audio File Transcription","pages":[{"title":"ElevenLabs","sidebarTitle":"ElevenLabs","api":"POST https://mavi-backend.memories.ai/serve/api/v2/transcriptions/speech-to-text","href":"/visual-intelligence/transcript/elevenlabs"},{"title":"AssemblyAI","sidebarTitle":"AssemblyAI","api":"POST https://mavi-backend.memories.ai/serve/api/v2/transcriptions/speech-to-text","href":"/visual-intelligence/transcript/assemblyai"},{"title":"Whisper Audio Transcription","href":"/visual-intelligence/transcript/whisper-audio-transcription"},{"title":"Speaker Diarization","href":"/visual-intelligence/transcript/speaker-diarization"},{"openapi":"POST /transcriptions/async-generate-multi-speaker","title":"Multimodal Speaker Recognition","href":"/visual-intelligence/transcript/speaker-recognition"}]},{"group":"Live Audio Transcription","pages":[{"group":"Server-Pull Mode (callback)","pages":[{"openapi":"visual-intelligence/stream/openapi.json POST /audio-stream/start","title":"Start Audio Stream Transcription","href":"/visual-intelligence/stream/audio-stream-start"},{"openapi":"visual-intelligence/stream/openapi.json POST /audio-stream/stop","title":"Stop Audio Stream Transcription","href":"/visual-intelligence/stream/audio-stream-stop"}]},{"group":"Client-Push Mode (WebSocket)","pages":[{"title":"Real-time Audio Stream (WebSocket)","href":"/visual-intelligence/stream/audio-stream-websocket"}]}]},{"group":"Video Model APIs","pages":[{"title":"Video Model Selection","description":"Choose the right video understanding model for your workload","href":"/visual-intelligence/video-model-selection"},{"title":"Gemini Video","openapi":"visual-intelligence/gemini/openapi.json POST /vu/chat/completions","href":"/visual-intelligence/gemini/gemini-vlm"},{"openapi":"visual-intelligence/nova/openapi.json POST /vu/chat/completions","title":"Nova Video","description":"Generate chat completions using Nova VLM model with text, video, and image inputs.","href":"/visual-intelligence/nova/nova-vlm"},{"openapi":"visual-intelligence/qwen/openapi.json POST /vu/chat/completions","title":"Qwen Video","href":"/visual-intelligence/qwen/qwen-vlm"}]},{"group":"Video Task APIs","pages":[{"openapi":"POST /transcriptions/async-generate-video","title":"Video Frame Description","href":"/visual-intelligence/caption/video-frame-description"},{"openapi":"POST /transcriptions/async-summary","title":"Video Summary","href":"/visual-intelligence/caption/video-summary"}]},{"group":"Live Video Content Moderation","pages":[{"openapi":"visual-intelligence/stream/openapi.json POST /stream/start","title":"Start Video Stream Moderation","href":"/visual-intelligence/stream/video-stream-start"},{"openapi":"visual-intelligence/stream/openapi.json POST /stream/stop","title":"Stop Video Stream Moderation","href":"/visual-intelligence/stream/video-stream-stop"}]},{"group":"Live Video Understanding","pages":[{"openapi":"visual-intelligence/stream/understanding-openapi.json POST /v1/understand/streamConnect","title":"Start Stream Video Understanding","href":"/visual-intelligence/stream/video-stream-understanding-start"},{"openapi":"visual-intelligence/stream/understanding-openapi.json POST /v1/understand/stop/{task_id}","title":"Stop Stream Video Understanding","href":"/visual-intelligence/stream/video-stream-understanding-stop"}]},{"group":"Image Model APIs","pages":[{"title":"Image Model Selection","href":"/visual-intelligence/image-model-selection"},{"openapi":"visual-intelligence/gemini/openapi.json POST /iu/chat/completions","title":"Gemini Image","href":"/visual-intelligence/gemini/gemini-ilm"},{"openapi":"visual-intelligence/gpt/openapi.json POST /iu/chat/completions","title":"GPT Image","href":"/visual-intelligence/gpt/gpt-ilm"},{"openapi":"visual-intelligence/nova/openapi.json POST /iu/chat/completions","title":"Nova Image","href":"/visual-intelligence/nova/nova-ilm"},{"openapi":"visual-intelligence/qwen/openapi.json POST /iu/chat/completions","title":"Qwen Image","href":"/visual-intelligence/qwen/qwen-ilm"}]},{"group":"Embeddings","pages":[{"openapi":"POST /embeddings/image","title":"Generate Image Embedding","href":"/visual-intelligence/embeddings/image-embedding"},{"openapi":"POST /embeddings/video","title":"Generate Video Embedding","href":"/visual-intelligence/embeddings/video-embedding"},{"openapi":"POST /embeddings/text","title":"Generate Text Embedding","href":"/visual-intelligence/embeddings/text-embedding"}]},{"group":"Human ReID \u0026 Caption","pages":[{"title":"Video Caption","href":"/visual-intelligence/caption/video-caption"},{"title":"Image Caption","href":"/visual-intelligence/caption/image-caption"}]},{"group":"Reference","pages":[{"title":"Rate Limit","href":"/visual-intelligence/getting-started/rate-limit"},{"title":"Webhooks","href":"/visual-intelligence/getting-started/webhooks"},{"title":"Response \u0026 Error Codes","href":"/visual-intelligence/getting-started/error-codes"}]}]},{"tab":"Visual Search","pages":[{"title":"Visual Search","href":"/visual-search/introduction"}]},{"tab":"Visual Agents","pages":[{"title":"Visual Agents","href":"/visual-agents/overview"}]}]}]},"basePath":"","title":"Gemini Video - Memories.ai API","buildId":"dpl_41S5Z2jG9QnfDRwN1KZrLdBwj7DM","deploymentId":"dpl_41S5Z2jG9QnfDRwN1KZrLdBwj7DM","dynamics":["c2aa737661","2b790eda92","b0f84f53ff","a9bb46feb3"],"chunks":["OpenApiReferenceProvider-DDP9JXtj.js","utils-8yQyvEtx.js","cloneDeep-izs3Hzxb.js","_Uint8Array-BVIqJ90l.js","isObjectLike-C8vmzPEN.js","isArray-Dcu1dQ5t.js","utils-CBCFR8Sn.js","toString-BX-iyh8G.js","isSymbol-CSH9U2Gm.js","addUniqueKeysToSchema-rQaXkUHa.js","snippetPresets-J5KpBTgV.js","style-to-object-BY3JEAdk.js","v4-DIgz8zy6.js","conditional-requirements-CFM0id0Q.js","ApiExamples-BVxVH4Cj.js","isEqual-BfaiBbcl.js","usePlaygroundInputsStore-BxdQ2vIi.js","shallow-BjV2tFiD.js","getApiPlaygroundDisplay-C_55tL4O.js","CodeSnippet-C0JpiCOC.js","CodeSnippets-w9Ps7djG.js","Page-DTNSD-0M.js","getPastedJson-BDfB-H8d.js","icon-g-kUkkO9.js","MethodPill-v4l6fq0h.js","DuplicateIcon-CvLo-CfU.js","createIcon-165clrrV.js","DynamicMarkdown-D3RQ-fEj.js","SectionHeading-vvo-3yLf.js","axios-vUo_bRtp.js","Markdown-CMT1uFWQ.js","clsx-C8f2yC9R.js","lib-DuNMoZ05.js","lib-B8HbPgcC.js","html-void-elements-mCSPHezU.js","dist-CI2D8R2Y.js","katex-YMM-FMeD.js","marked.esm-CZWythHk.js","AssistantPageLink-k78Wrw_e.js"]}