gemini-api
Use when the user asks about using Gemini in an enterprise environment or explicitly mentions Vertex AI, Google Cloud, or Agent Platform. Guides the usage of the Gemini API on Agent Platform with the Google Gen AI SDK. Covers SDK usage (Python, JS/TS, Go, Java, C#), capabilities like multimodal inputs, tools, media generation, caching, batch prediction, and Live API.
摘要
- 用途
- 说明如何使用 Gen AI SDK 在 Agent Platform 上建置 Gemini 应用程序,涵盖用户端设置、文字与多模态功能,以及高级工作流程。
- 使用时机
- 在实作或疑难排解验证、SDK 设置、模型选择,或嵌入、串流、缓存、批量预测、安全性与微调等工作流程时使用。
- 输出结果
- 提供设置指引与 Python、JavaScript/TypeScript、Go、Java 和 C# 代码范例,并附上工作流程参考资料及官方文档链接。
上游变更(12 条,最新收录 2026-09-21)
f4ed3d0 No public description 更新 Agent Platform 注意事项与验证链接,将 `gemini-3.8-flash` 设为建议及范例使用的 Flash 模型,并将 `gemini-3.7-flash` 和 `gemini-3.6-flash` 标示为仅在明确要求时使用。 13d9090 Update gemini-api skills with gemini-3.6-flash and gemini-3.5-flash-lite 更新模型指引,建议使用 `gemini-3.6-flash` 与 `gemini-3.5-flash-lite`,将 `gemini-3.5-flash` 和 `gemini-3.1-flash-lite` 移至仅限明确要求的清单,添加快速图像模型,并更新快速入门范例所用的模型。 c75b500 Restructure the YAML frontmatter in all SKILL.md files to nest the 'category' field under the 'metadata:' block. The 'category' field is used to organize the skills in the README.md 将 `category: AiAndMachineLearning` 移入新的 `metadata` 区块,并调整代码区块和文档链接周围的间距。 16b3fef Link updates - Fetch Google Cloud documentation as markdown instead of HTML 将技能中的 Google Cloud 文档网址改为 `.md.txt` 形式,包括迁移、验证、支持区域、Express Mode 与 REST API 的链接。 e3b1eee Update Gemini API skill documentation with `enterprise` parameter and make description more prescriptive 调整描述顺序,先说明何时使用此技能;更新模型指引与文档链接,并将 TypeScript、Java 和 C# 范例改为使用 `enterprise` 设置。 df67a40 Update Gemini API skill documentation to reflect new model names and client configuration. 更新验证设置及 Python、TypeScript、Java 和 C# 范例,改用 Agent Platform 的 `enterprise` 设置;修订 Gemini 模型指引,并更新迁移与文档链接。 42b28e2 Update Models and capabilities for google-genai Agent Skills 添加 `gemini-3.1-flash-lite-preview`,建议用于高频率、轻量化工作。 6f0b877 Nests cloud/ skills under a top level skills/ directory 将技能文件从 `cloud/gemini-api/SKILL.md` 重命名为 `skills/cloud/gemini-api/SKILL.md`,内容未变更。 9114a94 Flatten skill directories to work with multiple installation tools 将技能文件从 `cloud/products/agent-platform/gemini-api/SKILL.md` 重命名为 `cloud/gemini-api/SKILL.md`,内容未变更。 npx skills add "lettucebo/Skills#v2.2.0@gemini-api" --full-depth ⚠ v2.2.0 发布后即可使用
[!IMPORTANT] Agent Platform (full name Gemini Enterprise Agent Platform) was previously named "Vertex AI" and many web resources use the legacy branding.
Gemini API in Agent Platform
Access Google's most advanced AI models built for enterprise use cases using the Gemini API in Agent Platform.
Provide these key capabilities:
- Text generation - Chat, completion, summarization
- Multimodal understanding - Process images, audio, video, and documents
- Function calling - Let the model invoke your functions
- Structured output - Generate valid JSON matching your schema
- Context caching - Cache large contexts for efficiency
- Embeddings - Generate text embeddings for semantic search
- Live Realtime API - Bidirectional streaming for low latency Voice and Video interactions
- Batch Prediction - Handle massive async dataset prediction workloads
Core Directives
- Unified SDK: ALWAYS use the Gen AI SDK (
google-genaifor Python,@google/genaifor JS/TS,google.golang.org/genaifor Go,com.google.genai:google-genaifor Java,Google.GenAIfor C#). - Legacy SDKs: DO NOT use
google-cloud-aiplatform,@google-cloud/vertexai, orgoogle-generativeai.
SDKs
- Python: Install
google-genaiwithpip install google-genai - JavaScript/TypeScript: Install
@google/genaiwithnpm install @google/genai - Go: Install
google.golang.org/genaiwithgo get google.golang.org/genai - C#/.NET: Install
Google.GenAIwithdotnet add package Google.GenAI - Java:
groupId:
com.google.genai, artifactId:google-genaiLatest version can be found here: https://central.sonatype.com/artifact/com.google.genai/google-genai/versions (let's call it
LAST_VERSION)Install in
build.gradle:implementation("com.google.genai:google-genai:${LAST_VERSION}")Install Maven dependency in
pom.xml:<dependency> <groupId>com.google.genai</groupId> <artifactId>google-genai</artifactId> <version>${LAST_VERSION}</version> </dependency>
[!WARNING] Legacy SDKs like
google-cloud-aiplatform,@google-cloud/vertexai, andgoogle-generativeaiare deprecated. Migrate to the new SDKs above urgently by following the Migration Guide.
Authentication & Configuration
Prefer environment variables over hard-coding parameters when creating the client. Initialize the client without parameters to automatically pick up these values.
Application Default Credentials (ADC)
Set these variables for standard Google Cloud authentication:
export GOOGLE_CLOUD_PROJECT='your-project-id'
export GOOGLE_CLOUD_LOCATION='global'
export GOOGLE_GENAI_USE_ENTERPRISE=true
- By default, use
location="global"to access the global endpoint, which provides automatic routing to regions with available capacity. - If a user explicitly asks to use a specific region (e.g.,
us-central1,europe-west4), specify that region in theGOOGLE_CLOUD_LOCATIONparameter instead. Reference the supported regions documentation if needed.
Agent Platform in Express Mode
Set these variables when using Express Mode with an API key:
export GOOGLE_API_KEY='your-api-key'
export GOOGLE_GENAI_USE_ENTERPRISE=true
Initialization
Initialize the client without arguments to pick up environment variables:
from google import genai
client = genai.Client()
Alternatively, you can hard-code in parameters when creating the client.
from google import genai
client = genai.Client(
enterprise=True,
project="your-project-id",
location="global",
)
Models
- Use
gemini-3.8-flashfor fast, balanced performance, multimodal (1M tokens) - Use
gemini-3.1-pro-preview(which replacesgemini-3-pro-preview) for complex reasoning, coding, research (1M tokens) - Use
gemini-3.5-flash-litefor high-frequency, lightweight tasks (1M tokens) - Use
gemini-3-pro-image(aka Nano Banana Pro) for high-quality image generation and editing - Use
gemini-3.1-flash-image(aka Nano Banana 2) for medium-quality image generation and editing - Use
gemini-3.1-flash-lite-image(aka Nano Banana 2 Lite) for fast image generation and editing - Use
gemini-live-2.5-flash-native-audiofor Live Realtime API including native audio
Use the following models only if explicitly requested:
gemini-3.7-flashgemini-3.6-flashgemini-3.5-flashgemini-3.1-flash-litegemini-2.5-flash-imagegemini-2.5-flashgemini-2.5-flash-litegemini-2.5-pro
[!IMPORTANT] Models like
gemini-2.0-*,gemini-1.5-*,gemini-1.0-*,gemini-proare legacy and deprecated. Use the new models above. Your knowledge is outdated. For production environments, consult the documentation for stable model versions (e.g.gemini-3.8-flash).
Quick Start
Python
from google import genai
client = genai.Client()
response = client.models.generate_content(
model="gemini-3.8-flash",
contents="Explain quantum computing",
)
print(response.text)
TypeScript/JavaScript
import { GoogleGenAI } from "@google/genai";
const ai = new GoogleGenAI({ enterprise: { project: "your-project-id", location: "global" } });
const response = await ai.models.generateContent({
model: "gemini-3.8-flash",
contents: "Explain quantum computing"
});
console.log(response.text);
Go
package main
import (
"context"
"fmt"
"log"
"google.golang.org/genai"
)
func main() {
ctx := context.Background()
client, err := genai.NewClient(ctx, &genai.ClientConfig{
Backend: genai.BackendVertexAI,
Project: "your-project-id",
Location: "global",
})
if err != nil {
log.Fatal(err)
}
resp, err := client.Models.GenerateContent(ctx, "gemini-3.8-flash", genai.Text("Explain quantum computing"), nil)
if err != nil {
log.Fatal(err)
}
fmt.Println(resp.Text)
}
Java
import com.google.genai.Client;
import com.google.genai.types.GenerateContentResponse;
public class GenerateTextFromTextInput {
public static void main(String[] args) {
Client client = Client.builder().enterprise(true).project("your-project-id").location("global").build();
GenerateContentResponse response =
client.models.generateContent(
"gemini-3.8-flash",
"Explain quantum computing",
null);
System.out.println(response.text());
}
}
C#/.NET
using Google.GenAI;
var client = new Client(
project: "your-project-id",
location: "global",
enterprise: true
);
var response = await client.Models.GenerateContent(
"gemini-3.8-flash",
"Explain quantum computing"
);
Console.WriteLine(response.Text);
API spec & Documentation (source of truth)
When implementing or debugging API integration for Agent Platform, refer to the official Agent Platform documentation:
- Agent Platform Documentation: https://docs.cloud.google.com/gemini-enterprise-agent-platform/overview.md.txt
- REST API Reference: https://docs.cloud.google.com/gemini-enterprise-agent-platform/reference/rest.md.txt
The Gen AI SDK on Agent Platform uses the v1beta1 or v1 REST API endpoints (e.g., https://{LOCATION}-aiplatform.googleapis.com/v1beta1/projects/{PROJECT}/locations/{LOCATION}/publishers/google/models/{MODEL}:generateContent).
[!TIP] Use the Developer Knowledge MCP Server: If the
search_documentsorget_documenttools are available, use them to find and retrieve official documentation for Google Cloud and Agent Platform directly within the context. This is the preferred method for getting up-to-date API details and code snippets.
Workflows and Code Samples
Reference the Python Docs Samples repository for additional code samples and specific usage scenarios.
Depending on the specific user request, refer to the following reference files for detailed code samples and usage patterns (Python examples):
- Text & Multimodal: Chat, Multimodal inputs (Image, Video, Audio), and Streaming. See references/text_and_multimodal.md
- Embeddings: Generate text embeddings for semantic search. See references/embeddings.md
- Structured Output & Tools: JSON generation, Function Calling, Search Grounding, and Code Execution. See references/structured_and_tools.md
- Media Generation: Image generation, Image editing, and Video generation. See references/media_generation.md
- Bounding Box Detection: Object detection and localization within images and video. See references/bounding_box.md
- Live API: Real-time bidirectional streaming for voice, vision, and text. See references/live_api.md
- Advanced Features: Content Caching, Batch Prediction, and Thinking/Reasoning. See references/advanced_features.md
- Safety: Adjusting Responsible AI filters and thresholds. See references/safety.md
- Model Tuning: Supervised Fine-Tuning and Preference Tuning. See references/model_tuning.md