firebase-ai-logic-basics

작성자: firebase

Firebase AI Logic(Gemini API)를 웹 애플리케이션에 통합하기 위한 공식 스킬입니다. 설정, 멀티모달 추론, 구조화된 출력 및 보안을 다룹니다.

npx skills add https://github.com/firebase/agent-skills --skill firebase-ai-logic-basics

Firebase AI Logic Basics

Overview

Firebase AI Logic is a product of Firebase that allows developers to add gen AI to their mobile and web apps using client-side SDKs. The app can directly call Gemini models via Firebase AI Logic without the developer needing to manage a dedicated backend. Firebase AI Logic was previously known as "Vertex AI for Firebase".

It supports the two Gemini API providers:

  • Gemini Developer API: It has a free tier ideal for prototyping, and pay-as-you-go for production
  • Agent Platform Gemini API (formerly branded Vertex AI): Ideal for scale with enterprise-grade production readiness, requires Blaze pricing plan

Use the Gemini Developer API as a default, and only Agent Platform Gemini API (formerly branded Vertex AI) if the application requires it.


Setup & initialization

Prerequisites

  • Identify the platform the user is interested in building on prior to starting: Android, iOS, Web, or Flutter.
  • If their platform is unsupported, Direct the user to Firebase Docs to learn how to set up AI Logic for their application (share this link with the user https://firebase.google.com/docs/ai-logic/get-started)
  • The Firebase CLI commands below run through npx on every platform, so they need Node.js 20+ and npm. Use the firebase-basics skill to check for them and to log in to the Firebase CLI. If Node.js is missing or older than version 20, ask the user to install it as that skill describes. Don't install system packages yourself, for example with sudo apt-get, because that changes the user's machine without their consent.

1. Provision Firebase AI Logic (ALL platforms)

Use the Firebase CLI to provision Firebase AI Logic for the Firebase Project:

  1. Make sure that you're in a firebase directory (with a firebase.json).

  2. Verify that you're running Firebase CLI commands against the intended Firebase Project. When you run this command, the active project is marked with "current":

    npx -y firebase-tools@latest projects:list
    
  3. Make sure there's at least one Firebase App for the target platform registered with the current Firebase Project:

    npx -y firebase-tools@latest apps:list
    
  4. Provision Firebase AI Logic for the Firebase Project:

    npx -y firebase-tools@latest init ailogic
    

    This command will enable the Gemini Developer API in the Firebase project.

[!WARNING] CRITICAL: Provisioning Firebase AI Logic is Required For all platforms (Android, iOS, Web, or Flutter), even if the app already uses Firebase, you MUST run npx -y firebase-tools@latest init ailogic to provision the service. The configuration files of GoogleService-Info.plist, google-services.json, and firebase_options.dart ONLY handle client configuration and do NOT enable the Firebase AI Logic service, leading to PERMISSION_DENIED errors.

If you can't run init ailogic yourself (for example because Node.js is missing or the Firebase CLI isn't logged in) do NOT skip it. The app's requests to Gemini models will fail until the Firebase AI Logic service is provisioned. Tell the user to run this command in their project directory, and include it in your final summary:

npx -y firebase-tools@latest init ailogic

2. Add the SDK and initialize the service in the app

Adding the SDK dependency and initializing the service are platform-specific. Before writing code, read the reference for the target platform listed under Initialization Code References.

More info in Firebase AI Logic Getting Started


Core Capabilities

[!WARNING] CRITICAL: Use current model names: Always check the Firebase AI Logic Models documentation for the currently supported model names. Do NOT use any Gemini 1.x or Gemini 2.x models (such as gemini-1.5-flash, gemini-1.5-pro, gemini-2.0-flash, gemini-2.0-pro, gemini-2.5-flash, gemini-2.5-flash-lite, or gemini-2.5-pro), as older models are deprecated or shut down. Always use a currently supported Gemini 3+ model; if URL access is blocked in your environment, proceed directly without searching local files.

Text-Only Generation

Multimodal (Text + Images/Audio/Video/PDF input)

Firebase AI Logic allows Gemini models to analyze image files directly from your app. This enables features like creating captions, answering questions about images, detecting objects, and categorizing images. Beyond images, Gemini can analyze other media types like audio, video, and PDFs by passing them as inline data with their MIME type. For files larger than 20 megabytes (which can cause HTTP 413 errors as inline data), store them in Cloud Storage for Firebase and pass their URLs to the Gemini Developer API.

Chat Session (Multi-turn)

Maintain history automatically using startChat.

Streaming Responses

To improve the user experience by showing partial results as they arrive (like a typing effect), use generateContentStream instead of generateContent for faster display of results.

Text-to-Speech (TTS) Generation

Generate spoken audio directly on client devices without a custom speech backend. Firebase AI Logic supports speech synthesis using dedicated Gemini TTS models:

  • Supported Models: gemini-3.1-flash-tts-preview
  • Capabilities:
    • Single-speaker voice persona selection (voiceName) and multi-speaker dialogues (up to 2 distinct speakers) via SpeechConfig / MultiSpeakerVoiceConfig
    • Direct audio responses by setting responseModalities to audio
    • Streaming speech responses with generateContentStream for low-latency playback
    • Audio directives ([Audio Profile: ...], [Scene: ...], [Director's Note: ...]) and emotional tags ([whispers], [laughs], [slowly])
    • Client-side decoding and playback of 24 kHz 16-bit linear PCM (audio/l16) or WAV container format (audio/x-wav)

See the Text-to-Speech (TTS) Generation Guide for full implementation details, streaming patterns, and copy-paste code snippets for iOS (Swift), Android (Kotlin), and Web.

Generate Images with Nano Banana

[!WARNING] Use current Image model names: Always check the Firebase AI Logic Models documentation for the currently supported image generation (Nano Banana) model names.

  • Requires an upgraded Blaze pay-as-you-go billing plan.

Search Grounding with the built in googleSearch tool


Supported Platforms and Frameworks

Supported Platforms and Frameworks include Kotlin and Java for Android, Swift for iOS, JavaScript for web apps, Dart for Flutter, and C Sharp for Unity.

Advanced Features

Structured Output (JSON)

Enforce a specific JSON schema for the response.

On-Device AI (Hybrid)

Hybrid inference runs prompts with an on-device model when one is available and falls back to a cloud-hosted model otherwise (or vice versa). Availability and setup steps differ by platform, more info in the hybrid and on-device documentation, which links to each platform's guide.


Security & Production

Firebase App Check

[!WARNING] Critical Safety Requirement: In order to use AI Logic safely, you MUST set up App Check on your app. This prevents unauthorized clients from using your API quota and accessing your backend resources.

See App Check for Firebase AI Logic for setup instructions. Each platform uses its own attestation provider, so follow the instructions for the target platform.

App Check Debug Tokens for Local Development & CI/CD

Because App Check attestation providers (like Play Integrity or DeviceCheck) reject emulators, simulators, or CI environments, you must use App Check Debug Tokens during development and testing to bypass standard attestation.

[!WARNING] CRITICAL: Never Hardcode or Commit Debug Tokens App Check debug tokens allow clients to bypass attestation and access backend resources without a genuine device. Treat them as private secrets. Never commit debug tokens to version control or hardcode raw token strings in client code (Web, Android, iOS, or Flutter). Always inject them through local environment variables, gitignored local configurations, or CI secrets. If a token is compromised, revoke it immediately in the Firebase Console.

Local Development (Auto-Generated)
  1. Configure your code's App Check provider to use the debug factory. The API is platform-specific; see the App Check section of the platform reference or the App Check documentation linked above.
  2. Run your app in the emulator/localhost.
  3. Look at your runtime debugger console / Logcat logs for the generated UUID:
    • Example: AppCheck debug token: "123a4567-b89c-12d3-e456-789012345678"
  4. Register this token in the Firebase Console under Security > App Check > Apps > Manage debug tokens.

💡 Tip (Prevent Debug Token Churn): Simulator or emulator resets, fresh installs, and clearing browser data can make the SDK generate a new debug token that you must register again. To keep a stable debug token without hardcoding it, see the App Check section of the platform reference.

CI/CD Pipelines (Pre-Provisioned)
  1. Generate and register a new debug token in the Firebase Console under Security > App Check > Apps > Manage debug tokens.
  2. Add this token string as an encrypted secret in your CI system (e.g. APP_CHECK_DEBUG_TOKEN).
  3. Configure your build to pass this secret as an environment variable to the SDK during test execution.

Firebase Remote Config

Consider that you do not need to hardcode model names (e.g., a specific model version string). Use Firebase Remote Config to update model versions dynamically without deploying new client code. See Changing model names remotely


Initialization Code References

[!WARNING] CRITICAL: Use current model names: Always check the Firebase AI Logic Models documentation for the currently supported model names. Do NOT use any Gemini 1.x or Gemini 2.x models (such as gemini-1.5-flash, gemini-2.0-flash, gemini-2.5-flash, or gemini-2.5-flash-lite), as older models are deprecated or shut down.

References

Android (Kotlin) SDK usage patterns iOS SDK code examples and usage patterns Web SDK setup, code examples, and usage patterns

Flutter SDK code examples and usage patterns Client-side Text-to-Speech (TTS) generation

firebase의 다른 스킬

developing-genkit-dart
firebase
통합 AI SDK for Dart로 코드 생성, 구조화된 출력, 도구, 플로우 및 에이전트를 지원합니다. 단일 인터페이스로 생성, 도구 정의, 플로우 오케스트레이션, 임베딩 및 스트리밍을 위한 핵심 API를 제공합니다. LLM 제공업체(Google Gemini, Anthropic Claude, OpenAI GPT), Firebase AI, Model Context Protocol, Chrome 브라우저 통합, Shelf를 통한 HTTP 서버 호스팅을 위한 8개 이상의 플러그인을 포함합니다. 플로우 실행, 추적, 모델 실험 등을 위한 로컬 개발 UI가 포함된 내장 CLI를 제공합니다.
developing-genkit-go
firebase
Go에서 Genkit을 사용하여 AI 기반 애플리케이션을 개발합니다. 사용자가 Genkit을 사용하여 Go로 AI 기능, 에이전트, 플로우 또는 도구를 구축하거나 작업할 때 사용합니다.
developing-genkit-js
firebase
Genkit 플로우, 도구 및 멀티 모델 지원을 통해 AI 기반 Node.js/TypeScript 애플리케이션을 구축합니다. Genkit은 제공자에 구애받지 않으며, 플러그인을 통해 Google AI, OpenAI, Anthropic, Ollama 및 기타 LLM 제공자를 지원합니다. Zod를 사용하여 타입 안전 스키마로 플로우를 정의하고, 생성 요청을 실행하며, TypeScript로 다단계 AI 워크플로우를 구성합니다. Genkit CLI v1.29.0+가 필요하며, 최근 주요 API 변경 사항으로 인해 이전 지식이 아닌 현재 패턴을 위해 genkit docs:read 및 common-errors.md를 참조해야 합니다...
developing-genkit-python
firebase
Python에서 Genkit을 사용하여 AI 기반 애플리케이션을 개발합니다. 사용자가 Genkit, AI 에이전트, 플로우 또는 Python 도구에 대해 묻거나 Genkit을 접할 때 사용합니다…
developing-genkit-tooling
firebase
Genkit 도구 제작을 위한 모범 사례로, CLI 명령어와 MCP 서버 도구를 포함합니다. 명명 규칙, 아키텍처 패턴, 일관성 등을 다룹니다…
extension-to-functions-codebase
firebase
설치된 Firebase Extension(또는 확장 프로그램 소스)을 독립형 Cloud Functions for Firebase 코드베이스 또는 게시 가능한 npm 패키지로 변환하는 스킬,…
firebase-ai-logic
firebase
웹 앱을 위한 클라이언트 측 Gemini 통합으로, 멀티모달 추론, 스트리밍, 온디바이스 하이브리드 실행을 지원합니다. 텍스트 전용 및 멀티모달 입력(이미지, 오디오, 비디오, PDF)을 지원하며, 20MB를 초과하는 파일은 Cloud Storage를 통해 라우팅됩니다. 자동 기록이 포함된 채팅 세션, 실시간 디스플레이를 위한 스트리밍 응답, 구조화된 JSON 출력 적용을 제공합니다. Chrome의 Gemini Nano를 통한 온디바이스 하이브리드 추론을 지원하며, 자동으로 클라우드 실행으로 폴백됩니다. 프로덕션 환경에서는 App Check가 필요합니다...
firebase-ai-logic
firebase
Firebase AI Logic(Gemini in Firebase)을 통합하여 지능형 앱 기능을 구현합니다. Firebase 앱에 AI 기능을 추가하거나 생성형 AI를 구현할 때 사용합니다.