Skip to main content
Origami AI can run AI inference entirely on your device using WebGPU and WebLLM—no internet connection required after the initial model download. If you prefer a cloud provider, or if your machine doesn’t support WebGPU, you can route requests to any OpenAI-compatible API endpoint instead. Both modes are available simultaneously, and you can mix them per feature.

​
Local WebLLM (Default)

Open ⚙️ Settings → WebLLM to configure on-device inference.

​
Enable / Disable Local AI

Use the Enable local AI toggle to turn WebLLM on or off globally. When disabled, Origami AI falls back to your configured cloud API for all AI tasks. When enabled, local inference is used by default unless you override it per feature in Settings → API.

​
Model Selection

Pick the model you want to load from the model list. Models download on first use and are cached in your browser’s storage. Only one model is loaded at a time to preserve tab stability.

​
Precision Filter

Filter the model list by numerical format:

​
Capability Filter

Narrow the model list by what the model can process:

​
Available Models

On machines with limited GPU memory, start with Gemma 2 2B or Llama 3.2 1B. Both deliver solid narration quality and load quickly, leaving headroom for FFmpeg rendering and TTS synthesis running in parallel.

​
Using a Cloud API Instead

Open ⚙️ Settings → API to connect an OpenAI-compatible cloud provider. Cloud API and local WebLLM are not mutually exclusive—you can enable cloud for specific tasks while keeping local inference for others.

​
Connection Settings

Example endpoint URLs:

​
Supported Providers

Origami AI works with any OpenAI-compatible API, including:
  • OpenAI (GPT-4o, GPT-4o-mini, etc.)
  • Google Gemini (gemini-2.0-flash, gemini-1.5-pro, etc.)
  • OpenRouter (access hundreds of models through a single key)
  • Groq (fast inference for open-source models)
  • Ollama (run models locally with an OpenAI-compatible server)

​
Per-Feature Overrides

Use the checkboxes in Settings → API to enable cloud routing for specific tasks independently:

​
AI Prompt Customization

Open ⚙️ Settings → AI Prompt to customize how Origami AI generates narration scripts. You can adjust:
  • Narration tone — formal, conversational, enthusiastic, concise
  • Narration length — short summaries vs. in-depth explanations
  • Generation behavior — system prompt and context hints that guide every script the AI writes
Changes here apply globally to all script generation, but you can always edit individual slide scripts in the Slide Editor after generation.
Your API key is stored exclusively in your browser’s local IndexedDB store. It is never transmitted to Origami AI’s servers and is not included in any telemetry.