Two Open-Source AI Comic Creation Tools Supporting Story-to-Storyboard and Character Sheet Workflows
An architectural overview and setup guide for AI Comic Factory, which generates comic pages from single prompts using LLMs and SDXL, and AI Comic Generator, a J
Open-source AI comic tools span distinct architectures, ranging from single-prompt page generators to structured pipelines that enforce character and layout consistency via JSON. Based on verified GitHub repository metadata and official documentation, this guide covers the core capabilities and local setup paths for AI Comic Factory and AI Comic Generator.

Image source: Official product README: https://github.com/Dapeng960208/AI-Comic-Generator
AI Comic Factory: Single-Prompt Comic Generation Combining LLMs and SDXL
jbilcke-hf/ai-comic-factory (Apache-2.0 license, 1,370 GitHub stars, 325 forks) pairs a Large Language Model (LLM) with SDXL (Stable Diffusion XL) to generate comic panels from a short story description and selected art style. Created on August 25, 2023, the repository lists release 1.2 in its README and provides an official hosted web demo at aicomicfactory.app for immediate testing without local setup.
Rather than functioning as a standalone monolithic binary, the project separates its frontend, backend, LLM inference server, and SDXL rendering engine. Self-hosting or running the project locally requires creating a .env.local file to configure backend inference and rendering providers.
- LLM Engine (
LLM_ENGINE): SupportsINFERENCE_API,INFERENCE_ENDPOINT,OPENAI,GROQ, andANTHROPICto structure story beats and panel captions. - Rendering Engine (
RENDERING_ENGINE): SupportsINFERENCE_API,INFERENCE_ENDPOINT,REPLICATE,VIDEOCHAIN, andOPENAI, defaulting tostabilityai/stable-diffusion-xl-base-1.0andstabilityai/stable-diffusion-xl-refiner-1.0for panel artwork. - Extensibility: Developers can connect private Hugging Face Inference Endpoints running Text Generation Inference (TGI) or fork the codebase to plug in custom Stable Diffusion pipelines.
AI Comic Generator: JSON-Driven Storyboards and Character Sheets with Gemini
Dapeng960208/AI-Comic-Generator (MIT license, 27 GitHub stars, 5 forks), created on January 17, 2026, is a full-stack web application that expands text outlines into structured comic storyboards while managing character reference sheets. Operation requires a Google Cloud API key with access to the Gemini API.
The backend is built with FastAPI, SQLite, SQLModel, and FastAPI BackgroundTasks, paired with a Vue 3, Vite, Element Plus, and Pinia frontend. For AI processing, the application uses gemini-3-flash-preview for text expansion and script structuring alongside gemini-3-pro-image-preview for character and panel image generation.
- Global Configuration (Global Config JSON): Stores story outlines, character profiles, and panel specifications as structured JSON. Updating global art styles, aspect ratios, color palettes, panel spacing, or border styles propagates across all storyboard frames.
- Character Workshop and Visual Consistency: Automatically extracts characters from the script to generate three-view character sheets, then passes those reference images (Image-to-Image) when rendering panels to preserve visual continuity. It also includes a merge feature to deduplicate repeated character entries.
- Single-Panel Redrawing: Allows creators to edit individual panel prompts or actions and trigger single-panel redraws or batch background generation without regenerating the entire comic page.
Local Setup and Architectural Tradeoffs
The two repositories differ substantially in both workflow design and deployment requirements.
AI Comic Factory is designed around Hugging Face Spaces and relies on wiring external API credentials (AUTH_HF_API_TOKEN, AUTH_OPENAI_API_KEY, AUTH_REPLICATE_API_TOKEN, or a self-hosted VideoChain server) into .env.local. By contrast, AI Comic Generator runs both its FastAPI backend and Vue 3 frontend locally, allowing users to register their Google API key and activate text and image models through the top navigation bar's "Models" menu.
Running AI Comic Generator locally requires Python 3.9+, Node.js 16+, and pnpm:
# 1. Configure and start the backend (inside the backend directory)
cd backend
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
alembic upgrade head
uvicorn app.main:app --reload --host 0.0.0.0 --port 8000
# 2. Install dependencies and start the frontend (inside the frontend directory)
cd ../frontend
pnpm install
pnpm dev
Once both services are running, opening http://localhost:5173 provides access to project creation, character sheet generation, and the visual storyboard editor. AI Comic Factory fits rapid single-prompt prototyping and browser-based testing, whereas AI Comic Generator provides finer control for multi-panel workflows that depend on three-view character sheets and targeted panel revisions.
Sources
- GitHub: jbilcke-hf/ai-comic-factory
- GitHub: Dapeng960208/AI-Comic-Generator
- Original X thread: @CY160909