The Open-Source AI-Assisted Embedded HMI Studio for ESP32-P4 that transforms natural language into production-ready LVGL applications, reusable widgets, native assets and standalone ESP-IDF projects.
If ForgeUI Studio helped accelerate your embedded development, saved you from proprietary ecosystem lock-in, or slashed your interface compilation times, please leave a GitHub Star! Stars are our open-source currencyβthey drive visibility, fund community development, and ensure this framework remains 100% free and subscription-free forever.
Real-world runtime logs captured directly via idf_monitor.py on the physical Waveshare ESP32-P4-WiFi6-Touch-LCD-7B system hardware platform running intensive vector widgets over full layered 1024x600 alpha-blended high-contrast textures show:
- Fluid Visuals: Fixed, rock-solid 63 FPS continuous hardware-accelerated rendering loop profiles.
- Minimal Processor Overhead: Low 2.5% CPU utilization footprint under active layout rendering passes.
- Sub-Millisecond Drawing Passes: Ultra-low 2ms to 5ms draw cycle updates across complex layered geometries.
- Silicon Optimization: Deep core configuration scripts unlock the high-performance dual-core RISC-V processor straight to its high-speed 360MHz CPU frequency.
- Expanded Volatile Memory: Auto-maps a 32MB external Hex-PSRAM bank running at a 200MHz bus clock for massive volatile canvas allocations.
ForgeUI now maintains render parity across:
β Builder Canvas
β Browser Preview
β Generated LVGL Assets
β Physical ESP32-P4 Hardware
Images imported into ForgeUI are automatically processed into native device-sized assets ensuring identical rendering throughout the complete development workflow.
ForgeUI Studio now supports automatic AI-generated Hero Backgrounds that are converted into native LVGL assets during import.
Natural Language Prompt
β
βΌ
OpenAI Image Generation
β
βΌ
PNG Import
β
βΌ
Automatic Device Preprocessing
β
βΌ
Center Crop
β
βΌ
Resize To Active Display
β
βΌ
Native LVGL Asset Generation
β
βΌ
Theme Manager
β
βΌ
Builder Canvas
β
βΌ
Browser Preview
β
βΌ
ESP-IDF Export
β
βΌ
Physical ESP32-P4
β AI Hero Generation
β Automatic Image Processing
β Native LVGL Asset Generation
β Builder Rendering
β Browser Preview
ForgeUI Studio now supports reusable image-based Interactive Buttons with independent Normal and Pressed visual states.
Buttons can be created manually from existing LVGL-ready assets or generated directly with AI.
Button Description
β
βΌ
AI Normal State Generation
β
βΌ
AI Pressed State Generation
β
βΌ
Requested Width & Height
β
βΌ
Interactive Button Preprocessor
β
βΌ
Native-Size PNG Assets
β
βΌ
LVGL C Asset Generation
β
βΌ
Interactive Asset Registry
β
βΌ
Builder Canvas
β
βΌ
Browser Preview
β
βΌ
Native LVGL Export
β
βΌ
Physical ESP32-P4
---
---
## β
Verified End-to-End Development Workflow
ForgeUI Studio has now been physically verified from Builder to hardware using both the integrated Studio workflow and a completely detached exported project.
## π€ AI Studio V2 β Verified End-to-End AI Interface Generation
ForgeUI Studio now includes **ForgeUI AI Studio**, allowing developers to describe interfaces using natural language and generate validated ForgeUI layouts that can be immediately edited, exported, compiled and flashed to physical hardware.
### Proven AI Workflow
```text
Natural Language Prompt
β
βΌ
Layout Prompt Helper (Optional)
β
βΌ
OpenAI GPT
β
βΌ
Validated ForgeUI Layout Document
β
βΌ
Semantic Icon Resolution
β
βΌ
Visual Builder Canvas
β
βΌ
Live Browser Preview
β
βΌ
Native LVGL Code Generation
β
βΌ
Standalone ESP-IDF Project
β
βΌ
Visual Studio Code
β
βΌ
ESP-IDF Build
β
βΌ
Physical ESP32-P4 Hardware
- β AI Layout Prompt Helper
- β Live GPT integration
- β Structured ForgeUI layout generation
- β Automatic JSON validation
- β Component validation
- β Semantic icon resolution
- β Native icon asset generation
- β One-click Canvas insertion
- β Live Browser Preview
- β Native LVGL code generation
- β Standalone ESP-IDF project generation
- β Physical ESP32-P4 deployment
ForgeUI Studio transforms natural-language interface ideas into fully native LVGL applications while preserving a pure ESP-IDF workflow. Every generated layout remains fully editable before export, giving developers complete control over the final firmware.
ForgeUI Studio
β
βΌ
Visual Builder / AI Playground
β
βΌ
Canvas & Live Browser Preview
β
βΌ
Native LVGL Code Generation
β
βΌ
Standalone ESP-IDF Export
β
βΌ
Visual Studio Code
β
βΌ
ESP-IDF Build System
β
βΌ
Ninja Toolchain
β
βΌ
ESP32-P4 Hardware
- β Visual Builder and Canvas
- β AI Layout Generation
- β Layout Prompt Helper
- β Semantic Icon Pipeline
- β Browser Preview
- β Native LVGL Code Generation
- β Standalone ESP-IDF Export
- β Independent Visual Studio Code Build
- β ESP-IDF v5.5 Compatibility
- β Physical ESP32-P4 Flash Validation
ForgeUI Studio now includes built-in firmware maintenance tools to keep generated projects clean during rapid AI iteration.
Regenerates the generated project while preserving user assets.
Rebuilds:
main/CMakeLists.txt90_Studio_Export.c90_Studio_Export.h
Preserves:
- Uploaded assets
- AI-generated themes
- Generated icons
Performs a complete firmware cleanup before rebuilding.
Actions:
- Removes temporary build files
- Clears ESP-IDF build output
- Regenerates CMake
- Regenerates Studio export files
- Performs a clean rebuild
- Flashes the physical ESP32-P4
This eliminates stale generated files, historical assets and cached build artefacts, ensuring every deployment is produced from a clean project state.
ForgeUI Studio completely removes the engineering overhead of setting up modern embedded display architectures:
[Eliminated Workspace Overhead] [Preserved Native Low-Level Control]
Manual coordinate calculations ββββΊ Pure Native C Code Syntax Structures
Monolithic UI programming ββββΊ Standard ESP-IDF Toolchain Optimization
Manual graphic file formatting ββββΊ Raw 2D-DMA Hardware Acceleration Loops
Complex CMake script management ββββΊ Zero Web Runtimes Ever Deployed to Flash
No HTML, CSS, JavaScript, Node.js, or browser runtimes ever deploy onto the microcontroller. Everything compiles down into pure embedded firmware.
-
Visual Canvas β Drag, drop, resize and configure LVGL components including Buttons, Text, Images, Charts, Arcs, Bars, Scales, LEDs, Calendars, Rollers, Switches and many more.
-
AI Layout Designer β Generate complete embedded HMI layouts from natural language using the integrated ForgeUI AI Playground.
-
AI Layout Prompt Helper β Guided prompt builder for creating structured industrial dashboards and embedded interfaces.
-
AI Asset Designer β Generate reusable ForgeUI widgets and standalone industrial artwork using AI.
-
Forge Asset Library β Save, organise, reuse and insert AI-generated widgets and artwork across projects.
-
Dynamic Theme Manager V2 β Includes 25+ built-in industrial themes with persistent hero backgrounds and custom asset support.
-
Semantic Icon Browser β Search and use over 9,500 React Icons. AI-generated icon requests are automatically resolved into native LVGL-ready assets.
-
Live Browser Preview β Instantly preview layouts, widgets, themes and assets before exporting or flashing hardware.
-
Device-Aware Image Processing β Automatically preprocesses imported artwork and AI-generated images for the active display resolution.
-
Native LVGL Asset Generation β Converts PNG, JPG and SVG assets into optimized LVGL image resources using the local
LVGLImage.pypipeline. -
Automatic Asset Registry β Manages uploaded images, icons, AI artwork and generated assets with automatic LVGL conversion and project integration.
-
Theme & Hero Pipeline β AI-generated hero backgrounds integrate directly into the Theme Manager, Builder Canvas and Browser Preview.
-
One-Click Build & Flash β Build, deploy and monitor firmware directly from ForgeUI Studio.
-
Clean Build & Flash β Regenerates project files, refreshes CMake, performs a clean ESP-IDF build and flashes the physical device.
-
Inline Flash Console β Streams live build output, firmware logs and deployment status directly inside the Studio.
-
Standalone ESP-IDF Export β Generate fully independent ESP-IDF projects that build directly in Visual Studio Code without requiring ForgeUI Studio.
-
Native ESP32-P4 Workflow β Zero cloud runtime, zero embedded web technologies. Every interface compiles into pure native LVGL C running on physical ESP32-P4 hardware.
- AI Layout Generation
- AI Layout Prompt Helper
- AI Hero Background Generation
- AI Asset Designer
- AI Artwork Generation
- Forge Asset Library
- Reusable Widget Library
- Semantic Icon Resolution
- Native Icon Asset Generation
- Device-Aware Image Processing
- Native LVGL Asset Generation
- Theme Manager Integration
- Asset Manager Integration
AI Artwork / Hero Prompt β βΌ OpenAI Image Generation β βΌ ForgeUI Asset Import β βΌ Automatic Device Preprocessing β βΌ Native 1024Γ600 Processing β βΌ LVGLImage.py β βΌ Generated LVGL C Asset β βΌ ForgeUI Asset Registry β βΌ Theme Manager / Asset Library β βΌ Builder Canvas β βΌ Live Browser Preview β βΌ Native LVGL Code Export β βΌ Standalone ESP-IDF Project β βΌ Build & Flash β βΌ Physical ESP32-P4
Clicking Export Standalone Project completely decouples ForgeUI Studio from the generated firmware, producing a fully independent ESP-IDF workspace that can be built, flashed, version controlled, and shared without requiring ForgeUI Studio.
The exported project has been physically verified by:
- β Opening directly in Visual Studio Code
- β Building with the Espressif ESP-IDF Extension
- β Flashing to a physical ESP32-P4
- β Running independently of ForgeUI Studio
ForgeUI Studio
β
βΌ
Export Standalone Project
β
βΌ
Independent ESP-IDF Workspace
β
βΌ
Visual Studio Code Workspace
β
βΌ
Official ESP-IDF Extension Build
β
βΌ
Ninja Toolchain Binary Flash
β
βΌ
Physical ESP32-P4 Hardware Run
Example Export Destination Target:
C:\ForgeUI-Exports\ForgeUI_Export_003
Project Structural Workspace Directory Tree:
esp32p4-ui-studio/
βββ studio/ # React / Next.js visual builder workspace
βββ tools/lvgl/LVGLImage.py # Local offline raw LVGL asset asset converter
βββ firmware/ForgeUI-One/ # Standalone ESP-IDF reference deployment target
βββ .vscode/ # Pre-configured editor workspace files
βββ partitions.csv # Linear flash partition memory layouts
βββ sdkconfig.defaults # Default optimization settings and frequency parameters
βββ sdkconfig # Actively generated target compilation properties
βββ CMakeLists.txt # Top-level project build declaration file
βββ main/
βββ assets/uploads/ # Auto-converted target image data structs (.c)
βββ 00_ForgeUI_Config.h # Global canvas pin constraints and geometric definitions
βββ 01_FG_Runtime.c/.h # Threaded interface redraw hooks and execution timers
βββ 20_RTC.c/.h # Native I2C real-time system clock drivers (DS3231)
βββ 30_Audio.c/.h # Asynchronous MP3 / WAV hardware decoding runtimes
βββ 30_WIFI.c/.h # Hosted SDIO Wi-Fi wireless co-processor management (ESP32-C6)
βββ 40_SD.c/.h # FATFS system memory interface drivers
βββ 90_Studio_Export.c # Clean native generated LVGL 9 application source code
ForgeUI Studio maintains absolute ownership over visual project generation layouts, while ESP-IDF maintains total ownership over low-level code compilation and hardware deployment.
Following export, the directory acts as an independent application. Developers are completely free to track progress inside isolated Git repositories and integrate backend modifications without vendor lock-in.
Your exported code incorporates a high-capacity custom allocation scheme designed to prevent memory overflows when managing dense layout interface assets:
factory(8 MB /0x10000, 8M): Massive linear code space window allocated exclusively for user runtime firmware logic, application states, and UI layouts.storage(7 MB /0x810000, 7M): High-capacity dedicated local SPIFFS partition block ensuring static background structures and image file array matrices remain safe from software layer collisions.
- Direct 2D-DMA Tunneling: The display refresh configuration parameters (
bsp_display_cfg_t) lock pixel allocation pathways directly to active DMA engines (.buff_dma = true) while enforcing direct internal RAM layout tracking (.buff_spiram = false). This completely eliminates frame rendering transmission latency over slower external memory lanes. - Thread-Safe Graphics Handshaking: Visual initialization calls inside
main.care fully encapsulated within native Espressif display locks (bsp_display_lock(0)), ensuring your graphic compositions update with complete structural integrity across multi-core task switches.
Build it.
Prove it.
Flash it.
Improve it.
Repeat.
ForgeUI Studio has now proven:
β Visual Builder
β AI Layout Generation
β AI Layout Prompt Helper
β AI Hero Background Generation
β AI Asset Designer
β AI Artwork Generation
β Forge Asset Library
β Reusable Widget Library
β Semantic Icon Pipeline
β Native Icon Asset Generation
β Device-Aware Asset Pipeline
β Automatic Image Preprocessing
β Native LVGL Asset Generation
β Theme Manager Integration
β Browser Preview
β Native LVGL Export
β Standalone ESP-IDF Export
β Independent Visual Studio Code Build
β One-Click Build & Flash
β Physical ESP32-P4 Validation
Hi, I'm Scott Forster from New Zealand.
ForgeUI Studio began as a personal project to make embedded HMI development easier, faster and more enjoyable. As someone who enjoys solving real engineering problems, I wanted a tool that could take an idea from a simple prompt all the way through to a working interface running on physical ESP32 hardware.
Every feature in ForgeUI is developed with a simple philosophy:
Build it. Prove it. Flash it. Improve it.
The project has grown into an open-source AI-assisted embedded UI platform combining visual design, AI-powered generation, LVGL, and ESP-IDF into a single workflow.
ForgeUI Studio is developed in collaboration with ChatGPT, which serves as a coding assistant, architectural sounding board and rapid prototyping partner. While I define the vision, validate the hardware and direct the engineering, ChatGPT helps accelerate implementation, refactoring and documentation., which has been an invaluable coding assistant, sounding board and development partner throughout the project. While I design the architecture, test the hardware and drive the vision, ChatGPT has helped accelerate development by assisting with implementation, refactoring and documentation.
This project is shared with the community in the hope that it makes embedded development more accessible and inspires others to build amazing products.
I welcome feedback, ideas and contributions from developers around the world.
Scott Forster
Creator & Lead Developer β ForgeUI Studio