Week 18 - Applications & Implications - AI Horse BOOK
AI Horse BOOK is an interactive smart book robot that combines conversational AI, remote-controlled motion, MIDI music playback, and graphical block-based programming. Designed for youth STEAM education, it lowers the barrier to entry through visual coding, enabling teenagers to explore programming, robotics, and music creation in a single integrated platform.
Timeline
📅 Weekly Timeline & Deliverables
| Week | Module | Core Tasks & Final Project (AI Horse Book) Progress | Stage Milestones & Deliverables |
|---|---|---|---|
| 01 | Project Management | Set up the personal documentation website using Docusaurus; configure Git for version control and repository initialization. | 🔧 Personal documentation site live |
| 02 | Computer Aided Design | Draw 2D/3D conceptual sketches and initial digital models of the horse body, and pop-up book chassis. | 📐 3D conceptual model of mechanical structures |
| 03 | Computer Controlled Cutting | Laser-cut cardboard/acrylic prototypes of the book shell to verify living hinges and basic mechanical transmissions. | physical cardboard mechanism prototype |
| 04 | Embedded Production | Master MCU fabrication processes and test different PCB milling/production methods to prepare for custom board design. | ⚡ Successfully flashed and ran basic MCU circuits |
| 05 | 3D Scanning and Printing | 3D print the initial horse body and complex mechanical joint components; test multi-axis rotation tolerances and fits. | 🖨️ 3D printed functional joint components |
| 06 | Embedded Programming | Select the ESP32 microcontroller; write fundamental GPIO control scripts using the MicroBlocks live programming environment. | 💻 Interactive embedded programming environment set up |
| 07 | Computer Controlled Machining | Use a large-scale CNC router to machine the heavy wooden outer casing of the book or build a robust automated display stand. | 🪵 CNC-machined rigid outer structure |
| 08 | Electronics Design | Design the PCB V1 core controller board . | 🎛️ Custom controller schematic and PCB layout |
| 09 | Output Devices | Introduce the N20 DC geared motor and write control routines to drive the 4-leg linkage mechanism for the first time. | ⚙️ Actuation and power drive module functional |
| 10 | Input Devices | Integrate analog audio ,use Xiaozhi-esp32 for AI vocie chat ; test controlling the horse's start/stop states via voice | 🎙️ Audio signal input successfully tuned |
| 11 | Library / Break | Optimize core code architecture; refine input/output logic to ensure the stability of fundamental hardware and software systems. | 🔒 Core low-level hardware and firmware locked |
| 12 | Mechanical Design | Overcome spatial constraints: replace the tall standard N20 motor with a flat worm gear motor, and 3D print a matching 19-tooth gear. | 🏇 Actuation system successfully fits inside the Book Box |
| 13 | Machine Design | Collaborate with the group to design an automated machine, deepening understanding of multi-axis synchronization and system integration. | 🤖 Collaborative automation machine completed |
| 14 | Molding and Casting | Learn molding and casting to create unique visual aesthetic components . | 🧪 Molded high-quality aesthetic decorative casing |
| 15 | Networking & Comm. | Establish wireless communication between the ESP32 controller and the AI edge environment (TensorFlow.js / voice processing end). | 🌐 Wireless IoT interaction channel fully open |
| 16 | Interface and Application | Design a graphical user interface utilizing the MicroBlocks Stage or a Web App to realize intuitive control of the STEM kit. | 🖥️ Graphical User Interface (UI) completed |
| 17 | Applications and Implications | Compile the project Bill of Materials (BOM), analyze production costs, and finalize the deployment strategy for the STEM education kit. | 📋 Comprehensive STEM kit deployment blueprint |
| 18 | Invention, IP and Income | Formulate Intellectual Property (IP) strategy; determine open-source licenses (MIT/CC) and complete open-source compliance docs. | 🛡️ Open-source license and copyright declaration |
| 19 | Project Development | Final integration: assemble page-turning , AI voice control, and horse mechanics; perform continuous stability tests. | 🏁 Fully functional MVP smart kit completed |
| 20 | Project Presentation | Produce the 1-minute video (presentation.mp4) and 1920x1080 slide (presentation.png); present final defense. | 🎓 Successful defense of the Fab Academy Final Project |
Feature Scope
Core Closed Loop
-
Input: Voice commands / Remote control buttons / Graphical block logic
-
Processing: MCU parses instructions → dispatches to motion/music/voice subsystems
-
Output: Horse gait motion + MIDI music playback + Voice conversation responses
-
Programming: Drag-and-drop blocks generate code → Wireless upload/real-time control
Motion Modes
-
Remote control mode (gamepad/phone app controls Horse gaits)
-
Programming mode (custom motion sequences via block programming)
Music Features
-
MIDI protocol output
-
Block programming controls pitch/rhythm/timbre
-
Supports real-time performance and preset track playback
Graphical Programming Environment
-
Blockly/Scratch-style visual editor
-
Block categories: Motion, Sound, Control, Sensors
-
WiFi/Bluetooth wireless upload
Differentiation from Existing Products
| Dimension | Existing Solutions | AI Horse BOOK |
|---|---|---|
| Form factor | Separate robot / dev boards | Integrated book form factor |
| Programming | Pure code / single graphical tool | Visual blocks + code side-by-side |
| Music capability | External modules, no programming integration | Built-in MIDI, block-level note control |
| Motion | Wheeled/quasi-leg demo only | Programmable Horse gaits |
| Interaction | Buttons / App only | Voice + remote control dual-channel |
| Target audience | Makers / hobbyists | Youth STEAM beginners (ages 8–16) |
Bill of Materials (BOM) Summary
Estimated cost: ¥300–400 (excluding 3D printing/laser cutting)
| Category | Key Items |
|---|---|
| Main controller | ESP32 Dev 38pin + ESP32-S3 |
| Motion | N20 Motor (Horse quadruped gait) or wheeled drive |
| Music | MIDI audio module / Buzzer / Audio amp + speaker |
| Display | 0.96OLED |
| Voice | Microphone + amp + speaker ( voice module) |
| Remote control | Bluetooth/2.4G gamepad or phone app |
| Structure | 3D printed shell (book form) + Laser-cut panels |
| Battery | 18650 / LiPo pack (5V/2A supply) |
| Programming | Block editor (Web / Local client) |
In-House Design & Fabrication
| Category | Key Items |
|---|---|
| Main controller | ESP32 、ESP32-S3 |
| Motion | N20 (Horse quadruped gait) or wheeled drive |
| Music | MIDI audio module / Buzzer / Audio amp + speaker |
| Display | 0.96 OLED |
| Voice | Microphone + amp + speaker (offline voice module) |
| Remote control | Bluetooth/2.4G gamepad or phone app |
| Structure | 3D printed horse + Laser-cut (book form) |
| Battery | 18650 / LiPo pack (5V/2A supply) |
| Programming | Block editor (Web / Local client) |
Fabrication Processes Involved
| Process | Application |
|---|---|
| 3D Design | Book enclosure, Horse leg structures, internal mounts |
| Electronics Design | Main carrier board (EasyEDA) |
| Additive Manufacturing | FDM printing of shell/structure parts |
| Subtractive Manufacturing | Laser cutting of cover/panels |
| Embedded Programming | ESP32 + multi-peripheral drivers |
| Networking | MQTT/HTTP communication, Web control console |
| Software Engineering | Block editor web app, Code generator |
| System Integration | Hardware-software co-debug, End-to-end flow testing |
Week 20 Success Criteria
Full integration: Shell + mainboard + motion + music + voice + screen assembled as a complete book robot
Motion: Remote-controlled forward/backward/turning/gait switching
Music: MIDI track playback + block-programmed note/chord control
Voice: Wake word + basic voice commands (move forward/backward, play/stop music)
Graphical programming: Block-assembled motion, music routine runs successfully
User experience: A teenager can grasp basic operations within 5 minutes
Documentation: User manual + Technical BOM + Open-source code repository
Educational Value & Ethical Considerations
Target Audience
Youth aged 8–16
School STEAM clubs, beginner programming classes
Parent-child family education settings
Learning Objectives
Understand sequencing, loops, and conditionals through block programming
Connect abstract code to physical robot behavior
Spark interest in robotics, music, and programming
Cultivate creativity and problem-solving skills
Safety & Ethics
Servo speed limited to prevent finger pinching
Battery charging protection circuit + low-battery alert
Voice dialogue vetted offline command set (no sensitive content)
Zero collection of user privacy data
Code generation is transparent and auditable
Core Philosophy
Make programming visible, tangible, and audible.
Empower every child to build their own musical pony.