Skip to main content

Week 18 - Applications & Implications - AI Horse BOOK (Executive Summary)

AI Horse BOOK is an interactive smart book robot that combines conversational AI, remote-controlled motion, MIDI music playback, and graphical block-based programming. Designed for youth STEAM education, it lowers the barrier to entry through visual coding, enabling teenagers to explore programming, robotics, and music creation in a single integrated platform.

Current Status (Week 18)

Project Status Dashboard

SubsystemStatus
Book shell / mechanical structureDesign finalized, pending assembly
Motion chassis (Horse gaits)Motor/servo driver testing passed
MIDI music moduleAudio output verified
Voice conversation systemOffline/online dual-mode available
Graphical programming environmentBlock editor prototype complete
Remote control (Bluetooth/2.4G)Pairing test passed
Full system integration⚠️ Core task for this week

Feature Scope

Core Closed Loop

  • Input: Voice commands / Remote control buttons / Graphical block logic

  • Processing: MCU parses instructions → dispatches to motion/music/voice subsystems

  • Output: Horse gait motion + MIDI music playback + Voice conversation responses

  • Programming: Drag-and-drop blocks generate code → Wireless upload/real-time control

Motion Modes

  • Remote control mode (gamepad/phone app controls Horse gaits)

  • Programming mode (custom motion sequences via block programming)

  • Not included: Autonomous navigation, obstacle avoidance (educational context prioritizes safe manual control)

Music Features

  • MIDI protocol output (16 channels)

  • Block programming controls pitch/rhythm/timbre

  • Supports real-time performance and preset track playback

Graphical Programming Environment

  • Blockly/Scratch-style visual editor

  • Block categories: Motion, Sound, Control, Sensors

  • One-click Python/Arduino code generation

  • WiFi/Bluetooth wireless upload

Differentiation from Existing Products

DimensionExisting SolutionsAI Horse BOOK
Form factorSeparate robot / dev boardsIntegrated book form factor
ProgrammingPure code / single graphical toolVisual blocks + code side-by-side
Music capabilityExternal modules, no programming integrationBuilt-in MIDI, block-level note control
MotionWheeled/quasi-leg demo onlyProgrammable Horse gaits
InteractionButtons / App onlyVoice + remote control dual-channel
Target audienceMakers / hobbyistsYouth STEAM beginners (ages 8–16)

Bill of Materials (BOM) Summary

Estimated cost: ¥800–1200 (excluding 3D printing/laser cutting)

CategoryKey Items
Main controllerESP32-S3 / Raspberry Pi Pico W
MotionServos ×4 (Horse quadruped gait) or wheeled drive
MusicMIDI audio module / Buzzer / Audio amp + speaker
Display1.3" / 2.0" OLED or TFT
VoiceMicrophone + amp + speaker (offline voice module)
Remote controlBluetooth/2.4G gamepad or phone app
Structure3D printed shell (book form) + Laser-cut panels
Battery18650 / LiPo pack (5V/2A supply)
ProgrammingBlock editor (Web / Local client)

In-House Design & Fabrication

CategoryKey Items
Main controllerESP32-S3 / Raspberry Pi Pico W
MotionServos ×4 (Horse quadruped gait) or wheeled drive
MusicMIDI audio module / Buzzer / Audio amp + speaker
Display1.3" / 2.0" OLED or TFT
VoiceMicrophone + amp + speaker (offline voice module)
Remote controlBluetooth/2.4G gamepad or phone app
Structure3D printed shell (book form) + Laser-cut panels
Battery18650 / LiPo pack (5V/2A supply)
ProgrammingBlock editor (Web / Local client)

Fabrication Processes Involved

ProcessApplication
3D DesignBook enclosure, Horse leg structures, internal mounts
Electronics DesignMain carrier board (KiCad), Power board
Additive ManufacturingFDM printing of shell/structure parts
Subtractive ManufacturingLaser cutting of cover/panels
Embedded ProgrammingESP32 + multi-peripheral drivers
NetworkingWebSocket/HTTP communication, Web control console
Software EngineeringBlock editor web app, Code generator
System IntegrationHardware-software co-debug, End-to-end flow testing

Week 20 Success Criteria

Full integration: Shell + mainboard + motion + music + voice + screen assembled as a complete book robot

Motion: Remote-controlled forward/backward/turning/gait switching

Music: MIDI track playback + block-programmed note/chord control

Voice: Wake word + basic voice commands (move forward/backward, play/stop music)

Graphical programming: Block-assembled motion+music routine runs successfully via OTA

User experience: A teenager can grasp basic operations within 5 minutes

Documentation: User manual + Technical BOM + Open-source code repository

Educational Value & Ethical Considerations

Target Audience

Youth aged 8–16

School STEAM clubs, beginner programming classes

Parent-child family education settings

Learning Objectives

Understand sequencing, loops, and conditionals through block programming

Connect abstract code to physical robot behavior

Spark interest in robotics, music, and programming

Cultivate creativity and problem-solving skills

Safety & Ethics

Servo speed limited to prevent finger pinching

Battery charging protection circuit + low-battery alert

Voice dialogue vetted offline command set (no sensitive content)

Zero collection of user privacy data

Code generation is transparent and auditable

Timeline (~1 Week to Showcase)

Date Task 6/5–6 Structural assembly + Core circuit soldering + Power-on testing 6/7 Motion debugging + MIDI music testing 6/8 Voice wake-up + End-to-end block programming integration 6/9–10 Photography + Slide/video production + Preliminary user testing 6/11 Week 20 Online Presentation

Core Philosophy

Make programming visible, tangible, and audible.

Empower every child to build their own musical pony.