Final Project
Overview
Modern AI systems face a critical energy constraint, so they either rely on cloud processing (creating latency and privacy concerns) or drain batteries quickly with on-device computation.
During the scope of Fab Academy, I'm exploring the fundementals of neuromorphic computing systems that could develop into a later, more robust solution for that issue. My target is to design and fabricatecustom brain-inspired circuit boards that use event-based processing to visualize how neurons work and use brain-inspired software processing within different applicaions.
Right now, I'm exploring different applications for these neuromorphic/neuromorphic-like circuits from robotics to AR/XR systems to brain-computer interfaces, while learning about their capabilities and constraints through hands-on development at Fab Academy.
Throughout the program, I'll be developing, refining, and documenting the complete journey from initial concept to final fabrication.
Project Documents
Initial Proposal
Development Log
Project Goals
- Apply the skills I learn throughout Fab Academy.
- Explore the intersection between computing and neuroscience through building a real-world application of neuromorphic systems fundementals.
- Learn to integrate multidisciplinary skills and knowledge to accomplish a certain goal.
- Share the journey of building such a project with the community.
Systems Diagram
Development Spirals
I'm building the project in three spirals. Spiral 1 is a baseline wearable due by the end of system integration week (May 6), which is a self-deadline xD. Spirals 2 and 3 layer on top of it after that.
Spiral 1 (baseline wearable), due May 6
Forehead enclosure with the electrodes and ATtiny, XIAO ESP32-S3 on the frame, button plus 5 capacitive pads, camera, speaker, color display with optics, external 5000 mAh powerbank. Software does standard EEG processing (filter, band power, blink detection) and renders it on the display. XIAO talks directly over WiFi to my personal-assistant endpoint, which brokers Gemini and my other agents and shares memory.
Spiral 2 (advanced AI + EEG processing)
Layered onto spiral 1 hardware, same physical build:
- Spike encoder on the XIAO converts the ATtiny EEG stream to spike trains.
- Small LIF-SNN classifier runs in PSRAM, trained offline in Python and flashed as weights.
- Output: brain-state classes (focus / attention / blink intent / rest).
- Those classes drive the display: blink-to-click, alpha-gated menus, state-aware UI.
- Assistant endpoint receives brain-state as additional context alongside the user's voice or text input.
Spiral 3 (hardware miniaturization)
Full physical rebuild, software from spiral 2 stays:
- Electrodes plus ATtiny move into the glasses temples, shorter leads, lower pickup noise. Forehead enclosure removed.
- In-frame LiPo cell with charge IC replaces the external USB-C powerbank. Off-body enclosure removed.
- Prescription lens adapter on the frame.
- Upgraded camera module.
Beyond the final-project scope: separate EMG/ECG hand controller for driving the display (future work).
Tasks Timeline
| Week | Dates | Topic | Progress and tasks for final project |
|---|---|---|---|
| W02 | Jan 21-26 | CAD | ✓ Parametric glasses frame in Fusion ✓ Logo in Inkscape |
| W03 | Jan 28-Feb 4 | Computer-controlled cutting | ✓ Multi-layer logo sticker |
| W04 | Feb 9-11 | Embedded programming | ✓ EEG to stepper via Muse (Muse not in the final) ✓ EEG on XIAO with BLE + OLED ✓ OV2640 camera streaming ✓ Chose XIAO ESP32-S3 Sense as main MCU |
| W05 | Feb 18-23 | 3D scanning and printing | ✓ Hanger bracket for XIAO Grove Shield ✓ AR display optics calc |
| W06 | Feb 25-Mar 4 | Electronics design | ✓ LIF neuron PCB in KiCad |
| W07 | Mar 9-11 | Computer-controlled machining | ✓ Non-project build, skills week |
| W08 | Mar 18-23 | Electronics production | ✓ Milled and stuffed my first ever PCB |
| W09 | Mar 25-Apr 1 | Input devices | ✓ Second neuron PCB rev ✓ Step-response capacitive touch work ✓ Neil's feedback on ATtiny diff ADC + PGA for the EEG front-end |
| W10 | Apr 8-13 | Output devices | ✓ 3D press-fit PCB with display, buzzer, LED ✓ Traveling back to Saudi |
| W11 | Apr 15-21 | Networking and communication + midterm review | ✓ Pico W board with step-response touchpads + speaker (board 1) ✓ XIAO ESP32-S3 board with SAMD11C14A + display + button + camera (board 2) ✓ Communication between both ✓ Moving to Japan |
| W12 + break | Apr 22-27 | Mechanical / machine design | ✓ Machine-design team build (coreXYZ, MGN9) ~ Catching up on documentation: week 11 and 12 left ✓ Systems diagram + project timeline ~ Working EEG signal detection through XIAO and SAMD11c14A |
| W14 | Apr 29-May 6 | Molding and casting, spiral 1 work | ☐ Forehead enclosure + glasses frame design in Fusion + print ☐ ATtiny firmware skeleton (ADC read, I2C or UART stream) ☐ Detecting EEG through milled boards ☐ Start schematic merging the two experimental boards |
| W15 | Apr 29-May 6 | Interface programming + system integration, spiral 1 deadline | ☐ Personal-assistant endpoint wired to Gemini + my other agents + shared memory ☐ XIAO to endpoint API over WiFi (REST or WebSocket) ☐ Mill and stuff rev 1 board ☐ Bring-up: power via USB-C, XIAO, ATtiny link, display, speaker, camera, touch, button ☐ Port W04 EEG processing onto ATtiny data ☐ BLE commissioning flow (WiFi credentials + pairing) ☐ Assembly in the 3D-printed frame, cable dress, fit test ☐ End-to-end demo: electrode to ATtiny to XIAO to display + speaker, and XIAO over WiFi to assistant endpoint and back |
| W16 | May 13 | Wildcard, spiral 2 kickoff | ☐ Offline: data collection with the spiral 1 device for labeled brain states ☐ Train a small LIF-SNN classifier in Python ☐ Spike encoder on the XIAO (delta-sigma or threshold crossing) ☐ Flash LIF-SNN weights, run inference in PSRAM |
| W17 | May 20-25 | Applications and implications + project development, spiral 2 finish | ☐ Brain-state classes drive display UI (blink-to-click, alpha-gated menus) ☐ Feed brain state into the assistant endpoint as extra context ☐ Demo video + slide draft ☐ If time, start spiral 3 (electrodes to temples prototype) |
| W18 | May 27 | Invention and IP | ☐ Licensing and ethics write-up ☐ Final dev-log entries and final project page polish ☐ Refine my FabAcademy Website and Personal Website |
| Final | Jun 8-12 | Project presentations | ☐ Present spirals 1 + 2 ☐ Show spiral 3 progress where it landed ☐ Fallback: present spiral 1 only if spiral 2 doesn't work |