9. Inputs¶

Overview¶

This week I used the camera module on the ESP32S3 to make a detection software using ai for my final project.

Understanding How it Works¶

To make this weird input device possible I first needed to understand how it worked so I found this tutorial which explained to me how it works and linked this website which gave me some template models I could test using the esps3 to know that it work.

Test¶

This tutorial also gave instructions on how to make my own model. By going to Edge Impulse I was able to create my own ai generated video detection model.

Making one for my Final Project¶

Since my project is a robot dog, I wanted it to spot out doors. When it did see them I wanted it to stop but I didn’t get around to it this week. To do this I went around my house with my computer and the esp plugged into it, going from door to door and getting lots of wide fram pictures of them. I tried to make multiple models using diffrent things such as my keys and a granola bar but had no such luck with creating a model on Edge Impulse. I tried using over a hundred photos for each but each time I ran the test for the detection software, it didnt work.

Solution¶

With this hinderance in my path for my input device I had to do a bit of brainstorming and reasaerch. During this time I also worked on designing my output week due to how long it took to fail my input week. Because of this though it gave me the insperation to find a downloadable face detection model since I could have it be that when the camera detects a face the legs could start moving and since the camera can only really see straight, it would also give the illusion that the dog is moving towards you. After a bit of googling I found this code that was a face detecting code for the ESP32S3 with its camera module.

Board Design¶

I didnt design a board for my camera since I didnt really need to since the camera is dierctly attached to the ESP32S3, I will deffienitly design one it the future for my final project but at this moment I dont know how to design it since I havent figured out what function a PCB would serve.

Reflection¶

This week was a very enjoyable week for me. While it was annoying having my detection models fail, I learned alot about how they work through the presentation and