Final Project


what will it do?

Real life gaming machine in 3rd person’s view
Making fabable virtual reality headset and back-sided mounted cameras.

we only see the world in first person perspective, since our eyes have never left our face. I wanted to make gaming machine controlling myself in third person perspective.Using Augmented reality, I can display personal information like Heart rate or speed. And can make a simple game using this informations and computer vision.It could make me feel like control myself in game like GTA or Call of Duty.

finalsketch0
final01

 

who's done what beforehand?

There were some guys who had done a similar work. some hackers in Poland made Read World Third Person Perspective VR/AR Experiment. They made it use of an Oculus Rift, two GoPros, a microprocessor and a few  servo motors. There is a link.

http://hackaday.com/2014/07/02/third-person-perspective-is-guaranteed-to-mess-with-your-senses/

 

what parts and systems will be made?, What tasks need to be completed?

  1. Hardwares (~6/2)
    Backpack mount (molding and Casting, CNC machining, Composites) (5/31~6/1)
    For a good interface, the camera should be stable. So the backpack mount has to be fit well and strong. I'm going to make a mold to bend it.

    Pan Tilt mount (3D printing) (5/27~5/28)
    I redesigned Pan Tilt mount from my Computer Aided design assignment. I'm fabricating it with 3D printer at lab. I changed the design, because I don't want to use many bolts and nuts. I'm going to make it with press-fit construction.

    HMD(Head mount display) - display mount(Cardboard laser cutting / 3D printing), 2 lenses, (5/29~5/30).
    There are many design files for DIY HMD like google hardboard. I want to make Fab type HMD using raspberry pi, 7'' LCD, 3axis accelerometer) the challenging thing is making it not too heavy. First, I'm going to make it with cardboard and laser cutting.

  2. Electronics (~6/1)
    Pan & Tilt camera module - MPU6050 sensor module, I2C communication, 2servos driver module
    MPU6050 sensor module : I'm going to make this sensor module for the head-motion tracking.
    mpu6050module

    Servo module : ATtiny44 with 20MHz has a bus for serial communication
    servomodule

    Display module - 7'' lcd module, 2 camera modules, 1 Raspberry pi (ubuntu) (5/28)
    I wanted to use 2 pi-cameras for stereoscopic vision. but If I use 2 pi-cameras, Ordinary Raspberry pi can not handle them. people said only Raspberry pi compute module can do that. but It is out of my budget. I decided to make it with 1 camera module and split and distort the video for each eyes in software.


    Sensor module - Heart beat sensor


what processes will be used?

1. Prototyping
I failed to make MPU6050 I2C communication board with 1/64 diameter endmill. So we ordered 0.01 mill. I’m waiting for arriving. Before it's arrived, I did test with GY-521 breakout board, and mini servos.

2. 3D printing parts
Pan&Tilt camera mount, Head mount display

3. Laser cutting parts
Head mount display, I didn't decide yet to make HMD with laser cut or 3D print. If I using 3D print, It can get much more quality but price is going to be higher. And laser cutting will be much cheaper but weaker than 3D printed. I'm going to try both with same design.

4. Mold and Casting
I'll make a mold for back fit mount to fit on my back.

5. Composites
back fit mount, It has to comfortable and flexable and strong enough. I'm going to make composites with wood, linen, etc..

6.Input Devices
3-axis accelerometer (MPU6050)

7.Output Devices
Servo motors

8.Interfaces and application programming
display the personal status panel - Heart rate monitor
OpenGL, OpenCV

9.Networking and Communications
I2C communication with sensor board and MCU
serial bus with servo driver board

how much will it cost?

Parts
1. 7'' TFT LCD module - $44.98
2. Raspberry pi - $39.95
3. Raspberry pi camera - $26.61
4. flexable plywood 1.6mm - $10 (1 sheet)
5. Cardboard - $3 (2sheets)
6. 2 Servo motor - $9.99
7. Lipo-battery - $9.95

Total
144.48

Process
1. 3D printing - $15 ($3 per hour)
2. CNC machining - $10 ($5 per hour)
3. Laser cutting - $10 ($5 per hour)

Applications

1. augmented reality game : using motion detecting, augmented reality
2. personal status display : using heart rate, speed using GPS, etc..
3. Psychotherapy : It could be effective to people who has social anxiety disorder