Interface & application programming
Assignments
Our tasks for this week are:
- Group assignment: Compare as many tool options as possible
- Individual assignment: Write an application that interfaces a user with an input &/or output device that you made
Hero Shots
Notes:
IFttt OSC (wireless protocol) vs serial PureData Pixel sorting effect for OSC projects, just buy a router for it ($35) for AR, use home assistant on Raspberry Pi 5 or 4
Processing
- open source, free
- like arduino but for designers
Touch Designer
- some functionality free, some not
- node based, like grasshopper
- a lot of people use just for visuals
- info from phone –> physical output or create visuals
PureData
- Max MSP - for audio/song creation, is the commercial version of PureData Link
- more “rustic” interface, but open source
- Maria Arnal, Catalan singer
MaxMSP
Martin Messier - drops of water
Max
Max Air Guitar
Zappar
AR interactions through phone
Hands on Demo
Processing
info transmitted between Arduino <–> Processing
OSC seems more robust (as long as have own router) Serial is better for if using a cable, direct wire
Touch Designer
CHOPs DMX
Max MSP
Link connect to phone gyroscope/accelerometer
Zigzam
Really useful app for interfacing with phone
Including but not limited to: image detection NFC reader (read NFC tag, produce some output) Apple Pencil data reading Acceleration Gravity (if throw phone) gyroscope quaternation compass (orientation from phone) pressure (how many finger pressing) GPS - location
TouchOSC
“DJ” interface app need to connect with Processing, Touch Designer, etc. that uses OSC Will always need an intermediate program
AR kit
kit apple has for face sensors ex: turn a light on by blinking an eye, open mouth image detection
demo w/ AR on phone: Zappar / Zapworks
Tree and fox example Web hook - application connected to home assistant
Home assistant demo w/ Raspberry Pi
Raspberry pi 5 - it’s a tiny computer in itself will need an SD card to burn any program to a Raspberry pi, need an SD card & Raspberry pi image burner can be used for 3D printing operations also Home Assistant connect raspberry pi to router via ethernet connect RPi to power
- important to use google chrome browser, only browser which supports these interactions
Ideas
interact with heart in 3D, hospital installation interact with heart in OR
visualize flow through heart/tube visualize heart valve function visualize valve support structures