syneseizure

Final presentation: Team Syneseizure!

syneseizure — Mon, 14 Nov 2011 22:21:53 +0000

First public test…

syneseizure — Mon, 14 Nov 2011 22:19:33 +0000

Code!

syneseizure — Mon, 14 Nov 2011 00:31:42 +0000

Here’s the code for the arduino and processing sketches. The arduino sketch is used by the microcontroller sewn in to´ the mask and the processing sketch is run on the computer controlling the input via the video camera. The arduino code relies on two libraries: the first is the publicly available TimerOne library; the second is a new library written during Science Hack Day SF 2011 called SoftwareTone which allows creation of square wave tones to any (and all) arduino digital pin in software. The SoftwareTone library will be uploaded to github shortly.

https://github.com/gregfriedland/Synesthesia

Process in pictures

syneseizure — Sun, 13 Nov 2011 21:48:05 +0000

: Parker and Lil figuring out the placement for the speakers

Marissa with prototype pattern for the mask

Parker, Liam, Tymm, Greg, coding and soldering into the night

Marissa sewing the mask

Bala modeling mask with speakers in place (on the inside, wires sticking out)

First test with mask, Marissa modeling, Lil and Parker holding arduino and wires in place

Bug eyes to be attached for additional creepiness

Liam working on our presentation. Fen inspecting the code. Probably after 1am now.

testing the wireless connection from computer to arduino-- eventually we decided it was not reliable and ended up using cords

Parker modeling the completed mask

Syneseizure! Unmasking reality!

syneseizure — Sun, 13 Nov 2011 21:18:29 +0000

Our consciousness does not contain reality – there is too much information in reality to handle, our brains would fry. Therefore, our various sensory cortexes have really complex data compression and processing algorithms to present us with the most useful information to help us kill antelopes, run away from lions and find attractive mates. This means we ignore a lot of reality. Perhaps we can see a different aspect of reality by listening to our eyeballs or looking
through our nose.

Synesthesia is a condition in which one sensation (sight, hearing, etc) gets mixed up with another. This can cause situations in which someone “smells” sounds, or “sees” touches.

For this hack, we designed and built a full head mask that allows the wearer to feel images in real time. The mask is arrayed with 12 speakers that contact the skin of the face. When an image is captured with a webcam and converted into a 12 pixel black-and-white representation. The computer activates arduinos that control the speakers. If the pixel is white, the corresponding speaker is turned on. If the pixel is black, the corresponding speaker is turned off. This allows the wearer to feel (via the vibrations of the speakers) an image on their face.