In one of the best eye-tracking technology projects I’ve seen, the folks from the Graffiti Research Lab and FAT Lab have teamed up with Theodore Watson, Zachary Lieberman, and Christine Sugrue to tackle a novel accessibility problem: enabling pioneering graffiti artist Tempt, hospitalized for over two years with the muscle atrophy of ALS (Lou Gehrig’s Disease), to be able to tag again. Out of all of the things I heard about at SXSW this year, I think this project was the thing that excited me the most — open source hardware + software hacking, vision work, accessibility concerns, graffiti and a great story!
The system they’re developing is using the excellent openFrameworks library and two small cameras: the left can be used as a “mouse button” event by holding that eye closed, and the right eye’s pupil is tracked for gesture. The result is a simple hands-free drawing app, which they will connect with the GRL’s laser tag tools, giving Tempt the ability to express himself through graf writing again.
You can check out the rest of their videos under the TEMPT1 tag on fffff.at (“Release early, often, and w/ rap music.”), but here’s a good one to get you started: