a.Everything is a Remix Case Study: The iPhone
This video shows how the iphone was a clever remix of a brilliant new idea, the functionality of existing phones with buttons and of the representation of traditional mechanics on a touchscreen. As concurrents adopted and improved on the first iOS functionality Apple itself also took the interesting functionality of it’s concurrents and implemented it in it’s successive versions of the OS.
An example of automated recording of human/computer interaction :
“Zuckerberg also spoke about the social network’s artificial-intelligence initiatives:
There is one more evolution in our strategy to understand the world that I want to mention. In September (2013), we formed the Facebook AI Group to do world-class artificial-intelligence research using all of the knowledge that people have shared on Facebook. The goal here is to use new approaches in AI to help make sense of all of the content that people share so we can generate new insights about the world to answer people’s questions.”
Adding to that “Facebook mulls silently tracking users’ cursor movements to see which ads we like best” and the fact that facebook could be tracking every keystroke, so even the messages you wrote but decided not to post could be recorded.(http://nakedsecurity.sophos.com/2013/11/01/facebook-to-silent-track-users-cursor-movements-to-see-which-ads-we-like-best/)
Google is also doing “Deep learning” :
“Going from raw kinds of data and build up higher and higher level of features.”
E.g. speech recognition : from raw wave forms to what is actually said
Cognition as a service
CaaS powered apps will be able to think and interact with consumers like intelligent virtual assistants
Deep Learning, Self-Taught Learning and Unsupervised Feature Learning (Andrew Ng)
Some content :
– The “one learning algorithm” hypothesis
– Seeing with your tongue
– 2 biologists spending a year on an island documenting on different ways how monkeys pick up things
The game world is one af the frontrunners if it comes to HCI. Traditionally working with keyboard, mouse and hundreds of joysticks and controllers, one of the first great improvements on HCI I saw was on my playstation2 console : the Eye toy camera which could capture the player and project him inside the video game Kinetic. It was actually the reason I bought the console 🙂
Then came Augmented Reality, which puts a layer over the real world.
For example the game Ingress (http://www.ingress.com):
An example of an Augmented Reality game with a 3D depth sensing :
In this example there is still the need of a screen, but with the combination of a google glass, the environment can be almost everywhere. No need to be at your computer or gaming console, and a much more active gaming experience can be possible. Take a first person shooter, instead of sitting on the couch pressing buttons to make a caracter move on a motionless tv, the gamer could actually be moving himself. Like a track in a paintball park yet virtually.
I found an example of other technology of this, GVX, and they call it extreme reality :
Peace of Mind Through Your Smartphone
For the first time, you can record your own ECG using the FDA cleared AliveCor System on your smartphone and use AliveInsights™* analysis services to have a cardiac technician or cardiologist review your ECG recording in as little as 30 minutes.
Remote virtual surgery via Google Glass and telepresence
Body piercing controls wheelchair
e.Relation to the environment
In recent years more and more devices, sites, apps want to know where you are located, this to bring you tailored information.
f.Immediate future of interfaces
Spoken word, gestures, wearables, gaze, touch, holograms
The Siri trivia challenge: how many of these 50 things did you know Siri could do?
Robot system interpret speech and talk back :
inFORM is a Dynamic Shape Display that can render 3D content physically, so users can interact with digital information in a tangible way
Exoskeleton : A Real-Life Iron Man Suit That Could Be as Comfortable as Pajamas
Gaze – eye tracking
Some research even suggests that our universe itself is only a hologram…
g.The next step in HCI is BCI : brain-computer interface
artist uses brainwaves to manipulate the motions of water
Burning Man’s next big thing is a 15-foot-tall brain-controlled brain
Surrealistic Mind-controlled Dress Changes Shape, Lights Up at Your Will
Taily : wearable moving tail
Operating the computer with your brain
Thought controlled bionic arm
Mind-reading wakamaru robot teachers keep students focused : Engagement levels were monitored using a $200 EEG sensor to monitor the FP1 area of the brain, which manages learning and concentration.
h.The future of HCI
Some points of the video:
- Spoken interaction
- multiple people interacting
- the computational environment must be smart enough not to interrupt the flow of and between humans
- we need to move to where computers can take actions for you
BBI : Brain-to-brain interface
Non-invasively translate human intention to stimulate a rat’s brain motor area responsible for tail movement.
j. matrix ?