Own research on developments in HCI

a.Everything is a Remix Case Study: The iPhone

This video shows how the iphone was a clever remix of a brilliant new idea, the functionality of existing phones with buttons and of the representation of traditional mechanics on a touchscreen. As concurrents adopted and improved on the first iOS functionality Apple itself also took the interesting functionality of it’s concurrents and implemented it in it’s successive versions of the OS.

b.Artificial Intelligence

An example of automated recording of human/computer interaction :
“Zuckerberg also spoke about the social network’s artificial-intelligence initiatives:
There is one more evolution in our strategy to understand the world that I want to mention. In September (2013), we formed the Facebook AI Group to do world-class artificial-intelligence research using all of the knowledge that people have shared on Facebook. The goal here is to use new approaches in AI to help make sense of all of the content that people share so we can generate new insights about the world to answer people’s questions.”

Adding to that “Facebook mulls silently tracking users’ cursor movements to see which ads we like best”  and the fact that facebook could be tracking every keystroke, so even the messages you wrote but decided not to post could be recorded.(http://nakedsecurity.sophos.com/2013/11/01/facebook-to-silent-track-users-cursor-movements-to-see-which-ads-we-like-best/)

Google is also doing “Deep learning” :
“Going from raw kinds of data and build up higher and higher level of features.”
E.g. speech recognition : from raw wave forms to what is actually said

Cognition as a service

CaaS powered apps will be able to think and interact with consumers like intelligent virtual assistants


Deep Learning, Self-Taught Learning and Unsupervised Feature Learning (Andrew Ng)
Some content :
– The “one learning algorithm” hypothesis
– Seeing with your tongue
– 2 biologists spending a year on an island documenting on different ways how monkeys pick up things

c.Game world

The game world is one af the frontrunners if it comes to HCI. Traditionally working with keyboard, mouse and hundreds of joysticks and controllers, one of the first great improvements on HCI I saw was on my playstation2 console : the Eye toy camera which could capture the player and project him inside the video game Kinetic. It was actually the reason I bought the console 🙂

Then came Augmented Reality, which puts a layer over the real world.
For example the game Ingress (http://www.ingress.com):

An example of an Augmented Reality game with a 3D depth sensing :


In this example there is still the need of a screen, but with the combination of a google glass, the environment can be almost everywhere. No need to be at your computer or gaming console, and a much more active gaming experience can be possible. Take a first person shooter, instead of sitting on the couch pressing buttons to make a caracter move on a motionless tv, the gamer could actually be moving himself. Like a track in a paintball park yet virtually.

I found an example of other technology of this, GVX, and they call it extreme reality :


Peace of Mind Through Your Smartphone
For the first time, you can record your own ECG using the FDA cleared AliveCor System on your smartphone and use AliveInsights™* analysis services to have a cardiac technician or cardiologist review your ECG recording in as little as 30 minutes.

Remote virtual surgery via Google Glass and telepresence


Body piercing controls wheelchair


e.Relation to the environment

In recent years more and more devices, sites, apps want to know where you are located, this to bring you tailored information.



f.Immediate future of interfaces

Spoken word, gestures, wearables, gaze, touch, holograms


The Siri trivia challenge: how many of these 50 things did you know Siri could do?

Robot system interpret speech and talk back :




inFORM is a Dynamic Shape Display that can render 3D content physically, so users can interact with digital information in a tangible way




Exoskeleton : A Real-Life Iron Man Suit That Could Be as Comfortable as Pajamas


Gaze – eye tracking

Tobii rex


Some research even suggests that our universe itself is only a hologram…

g.The next step in HCI is BCI : brain-computer interface


artist uses brainwaves to manipulate the motions of water


Burning Man’s next big thing is a 15-foot-tall brain-controlled brain



Surrealistic Mind-controlled Dress Changes Shape, Lights Up at Your Will


Taily : wearable moving tail

Cat ears



Operating the computer with your brain

Thought controlled bionic arm



Mind-reading wakamaru robot teachers keep students focused : Engagement levels were monitored using a $200 EEG sensor to monitor the FP1 area of the brain, which manages learning and concentration.



h.The future of HCI

Some points of the video:

  • Spoken interaction
  • multiple people interacting
  • eyetracking
  • the computational environment must be smart enough not to interrupt the flow of and between humans
  • we need to move to where computers can take actions for you

i.Distant future

BBI : Brain-to-brain interface

Non-invasively translate human intention to stimulate a rat’s brain motor area responsible for tail movement.


j. matrix ?



Geef een reactie

Vul je gegevens in of klik op een icoon om in te loggen.

WordPress.com logo

Je reageert onder je WordPress.com account. Log uit /  Bijwerken )

Google photo

Je reageert onder je Google account. Log uit /  Bijwerken )


Je reageert onder je Twitter account. Log uit /  Bijwerken )

Facebook foto

Je reageert onder je Facebook account. Log uit /  Bijwerken )

Verbinden met %s