Not satisfied with simply controlling 120 pound robots with a Microsoft Surface, one of the lead programmers from this video ( youtube.com and youtube.com ) took a week off and hacked together an amazing on-screen joystick driver for Windows and the Microsoft Surface. Eric McCann’s adaptation of the DREAM Controller is based on Mark Micire’s PhD research www.cs.uml.edu and can provide all of the functionality of a physical joystick through multi-touch interaction. By simply placing five fingers on the table, the joystick is dynamically re-sized and oriented to the user’s hands automatically on every hand placement. It can also be moved to any position of the screen by dragging the index and middle fingers. To demonstrate the functionality, this video shows the Microsoft Flight Simulator and Valve Corporation’s Portal controlled exclusively through hand interaction on the tabletop. Visit the Robotics Lab robotics.cs.uml.edu and be sure to subscribe to this channel http . More fun to come… (Can anyone say steroids for Starcraft?) ![]()
Video Rating: 4 / 5

Compass Automation specializes in robotic deburring systems and custom automation. This version of our gear deburring systems features a touch screen HMI which allows an operator to seamlessly upload the specs of a custom gear to the robot for automatic deburring/chamfering of the gear. Our deburring systems (not just for gears) are totally customizable using one of three basic methods to apply the perfect finish: compliant tooling, gear specs, or CAM software. We will work with you to determine the ideal system. Our latest deburring system video: www.compass-automation.com Our cover story in Gear Solutions magazine: www.gearsolutions.com Simple, Accurate, Fast, and Flexible. There is no better way to deburr your parts. Call us at 847.426.6696 for more information or email Compass at sales@compass-automation.com.
![]() Neewer Game Controller Joystic... 0.97 | ![]() Mini Analog Joystick Game Cont... 2.44 | ![]() Neewer 2x Game Controller Joys... 12.12 | ![]() Neewer 5x Game Controller Joys... 39.81 |







the only time to touch a computer screen should be to block it from a child’s view. we have gesture recognition technology, this is all just a hype, the DREAM controller is obsolete considering i could flip my hand and flip something on a computer given the right equipment
you know this is just a gimmick, Another desperate attempt for Microsoft to be relevant
the only time to touch a computer screen should be to block it from a child’s view. we have gesture recognition technology, this is all just a hype, the DREAM controller is obsolete considering i could flip my hand and flip something on a computer given the right equipment
you know this is just a gimmick, Another desperate attempt for Microsoft to be relevant
mY FIngertips, they feel kinda toasty…
@Oldenheimer1913 See our latest video, please.
Yeah, FPS games would be a little iffy for something like this. But an RTS, hell, that’d be sweet with this touch screen thing. Just imagine that: StarCraft 2 (or whatever, I don’t even have that game) with this giant touchscreen “controller.” It’d be less like a game and more like you’re actually sitting in some control room somewhere looking at a camera feed of the battlefield and controlling your forces with your bare hands. That’d be badass, right there.
Hell, even iPads could do it (sorta).
any one think interactive porn.. or is it just me
Screw FPS games, I wanna see an RTS game use multitouch controls. Be like Minority Report, but with fewer double-crosses
Nice concept idea, could also be used for other things besides games.
It looks extremley uncomfortable in the longrun.
Flight looks cool with this, and Im guessing Racing might be good too, Ill stick with KB/M for everything else.
I’m positive Portal will be 100 times harder since there’ s a level that teaches you about flinging yourself with 3 portals (1 Blue, and 2 Orange, or the other way around). Good luck doing that level.
Oh god, that portal performance was painfully slow and award to watch, even at 2 times speed. The flight simulator was nicely fluid, but at the same time…the major thing this touch screen seems have to the ability to fine-tune and/or quickly turn with the ability a mouse or joystick could provide.
If this is going to compete in the FPS realm, they really need to work out allowing the player to quickly spin around and snap their look/aim to a particular direction. Still a cool idea though
@XAndroid1 it’s supposed to be flat like a table but there are probably going to be people using them like computers so they don’t have to go to the cyropracter everyday.
@TheWayToTheDawnVIII yah that’s exactly what I thought too. and if you look at when they do the portal part, it says 2x real time, which means he was moving at a snails pase. turrets would shoot the fuck out of you before you could find the right controls.
MUST….GET….
Portal was way to slow. There are some chambers where you just can’t go that slow. Seems like an awesome concept though.
awesome…
@mesaoneCCK Indeed. In theory it’s really awesome, but when you actually saw him play portal, that’s way too slow to succeed on some of the higher levels.
still looks a bit clumsy though. No matter how advanced and ergonomic the button orientation might be, for some people (myself included) it still can’t beat a real controller or kb/m setup. Still pretty amazing for a proof-of-concept! My hat is off to these folks.
is this like the computer screen is up and down like a normal computer or it like flat on the table/floor?
The flight simulator was cool, but Portal looked pretty awkward.
That’s kinda cool but damn was that song annoying.
cool can i buy this ? please give me a link so i can buy this please
Flight sim worked great but portal looked a little slow.
Thats cool man