Joystick Emulation using the DREAM Controller on the Microsoft Surface

Not satisfied with simply controlling 120 pound robots with a Microsoft Surface, one of the lead programmers from this video ( youtube.com and youtube.com ) took a week off and hacked together an amazing on-screen joystick driver for Windows and the Microsoft Surface. Eric McCann’s adaptation of the DREAM Controller is based on Mark Micire’s PhD research www.cs.uml.edu and can provide all of the functionality of a physical joystick through multi-touch interaction. By simply placing five fingers on the table, the joystick is dynamically re-sized and oriented to the user’s hands automatically on every hand placement. It can also be moved to any position of the screen by dragging the index and middle fingers. To demonstrate the functionality, this video shows the Microsoft Flight Simulator and Valve Corporation’s Portal controlled exclusively through hand interaction on the tabletop. Visit the Robotics Lab robotics.cs.uml.edu and be sure to subscribe to this channel http . More fun to come… (Can anyone say steroids for Starcraft?) ;)
Video Rating: 4 / 5

Compass Automation specializes in robotic deburring systems and custom automation. This version of our gear deburring systems features a touch screen HMI which allows an operator to seamlessly upload the specs of a custom gear to the robot for automatic deburring/chamfering of the gear. Our deburring systems (not just for gears) are totally customizable using one of three basic methods to apply the perfect finish: compliant tooling, gear specs, or CAM software. We will work with you to determine the ideal system. Our latest deburring system video: www.compass-automation.com Our cover story in Gear Solutions magazine: www.gearsolutions.com Simple, Accurate, Fast, and Flexible. There is no better way to deburr your parts. Call us at 847.426.6696 for more information or email Compass at sales@compass-automation.com.

Item Search :
Neewer Game Controller Joystick Joypad For iPad & iPad 2
Neewer Game Controller Joystic...
0.97
Mini Analog Joystick Game Controller Joypad for iPad iPad 2 Transparent
Mini Analog Joystick Game Cont...
2.44
Neewer 2x Game Controller Joystick Joypad For iPad & iPad 2
Neewer 2x Game Controller Joys...
12.12
Neewer 5x Game Controller Joystick Joypad For iPad & iPad 2
Neewer 5x Game Controller Joys...
39.81

Comments

  1. reesealdrich says:

    the only time to touch a computer screen should be to block it from a child’s view. we have gesture recognition technology, this is all just a hype, the DREAM controller is obsolete considering i could flip my hand and flip something on a computer given the right equipment
    you know this is just a gimmick, Another desperate attempt for Microsoft to be relevant

  2. reesealdrich says:

    the only time to touch a computer screen should be to block it from a child’s view. we have gesture recognition technology, this is all just a hype, the DREAM controller is obsolete considering i could flip my hand and flip something on a computer given the right equipment
    you know this is just a gimmick, Another desperate attempt for Microsoft to be relevant

  3. TheChanclasVerdes says:

    mY FIngertips, they feel kinda toasty…

  4. UMLrobotics says:

    @Oldenheimer1913 See our latest video, please. :)

  5. Oldenheimer1913 says:

    Yeah, FPS games would be a little iffy for something like this. But an RTS, hell, that’d be sweet with this touch screen thing. Just imagine that: StarCraft 2 (or whatever, I don’t even have that game) with this giant touchscreen “controller.” It’d be less like a game and more like you’re actually sitting in some control room somewhere looking at a camera feed of the battlefield and controlling your forces with your bare hands. That’d be badass, right there.
    Hell, even iPads could do it (sorta).

  6. sharp93 says:

    any one think interactive porn.. or is it just me

  7. sygnus5 says:

    Screw FPS games, I wanna see an RTS game use multitouch controls. Be like Minority Report, but with fewer double-crosses

  8. meman887 says:

    Nice concept idea, could also be used for other things besides games.

  9. WNxAtlas says:

    It looks extremley uncomfortable in the longrun.

  10. slipperywhenwet5 says:

    Flight looks cool with this, and Im guessing Racing might be good too, Ill stick with KB/M for everything else.

  11. weinerschnitzelboy says:

    I’m positive Portal will be 100 times harder since there’ s a level that teaches you about flinging yourself with 3 portals (1 Blue, and 2 Orange, or the other way around). Good luck doing that level.

  12. Slientwolf says:

    Oh god, that portal performance was painfully slow and award to watch, even at 2 times speed. The flight simulator was nicely fluid, but at the same time…the major thing this touch screen seems have to the ability to fine-tune and/or quickly turn with the ability a mouse or joystick could provide.

    If this is going to compete in the FPS realm, they really need to work out allowing the player to quickly spin around and snap their look/aim to a particular direction. Still a cool idea though

  13. Tyfighter152 says:

    @XAndroid1 it’s supposed to be flat like a table but there are probably going to be people using them like computers so they don’t have to go to the cyropracter everyday.

  14. Tyfighter152 says:

    @TheWayToTheDawnVIII yah that’s exactly what I thought too. and if you look at when they do the portal part, it says 2x real time, which means he was moving at a snails pase. turrets would shoot the fuck out of you before you could find the right controls.

  15. stormsirens2 says:

    MUST….GET….

  16. TheWayToTheDawnVIII says:

    Portal was way to slow. There are some chambers where you just can’t go that slow. Seems like an awesome concept though.

  17. DonkeyManda432 says:

    awesome…

  18. imaketwinks says:

    @mesaoneCCK Indeed. In theory it’s really awesome, but when you actually saw him play portal, that’s way too slow to succeed on some of the higher levels.

  19. mesaoneCCK says:

    still looks a bit clumsy though. No matter how advanced and ergonomic the button orientation might be, for some people (myself included) it still can’t beat a real controller or kb/m setup. Still pretty amazing for a proof-of-concept! My hat is off to these folks.

  20. XAndroid1 says:

    is this like the computer screen is up and down like a normal computer or it like flat on the table/floor?

  21. holyhandgrenade999 says:

    The flight simulator was cool, but Portal looked pretty awkward.

  22. swift17 says:

    That’s kinda cool but damn was that song annoying.

  23. 2000callum says:

    cool can i buy this ? please give me a link so i can buy this please

  24. YTBYlover says:

    Flight sim worked great but portal looked a little slow.

  25. ChriseyBoy007 says:

    Thats cool man

Leave a Reply