Comments on: I, for one, welcome our new Wii remote hacking overlords

I, for one, welcome our new Wii remote hacking overlords

TimeTravelSpeed — Sat, 22 Dec 2007 16:36:52 -0800

Still aren't sure if the Wii is worth the wait in line? That's okay, the Wiimote is all you need for: Low-Cost Multi-point Interactive Whiteboards Using the Wiimote, Tracking Your Fingers with the Wiimote, and the latest: Head Tracking for Desktop VR Displays using the Wii Remote (extremely cool and the easiest to implement). From the maker of the $14 steady-cam [prev. here], Johnny Chung Lee is taking Wiimote hacking to a whole new level, and giving away all necessary software and instructions for free. Wii games are about to get a whole lot cooler.

I successfully implemented both the white-board, and the VR display and I am just floored. You don't need the Wii for any of these projects. Just the Wiimote, bluetooth dongle, some free software, and an IR light source. I got the VR display working in about 30 minutes (20 of which were spent figuring out that I need the latest DirectX SDK and then installing it). Johnny Lee is quite clever, and will likely make even Nintendo realize that their interface has more potential than previously thought.

By: srboisvert

srboisvert — Sat, 22 Dec 2007 16:56:43 -0800

That head tracking was pretty cool. I know a few Perception Labs at the local Uni are all over the Wii for its research potential (not to mention getting a game console with grant money).

By: delmoi

delmoi — Sat, 22 Dec 2007 16:57:02 -0800

If all you need is a wiimote, why buy a Wii?

By: GavinR

GavinR — Sat, 22 Dec 2007 16:57:41 -0800

Now if only the library of games wasn't primarily composed of crappy PS2 ports or kiddified mini-game collections. Nintendo no longer sets any standards for developers and it shows. I'll pass.

By: dogwalker

dogwalker — Sat, 22 Dec 2007 17:05:37 -0800

I saw the interactive whiteboard vid awhile back. It made me feel like one of the natives who's never seen an airplane before and wants to attack the giant, shiny bird.

By: danb

danb — Sat, 22 Dec 2007 17:09:52 -0800

That's pretty sweet, Charles.

By: DU

DU — Sat, 22 Dec 2007 17:18:39 -0800

I can. Not. Wait. Until Wiimotes are commodities and I can get one for just a few bucks.

By: ZachsMind

ZachsMind — Sat, 22 Dec 2007 17:22:11 -0800

You crazy kids today with your Wiimotes! When ah wuz yer age we had ourselves joysticks! And paddles! They wuz hardwired to the console, which wuz hardwired to the television set. AND WE WUZ THANKFUL to have that!

By: DU

DU — Sat, 22 Dec 2007 17:24:29 -0800

Also, I heart this guy.

By: tksh

tksh — Sat, 22 Dec 2007 17:25:01 -0800

Yeah! The Wiimote is awesome! I'm using aone with my Mac (via RemoteBuddy) and I'm really loving it. That remote Apple throws in is useless in comparison.

By: Malor

Malor — Sat, 22 Dec 2007 17:27:03 -0800

This is really neat, and I suggest viewing these links -- it will blow your mind. But it has very little to do with the Wii itself, and/or Wii games... it's just repurposing a very neat peripheral. No matter what happens with Wiimotes on PCs, it's probably not going to do much for the games on the console. Note that you can buy Wiimotes on their own, no console necessary, so you can play with this stuff pretty cheaply.

By: bobo123

bobo123 — Sat, 22 Dec 2007 17:32:24 -0800

I had read somewhere about the "head tracking/desktop vr" technology being talked about before years ago (turning monitors into a "window") but I've never seen it demonstrated. So I'm guessing this has been tried without Wiimotes and I wouldn't be surprised if it was tied up with some patents somewhere. This really needs to be combined with 3d shutter glasses.

By: rlk

rlk — Sat, 22 Dec 2007 17:32:57 -0800

Johnny Lee does great work, and I get annoyed every time I see a new video from him because he's stealing my lunch. It just goes to show how effective YouTube is at focusing attention and broadening audience. (I suspect that he might next realize that he's only been exploiting 2 of the Wiimote's 4 potential tracks, and he'll show how easily you can extract both position and orientation given a four-point pose estimation algorithm.)

By: DU

DU — Sat, 22 Dec 2007 17:38:56 -0800

I suspect that he might next realize that he's only been exploiting 2 of the Wiimote's 4 potential tracks... I was wondering why he didn't use two Wiimotes to increase the resolution of the whiteboard app.

By: empath

empath — Sat, 22 Dec 2007 17:45:46 -0800

could you do this with any infrared camera and the appropriate software?

By: TheJoven

TheJoven — Sat, 22 Dec 2007 17:48:03 -0800

Using 2 wiimotes would require you to know the precise location of them relative to each other. I don't think the relative position information you get during calibration would help much with accuracy, though you could cover different angles and be less likely to accidentally block out your own pen.

By: Skwirl

Skwirl — Sat, 22 Dec 2007 17:50:17 -0800

It made me feel like one of the natives who's never seen an airplane before and wants to attack the giant, shiny bird. Funny, that's how I felt about the 3D/VR demo. A frickin' CAVE in every home. I haven't been that blown away since Wolf3D.

By: DU

DU — Sat, 22 Dec 2007 18:00:03 -0800

Using 2 wiimotes would require you to know the precise location of them relative to each other. I don't think the relative position information you get during calibration would help much with accuracy... I didn't really mean to combine them optically. Just mount them perpendicularly and H positioning from one and V from the other. That way they could even by right on the wall rather than askew from a distance.

By: eye of newt

eye of newt — Sat, 22 Dec 2007 18:16:15 -0800

This is really cool. I want to try this at work in the next meeting. People will say "How do you do that???" With the two LED pens he's made a version of Microsoft's touch table computer. Not quite all the capability, but instead of being very expensive and mostly unavailable (unless you are a casino), it is very cheap and a free download. He ought to sell the LED pens on his website. Who the heck needs a Wii?--just get the remote.

By: i_am_a_Jedi

i_am_a_Jedi — Sat, 22 Dec 2007 18:25:26 -0800

That was far far cooler than I thought it would be before I clicked the first link.

By: dirtynumbangelboy

dirtynumbangelboy — Sat, 22 Dec 2007 18:33:45 -0800

[This is fucking cooler than cool shit]

By: papakwanz

papakwanz — Sat, 22 Dec 2007 18:49:51 -0800

Wii Drums

By: lekvar

lekvar — Sat, 22 Dec 2007 18:57:59 -0800

I viewed the "finger-tracking" video and thought it was neat, but pretty useless. Then I watched the "whiteboard" video. Suddenly all those cool projection computers that we were supposed to have in the future seem so close, and inexpensive, too. Who would have thought that Johnny Chung Lee would be the architect of the future? I realize he's probably a busy man building the future and all, but if somebody could remind him we're behind schedule on the moon-bases, robot butlers ans rocket-packs, I'd really appreciate it. I'm sure he could whip something together by, say, Thursday. I can wait.

By: smackfu

smackfu — Sat, 22 Dec 2007 20:24:47 -0800

Woah.

By: null terminated

null terminated — Sat, 22 Dec 2007 21:36:25 -0800

He's so awesome his username is simply "johnny". These videos are sick.

By: ArmyOfKittens

ArmyOfKittens — Sun, 23 Dec 2007 03:10:44 -0800

I love these. I've seen them linked on various gaming sites before, but they blow me away every time I watch them. This guy needs hiring, now!

By: jouke

jouke — Sun, 23 Dec 2007 05:17:25 -0800

It's amazing he does this with commodity hardware. Very cool.

By: fcummins

fcummins — Sun, 23 Dec 2007 06:30:18 -0800

What a communicator! He explains the techie-title in terms your grandma could understand, and solves a serious tech issue by reversing two things. That's clarity! Long live Johnny!

By: Chunder

Chunder — Sun, 23 Dec 2007 07:27:42 -0800

Finger tracking: Cool DIY multi-touch digital whiteboard: Cool AND useful Head-tracking: Whoah! The head-tracking into a game along with the Wii remote (or a similar device) must surely be the Next Big Thing - looks totally awesome! I'm also trying to picture using a combination of the head-tracking and the finger-tracking in an operating system, moving windows and objects around - in front, behind, off to the side, etc. A bit disorienting, perhaps, but miles better than any other 3D desktop that I've seen so far...

By: quiet

quiet — Sun, 23 Dec 2007 07:34:34 -0800

This wiimote, it's just a newer Cuecat, right?

By: quiet

quiet — Sun, 23 Dec 2007 07:37:33 -0800

eye of newt: He ought to sell the LED pens on his website. From his website: "I'm currently looking into manufacturing and selling IR pens, but this may take several months."

By: cashman

cashman — Sun, 23 Dec 2007 08:27:25 -0800

Wow. I'd seen some of the others, but the head tracking one was neat.

By: mrgrimm

mrgrimm — Sun, 23 Dec 2007 08:58:09 -0800

Very cool. But yeah, but Malor said.

By: JHarris

JHarris — Sun, 23 Dec 2007 11:21:58 -0800

Nintendo needs to hire this guy, like, yesterday. Like, a year ago.

By: JHarris

JHarris — Sun, 23 Dec 2007 11:27:27 -0800

I just thought of this: best of all, since these are on YouTube, this is definitely prior art. No company can patent this use now!

By: LarryC

LarryC — Sun, 23 Dec 2007 11:42:35 -0800

I want to try this--I teach in a seminar room with a computer and projector and would love to have a white board. And my son is getting a Wii for Christmas, so I have everything but the light pen. (Sorry, son!)

By: JHarris

JHarris — Sun, 23 Dec 2007 12:06:58 -0800

What we really need now is a link to a site telling how to make inexpensive LED-tipped light pens. ........ I said, "WHAT WE REALLY NEED NOW IS A LINK TELLING HOW TO MAKE LIGHT PENS!" Sheesh, it's like they're not even listening.

By: empath

empath — Sun, 23 Dec 2007 15:32:18 -0800

How to make an IR Light Pen

By: JHarris

JHarris — Sun, 23 Dec 2007 16:33:08 -0800

Ah, there we go. Now go bring me a scotch. Snap snap! Apparently being an obnoxious prick actually works. To think I've been doing it all wrong these years!

By: JHarris

JHarris — Sun, 23 Dec 2007 16:34:22 -0800

(Oh, and thanks empath, completely unironically. I vote you +3 karma, extra brownie points, and half-off coupons at Publix.)

By: P.o.B.

P.o.B. — Sun, 23 Dec 2007 20:06:59 -0800

Now if only the library of games wasn't primarily composed of crappy PS2 ports or kiddified mini-game collections. Nintendo no longer sets any standards for developers and it shows. I'll pass. posted by GavinR at 4:57 PM on December 22 Really? They must be doing something right, being the only system sold out for weeks on end?

By: caddis

caddis — Sun, 23 Dec 2007 22:01:59 -0800

Now if only the library of games wasn't primarily composed of crappy PS2 ports or kiddified mini-game collections. Someone fails to understand the Wii. It's not about the graphics. That was for suckers (PS3, this means you). It's about the game play. Oh well,.....

By: smackfu

smackfu — Sun, 23 Dec 2007 22:09:00 -0800

I was impressed no one fell for that troll... but it couldn't last forever.

By: caddis

caddis — Mon, 24 Dec 2007 18:40:55 -0800

Don't be such a killjoy. Just because it is Christmas Eve doesn't mean we can't trash this thread with a big bitchfest over a silly computer game. Only kids and morons play those things but they can still make for a good argument. ;)

By: middleclasstool

middleclasstool — Mon, 24 Dec 2007 21:02:25 -0800

Nintendo needs to hire this guy, like, yesterday. Like, a year ago. I have a feeling that there are a few companies who will see this video. I'll be shocked if he doesn't have at least two major offers by the end of the next quarter.

By: stavrosthewonderchicken

stavrosthewonderchicken — Tue, 25 Dec 2007 21:25:19 -0800

I've seen these videos linked all over the place, but finally just watched them. Thanks for the links. This guy rocks. I want a wall-mounted projector shining onto my desktop with cheapo multitouch action now please.

By: stavrosthewonderchicken

stavrosthewonderchicken — Tue, 25 Dec 2007 21:34:38 -0800

Holy shit, the Head Tracking for Desktop VR one just BLEW MY MIND. This is fantastic stuff.