00:00 : using “Avatar” Trailer 01:07 : using webcam feed
How, why, cool ?
So really basic programming, but I thought it would looks cool. Actually, what was going to be a cool looking animation turn out to become a cool visualisation tool !
I found out that by just showing those pixels in a 3d space based on there RGB values you could see several dimensions at once :
Red value : X axis
Green value : Y axis
Blue value : Z axis
Luma value : is the vector between the black color (0,0,0) -> white color (255,255,255). It means that if the point cloud is closer to the white corner, brighter the picture is (… no kidding 🙂 )
Saturation value : it is the vector perpendicular to the luma vector. it means if the picture is saturated wider the point cloud would be, and of course more it is desaturated finer the point cloud will be. A black & white picture would only show particles on the luma value.
This one was the less obvious to me (but I’m not really smart :p)
You will have to add a quicktime movie (.mov) in the “data” folder called “vid.mov”
For sure all this sounds pretty obvious, and I’m pretty sure I’ve seen people doing this kind of stuff before, but I’m surprised I haven’t seen it in any “video editing” software before (or maybe I miss it).
I think it could be a really helpful tool to have a quick over look on your picture and just in a snap being able to tell if its too saturate, too red, or too blue, too bright or too dark…
Feel free to leave any comments about that or if you know something similar, just drop a line in the comments. By the way, this is my really first complete project with processing, so I probably did things the wrong way, you are welcome to correct me 🙂
As my previous post about MariLena (openCV port to AS3), I made more research about it and found this project Deface, which is pretty much the same as MariLena, except that this is not a port of openCV, as the developer says “it’s written from scratch”. so far it’s using Haar cascade file as OpenCV.
I haven’t tried it that much, here is an example : LiveExample
It seems to be a bit slower that MariLena, but I wouldn’t be sure at all
I made some test today with a stupid texture, starting from Mario’s webcam example and that’s just fun !!! Well yes, it’s still slow (15 fps on a good computer), but this is just the beginning as I believe that a lot of optimization can still be done, and so what anyway ? It’s flash, it’s everywhere, nothing to install, the fun is there without downloading anything. I really believe in it ! Now with this and FLARToolKit (ARToolKit port to AS3), augmented reality and computer vision is really getting into Flash for sure, and it’s going to give to the community some great opportunity !! I’m looking forward about it
YouUp is a Ubisoft’s project, which I’ve been working on for the past 3 years. First as CG Artist / R&D with the real-time tracking technology and the internal 3d engine, also as Modeler/Mapping for the first assets we have made and finally as a TD Artist (designing features, tools, workflow, techniques, assets production pipeline, training graphic team, and so on).
It’s been a long way since then, this is the really beginning of this kind of technology, a lot more will come out of our work beside youup (so I hope).
For now you can download YouUp Windows Live Messenger version, which is a special version we brought with a Microsoft paternship. Download it here : http://www.ilovemessenger.fr/youup
You can also watch this interview (it’s in french, but you can only watch it, what they say is not that important, I appear in the end, that’s the important part 😀 )