I am not often impressed by what people call new technology or “inventions”, as I often find that these things are simply built on existing knowledge and/or modifications/combinations of what was already in place. In other words, many of the things becoming popular today already existed in a somewhat different shape, such as cell phones being created before the iPhone, portable mp3 players before the iPod, search engines before WebCrawler and music before CD (alternatively tape or LP if you’re not in the youngest generation, or mp3 if you feel CD is outdated)

To continue the thought I started with, most “inventions” are not new, and most thoughts build on the ideas of others. This is one of the reasons why I am not often impressed. Whatever you do, someone has probably done it before (I am more innovative than most people, so decided not to say “whatever we do”), but with the right marketing and contacts you will still have a great chance of succeeding with the idea.

Returning to the original thought yet again, what impressed me for the first time in a couple of years was a site from Stanford University, claiming to create 3D model from single photos - something anyone in the area of Computer Vision (or related) knows is close to impossible without at least some manual work. The site however claimed that you simply uploaded the image and you would get a 3D version back. The following is what I got back (you may need a plugin for viewing VRML content)

In the end, it took 1-3 days (actually I thought it failed after I uploaded a photo from Dublin) before I got the results, making me wonder about their method of 3D extraction from the single image I provided. There are after all relatively simple algorithms which lets you define a great number of points (i.e thousands of points) in the image which builds on estimates and probability (simplification, I know). Since the result impressed me a bit, I decided to look through their publications, and will try interpreting it in “plain english” to see if they have found something which I believe could revolutionize the way computers interpret single images and video streams, or if the this is simply yet another experiment on the way to greatness.

Thinking about what’s related, Microsoft is working on a tool (Photosynth) for creating 3D models from collections of photos. Although the creation of a model involves relatively advanced algorithms (I studied many ways of approach both in my thesis and in various projects) a glance at the work makes me think their algorithms needs much time and processing power, and too many photos for an average user. In other words, it’s not something for a startup to hope for without a budget. As another early impression, I find an interesting part in how they created the feature recognition, since many parts of the image analysis should be greatly helped by understanding the scene. On the BBC site:

It picks out distinctive features in each image and cross-references them against the other photographs, checking for similarities.

As a final note (a bit off topic), I would like to apologize to one of my readers who asked about using the POSIT object with OpenCV. I have only looked into this a few times but never actually used it more than for a few quick test runs, but since your question made me think a bit I decided to have a look as soon as I can after moving (I am actually in the process of packing and preparing for an ineresting move to an interesting move to a new country, which is the main reason I haven’t been able to answer the question). Until then, I recommend the Yahoo OpenCV group. I would be interested in reading/hearing about any findings you make, and wish you the best of luck in finding the answer you seek.

I found a great video with perfect music a few days ago, and simply can’t stop watching and listening! The video is made by shooting photos with 2 hour intervals at the same location for a year - giving us a video showing battery park day and night, autumn, winter, spring and summer; an incredible result IMHO. I found the video at Photojojo

Photojojo’s Time Lapse Video of Bryant Park from Photojojo on Vimeo.

In the summer I spent an afternoon on the balcony, reading a book while shooting a photo approximately once every second minute, just to see the effect of those photos when flipping through them fast (and of course, I some days have a difficulty in doing only one thing at a time). Now I feel inspired not only to make a short video with that set of photos, but also set up my good old webcam to create a jpg every 30 minutes and make a video from that…

A while back I wrote about Computer Vision with a short description of what it is and what we can do with it, today I decided to create a list of what we can do with it, either using only Computer Vision techniques or in conjunction with other technologies.

1. Augmented reality/Virtual Reality: Track a person with cameras and place him in a different context on the screen. This is used for creating movies, helping the animation by tracking a persons movements.
2. Eye-tracking: This can be used for people who can’t move their fingers, to write with their eyes instead of with the hands. Another common use for eye-tracking is Usability testing of websites, where users are left alone with the screen and a camera to track the eye movements, where after a heatmap is created depending on those movements.
3. Tracking and movement sensing: People, vehicles, animals etc - anything can be tracked. This can be used in shops for the owner to see which parts are most popular, or to find movement where there should be none - i.e. from an intruder or similar. This can also be used to track point in a video and insert objects such as 3D models on top.
4. Creating panoramas: Instead of a user having to define a number of points you can let the system suggest correspondences between images.
5. 3D Reconstruction: Reconstructing buildings in 3D can be useful to a historian who wants to show how an environment once looked, or to an architect who wants to create a building. The artist can change current landscapes, the gamer can see a real landscape and the traveler can be helped to decide where to go.
6. Commercial: Show ads in stadiums on TV depending on the audience - we can easily show an ad for Carlsberg on Danish TV on Old Trafford Stadium where in reality the ad is for Guinness.
7. Sports: Balls, pucks, players and everything else in the modern games can be tracked with cameras, giving statistic to help for example managers with the coaching or golf players improve their game. This type of tracking was first used in rocket science, now it’s explored at universities with normal off-the-shelf webcams and cheap digital cameras.

There are of course many more applications to Computer Vision, but as you can see there is everyday use of it which seamlessly integrate with our everyday passtime. I could also touch on for example robotics, but will wait with that for another time…

A few months back I bought my first digital camera, and have already taken about 2000 pictures with it, probably throwing at least half of them away soon afterwards. You can see some of my photos on Picasa, and others on Flickr, mixed with other types of images. Actually, I started writing this post after returning from another photowalk in Copenhagen, where I covered ’søerne’ (’the lakes’) and adjacent areas. On some of my photowalks I can’t believe how many of the old buildings still stand, especially after the Germans invading. The photowalk consisted of 4-5 hours of photography with a few breaks for beer or coke.

- another photowalk I’d recommend for the Copenhagen visitor is the ‘CowParade’, consisting of a number of cows spread around Copenhagen in interesting locations, and if you walk there you will certainly find other places as well ….

Of course, I used Picasa on some of the photos, working miracles instead of making me throw them away. Another tool I was considering is Picnic, allowing me to edit online so I don’t have to keep track of which computer I started with (I consistently switch between three computers with different OS) and instead let me take a break and then continue on another computer seamlessly…

For the apprentice photographer like myself, I would recommend PhotonHead, and especially the camera review. But of course, you can also learn much from for example 10 ways and many other sites which can tell you about the arts of light, composition, posture and stance….