PhotoGraph: Photo Realistic Virtual Worlds


Project Description

The ultimate goal of this project is to create a fully navigable photo-realistic virtual world from a set of photographs with shared scenery. This probably is not a feasible goal for this 8 week course, but at least I can get started. The main issues to be addressed are:
image correspondence - using feature detection a la SIFT or SURF
structure from motion - using bundle adjustment and/or RANSAC
the photo graph - I need to think hard about an efficient implementation
rendering - a good graphics library and platform should be chosen
interface - ease of navigation will be paramount in implementation.

This probably doesn't mean much to you, but any of the technical terms above have wikis about them and tons of research to read about. For anyone who's interested, I've included a few references as well as a research bibliography. Hopefully, I'll also be able to include the PDF of what I have for my thesis as soon as I figure out a reasonable way to post it here. This is followed by my schedule for the project's implementation, a preliminary class outline for the program, and my contact info. Happy browsing!


Research


This is microsoft's image mosaic software, photosynth:
www.photosynth.com

This is a TED Talk describing it:
http://www.ted.com/index.php/talks/blaise_aguera_y_arcas_demos_photosynth.html

And this is an introductory tutorial to image stitching:
http://research.microsoft.com/apps/pubs/default.aspx?id=75695
by a co-creator of photosynth, Richard Szeliski.

For even more fun, this is the working bibliography for the project:
http://photograph.sourceforge.net/ref.html

And perhaps most fun, here is a ?broken? link to download the thesis PDF:
http://photograph.sourceforge.net/thesis.pdf


The Schedule


My three increments for the project are:

1. Choose and implement the image correspondence algorithms.
2. Design and implement the actual graph structure for the photos.
3. Choose and set up rendering library on an appropriate platform to render the photos.
And here is my sorta schedule.


What Has Been Accomplished


I've finished the first part of my first increment; I have a working implementation of the SIFT feature detector. Please see the sift page for details and code. If you'd like to download my sift detector, its in the PhotoGraph git repo on the main sourceforge project page. Further install instructions can be found there :).


Contact Info


My name is Nick Insalata and I attend Portland State University.
I was taking the morning session of OSS 2009.
I can be reached by email: insalatn at pdx dot edu.