I am starting a new project, but find I am out of my league and need some insight from the gurus. I am happy to learn what needs to be done on my own, but time is scarce and rather than spend days working on something that may not work, I would appreciate if the community would mind pointing me in the right direction (i.e., best practices, relevant papers, or even just your thoughts).
Situation: I have an m x 2 array of images (relative order is known) and high-resolution (1mm x 1mm) elevation data for an area covering L x W meters. Objects in the images have fine detail, are heterogeneous, and for all intents and purposes, randomly distributed.
1. Create a mesh from elevation data
2. Find homographies between mesh and image (SIFT in 3D?)
3. Position camera in space to display desired position and scale
4. Transform images as needed and drape over mesh
5. Blend images (multiresolution spline?) to completely eliminate seams
6. Apply bump map (presumably from original photos?) to give a more natural appearance
7. Create red/cyan anaglyph on current view and export as TIF (will be large, but dims > supported by JPEG)
I am most comfortable programming in VB .NET and C#, but will take a crash course in C++ if I need to (I probably should anyway).
Thanks for any help!