What is the best online system to use to subset large spatial datasets for extraction of images?

I have multiple individual large spatial datasets, grids/rasters around 80Gb.  What is the best way to deal with delivery of this information online.  The proposed method is to allow the user to select an area eg rectangle on a google map interface. The rectangle geographic extent coordinates are used to issue the subset instructions and generate an output image of the area of interest. Instead of processing the image extraction from the large dataset I was looking at a solution that stitches image tiles together at resolution based on the area of interest. My questions relate to the following areas;

1. Type of OS / Scripting Language or Framework of the server (eg Linux/Python Windows/.NET (my primary technology)). Pls note CLOUD systems are NOT an option.
2. Perform Subsetting on a remote server or Supply Subset PNG8 images on the main server that get stitched together.
3. Open source systems that already achieve this.

Geoserver appears to be a potential solution.
LVL 7
XGISAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Scott Fell, EE MVEDeveloper & EE ModeratorCommented:
Have you looked into using fusion tables?  I experimented with this a few years back but never finished what I started.  You are essentially recreating what google earth does using fusion tables and your images.  I think this sample is what you are after.   https://developers.google.com/maps/documentation/javascript/examples/maptype-image
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
tbsgadiCommented:
0
XGISAuthor Commented:
Thankyou Padas and tbsgadi, both very useful answers.  
My scenario has changed slightly after doing further calculations that show I would require at least 400Gb to store my shapefiles for my 5m contour layer and 1.5Tb to store images at 150dpi. Since I dont have googles budget I have opted to store the 100 part processed grid tiles on the server (70gb) which will form the basis of any geoprocessing using GDAL and Python. Generated  thematic data layers and images will then be made available for client delivery as compressed downloads.  As for the web server I am looking at Telerik silverlight RadMap (which I already have licenced) which has a lot of basic resources for doing this kind of task, eg various providers, projections etc.

Any further comments are welcome as I am still in the planning stage. Just to clarify I do not plan to serve the Grid tiles through the web server.  The WMS will only be used to locate an area and draw a shape around it which will then be stored and used for any subsequent processing.
0
Scott Fell, EE MVEDeveloper & EE ModeratorCommented:
It sounds like you have everything under control
0
XGISAuthor Commented:
Both answers were equally useful in helping me reach a decision to this point in time. Thankyou for your time.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
GIS/GPS Programming

From novice to tech pro — start learning today.