How to steal/share compute cycles

Hi,

I work in a company that employs 'Quants' to develop statistical predictive models. One issue they often have is the time it takes to run optimisations of their data. I was thinking that this can be alleviated by providing them with a framework (They dev in c#) which they can extend and it will spread their computing across any registered machines.

So their are 2 parts to this

1 - A way of providing a framework which they can easily extend and will look after pushing their code to any registered machines.
2 - Having the node be unobtrusive to other applications running (A node will just be another users machine in this case)

I've been looking at implementations of the Actor pattern to achieve the first part and saw one that looks great (http://actorfx.codeplex.com/). Unfortunately this seems to only run on Azure which doesn't fit with my idea.

So my question is whether there are similar solutions already available in .net, and if not what recommendations would you have for me to start with?

thanks
basil365Asked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Joe WinogradDeveloperCommented:
Hi Basil,

The SETI@home project developed computer cycle stealing/sharing software:
http://setiathome.berkeley.edu/

It morphed into a general piece of software called BOINC that is now used beyond just SETI@home:
http://boinc.berkeley.edu/

It is available under the GNU LGPL, so you could integrate it into your own software without your company being required to release the source code of your own portion of the software (if that's an issue for your management). Regards, Joe
basil365Author Commented:
thanks - i had looked at BOINC, but unless i'm mistaken it requires any apps to be written in c++?
Joe WinogradDeveloperCommented:
My understanding is that it supports C++ directly but that the API is compatible with C and also that there are wrappers for many other languages. I've read of folks using BOINC with Java, Python, and even the stone-age Fortran. Haven't done it myself, but there's a lot of talk about it on the web. My interest is in finding those extraterrestrials.  :)   Regards, Joe

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Joe WinogradDeveloperCommented:
Hi Basil,
Just checking in with you, as it's been more than two months since the last post here. I'm wondering if you have this issue sorted or if you're still working on it. Cheers, Joe
basil365Author Commented:
Hi Joe - thanks for the follow up - I'm no longer working on it, but we are looking into HPC service pack as a solution.

regards
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
.NET Programming

From novice to tech pro — start learning today.