How to steal/share compute cycles
Hi,
I work in a company that employs 'Quants' to develop statistical predictive models. One issue they often have is the time it takes to run optimisations of their data. I was thinking that this can be alleviated by providing them with a framework (They dev in c#) which they can extend and it will spread their computing across any registered machines.
So their are 2 parts to this
1 - A way of providing a framework which they can easily extend and will look after pushing their code to any registered machines.
2 - Having the node be unobtrusive to other applications running (A node will just be another users machine in this case)
I've been looking at implementations of the Actor pattern to achieve the first part and saw one that looks great (http://actorfx.codeplex.com/). Unfortunately this seems to only run on Azure which doesn't fit with my idea.
So my question is whether there are similar solutions already available in .net, and if not what recommendations would you have for me to start with?
thanks
I work in a company that employs 'Quants' to develop statistical predictive models. One issue they often have is the time it takes to run optimisations of their data. I was thinking that this can be alleviated by providing them with a framework (They dev in c#) which they can extend and it will spread their computing across any registered machines.
So their are 2 parts to this
1 - A way of providing a framework which they can easily extend and will look after pushing their code to any registered machines.
2 - Having the node be unobtrusive to other applications running (A node will just be another users machine in this case)
I've been looking at implementations of the Actor pattern to achieve the first part and saw one that looks great (http://actorfx.codeplex.com/). Unfortunately this seems to only run on Azure which doesn't fit with my idea.
So my question is whether there are similar solutions already available in .net, and if not what recommendations would you have for me to start with?
thanks
ASKER
thanks - i had looked at BOINC, but unless i'm mistaken it requires any apps to be written in c++?
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Hi Basil,
Just checking in with you, as it's been more than two months since the last post here. I'm wondering if you have this issue sorted or if you're still working on it. Cheers, Joe
Just checking in with you, as it's been more than two months since the last post here. I'm wondering if you have this issue sorted or if you're still working on it. Cheers, Joe
ASKER
Hi Joe - thanks for the follow up - I'm no longer working on it, but we are looking into HPC service pack as a solution.
regards
regards
The SETI@home project developed computer cycle stealing/sharing software:
http://setiathome.berkeley.edu/
It morphed into a general piece of software called BOINC that is now used beyond just SETI@home:
http://boinc.berkeley.edu/
It is available under the GNU LGPL, so you could integrate it into your own software without your company being required to release the source code of your own portion of the software (if that's an issue for your management). Regards, Joe