?
Solved

How to steal/share compute cycles

Posted on 2014-01-08
5
Medium Priority
?
227 Views
Last Modified: 2014-03-31
Hi,

I work in a company that employs 'Quants' to develop statistical predictive models. One issue they often have is the time it takes to run optimisations of their data. I was thinking that this can be alleviated by providing them with a framework (They dev in c#) which they can extend and it will spread their computing across any registered machines.

So their are 2 parts to this

1 - A way of providing a framework which they can easily extend and will look after pushing their code to any registered machines.
2 - Having the node be unobtrusive to other applications running (A node will just be another users machine in this case)

I've been looking at implementations of the Actor pattern to achieve the first part and saw one that looks great (http://actorfx.codeplex.com/). Unfortunately this seems to only run on Azure which doesn't fit with my idea.

So my question is whether there are similar solutions already available in .net, and if not what recommendations would you have for me to start with?

thanks
0
Comment
Question by:basil365
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 2
5 Comments
 
LVL 55

Expert Comment

by:Joe Winograd, EE MVE 2015&2016
ID: 39765232
Hi Basil,

The SETI@home project developed computer cycle stealing/sharing software:
http://setiathome.berkeley.edu/

It morphed into a general piece of software called BOINC that is now used beyond just SETI@home:
http://boinc.berkeley.edu/

It is available under the GNU LGPL, so you could integrate it into your own software without your company being required to release the source code of your own portion of the software (if that's an issue for your management). Regards, Joe
0
 

Author Comment

by:basil365
ID: 39765786
thanks - i had looked at BOINC, but unless i'm mistaken it requires any apps to be written in c++?
0
 
LVL 55

Accepted Solution

by:
Joe Winograd, EE MVE 2015&2016 earned 2000 total points
ID: 39765852
My understanding is that it supports C++ directly but that the API is compatible with C and also that there are wrappers for many other languages. I've read of folks using BOINC with Java, Python, and even the stone-age Fortran. Haven't done it myself, but there's a lot of talk about it on the web. My interest is in finding those extraterrestrials.  :)   Regards, Joe
0
 
LVL 55

Expert Comment

by:Joe Winograd, EE MVE 2015&2016
ID: 39928415
Hi Basil,
Just checking in with you, as it's been more than two months since the last post here. I'm wondering if you have this issue sorted or if you're still working on it. Cheers, Joe
0
 

Author Closing Comment

by:basil365
ID: 39966482
Hi Joe - thanks for the follow up - I'm no longer working on it, but we are looking into HPC service pack as a solution.

regards
0

Featured Post

Stack Overflow Podcast - Developer Story

Welcome to the Stack Overflow podcast recorded Thursday July 20 at Stack Overflow Headquearters in NYC. Your hosts today are podcast regulars Jay Hanlon, David Fullerton, and Ilana Yitzhaki, plus the quite irregular Matt Sherman (Stack Overflow Engineering Manager extraordinaire)

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This guide will walk you through the essential considerations and tech stack for building scalable websites. Know how to grow your business the smart way!
In this article I discuss my selections of the Top Four free Outlook OST File Viewers available. Open, view and read even damaged OST files by using these tools. They all provide a clear preview of all data such as emails, notes, tasks, calendars, e…
Monitoring a network: why having a policy is the best policy? Michael Kulchisky, MCSE, MCSA, MCP, VTSP, VSP, CCSP outlines the enormous benefits of having a policy-based approach when monitoring medium and large networks. Software utilized in this v…
In this brief tutorial Pawel from AdRem Software explains how you can quickly find out which services are running on your network, or what are the IP addresses of servers responsible for each service. Software used is freeware NetCrunch Tools (https…

718 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question