Best grid architecture
Posted on 2005-04-20
I am planning a system where I would have any number of machines working together, processing files. The work will be defined by a sequence of tasks to be performed with those files, such as packing/unpacking, conversion, etc. Machines will be mostly Linux, but some will be PC for specialized processing. Each will tell what kind of processing it is able to do.
For the file system, I would choose something like google file system, or openAFS.
For work organization, I am looking at JINI - because it has JavaSpaces for tasks, and master/workers.
I am free to choose technology, and I am planning a completely java solution.
Are these choices ok? What else should I look at?