lavitz
asked on
Correct tech. for pull data from servers
My scenario:
I have many machines which stores data in local databases (sqlite).
There is one `client` machine that pull data from all machines and save it to his local database for use other parts of software. Saying pull I mean that he want get some data between dates, i.e. whole day, whole month. (By the way - how it's call that scenario?)
I'am struggling with choosing correct technology.
Currently I making RPC with Thrift framework. It's easy to use but I don't know is it good way, because I making some replication mechanism myself.
With that RPC I call function i.e  GetNewData(Revision). And I get all new tables data. Then I save it to client's database.
Other idea was use MongoDB or CouchDB with replication (i don't know if these databases can by setup like in my scenario).
Other idea was to save Sqlite database to file, download it and merge. Or save only new record and merge. It is simple, and because it is simple I'am afraid that I will be closed for future extensions.
I need some advice and discussion.
I have many machines which stores data in local databases (sqlite).
There is one `client` machine that pull data from all machines and save it to his local database for use other parts of software. Saying pull I mean that he want get some data between dates, i.e. whole day, whole month. (By the way - how it's call that scenario?)
I'am struggling with choosing correct technology.
Currently I making RPC with Thrift framework. It's easy to use but I don't know is it good way, because I making some replication mechanism myself.
With that RPC I call function i.e  GetNewData(Revision). And I get all new tables data. Then I save it to client's database.
Other idea was use MongoDB or CouchDB with replication (i don't know if these databases can by setup like in my scenario).
Other idea was to save Sqlite database to file, download it and merge. Or save only new record and merge. It is simple, and because it is simple I'am afraid that I will be closed for future extensions.
I need some advice and discussion.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.