Need for GlusterFS for distributed bigdata services running in a kubernetes managed environment

Tej Luthra
Tej Luthra used Ask the Experts™
on
Hello.. what type of storage architecture would be most useful for kafka, zookeeper running in a kubernetes and containerized environment. Would glusterfs that manages storage persistence, replication, resiliency, and HA be an overkill when the distributed bigdata services do this on their own anyway? We're debating internally why glusterfs would be needed for distributed bigdata systems like Cassandra, Mongo, Kafka, Zookeeper, etc. Thus trying to keep the architecture simpler. Just wondering if anyone has thoughts or experience to share that would help us a bit also.
Comment
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®
David FavorFractional CTO
Distinguished Expert 2018

Commented:
State...

1) Amount of data you'll be managing.

2) Type of workload (primarily read, primarily write, mixed).

3) Type of clients accessing data - like browsers or API service.

4) Typical amount of data returned each client access.

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial