Solved

pgpool-II... what is a good server spec?

Posted on 2015-01-29
5
446 Views
Last Modified: 2015-02-03
I'm setting up a new PostgreSQL cluster, and want to use pgpool-II to load balance and pool connections... but I've not found anywhere that gives suggestions on pgpool server sizing.

Can someone suggest a formula for sizing the pgpool servers?

It's going to be a fairly simple setup, just load balancing and connection pooling with PostgreSQL streaming replication keeping the Read-Only servers in sync... no pgpool parallel query... no pgpool replication, etc:

8 x Web servers
2 x pgpool servers (using "watchdog" for high-availability, so active/passive setup)
4 x PostgreSQL database servers (8 CPU Cores, 16GB RAM. 1 x Read-Write, and 3 x Read-Only)

This is in a private VMware cloud setup, so I can't definitely say what a "CPU Core" is... or how fast, etc.

I was planning on using a small-ish server that has 2 x GigEthernet connections, and maybe 2G of ram... but I figure the most important thing is having high CPU to keep latency down and ensure the network ports can be flooded.  I was going to start with 2 x CPU Cores and see how that goes, but it would be better if I wasn't shooting in the dark.

I'm going to do heavy-load testing later in the project, but I wanted to get close to the mark now... so any suggestions?

Thanks for your time.
0
Comment
Question by:Sophia Paterakis
  • 3
  • 2
5 Comments
 
LVL 61

Assisted Solution

by:gheist
gheist earned 500 total points
ID: 40578551
pgpool is just a connection broker. it needs fast ram if anything special at all.
1x write postgres will benefit from flash disk for journals.

you are very brief with your vmware specifications. Core what? you use 2-core laptop processors for serious servers?
0
 
LVL 1

Author Comment

by:Sophia Paterakis
ID: 40579412
Hi @gheist,

Thanks, and yes, sorry for the vague spec.  This is a new setup for me, and the servers are all in a private VMware hosted cloud.  I can assure you they are server-spec, and not laptops... but nobody can give me a hard definition of what a "core" means, how fast, or even what type of CPU.  They are Intel-based, but could be AMD for all I know... yay for virtulization. :o(

Really I was hoping to get some sort of formula to give a guide on sizing the servers, either based on transaction volume, or some other metric.  I had figured that they don't need much disk, but fast CPU (and RAM), plus fast network (ideally one inbound and one outbound) is best.

I just wanted to try and find something more accurate so I can take a best guess on the size of the servers beforehand.  It's not critical as we can add CPU later, but it will make me look silly if I say they only need a small server and it ends up being a bottleneck for the entire system.

At this point I'm going to have to spec a small server, then flood it with traffic to find the breaking point... and increment CPU and Memory from there.

Thanks.
0
 
LVL 61

Accepted Solution

by:
gheist earned 500 total points
ID: 40579414
vmware offers resource hotplug for all sorts of guests. No need to guess.
we tend to lock network devices (firewalls, proxys, or in your case pgpool) in memory, but otherwise it needs no special attention
0
 
LVL 1

Author Closing Comment

by:Sophia Paterakis
ID: 40585984
Thanks gheist.  I guess I was probably looking for some very specific documentation that doesn't exist, but if the general advice is that pgpool isn't all that heavy on server resources, then I'll start small and build up as necessary.
0
 
LVL 61

Expert Comment

by:gheist
ID: 40586074
they have some guide for vpostgres, but since pgpool spins in memory guide is irrelevant...
pgpool is similar to reverse proxy that plainly works, no tuning required outside VM
0

Featured Post

Comprehensive Backup Solutions for Microsoft

Acronis protects the complete Microsoft technology stack: Windows Server, Windows PC, laptop and Surface data; Microsoft business applications; Microsoft Hyper-V; Azure VMs; Microsoft Windows Server 2016; Microsoft Exchange 2016 and SQL Server 2016.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
VMware nested installation 2 73
V2V Hyper-V RODC to ESXi 4 61
2 VGA on VM 3 40
Cisco UCM 10.5 VM on UCS C240 M4S2 - v2.0(3i) How to backup 2 74
HOW TO: Connect to the VMware vSphere Hypervisor 6.5 (ESXi 6.5) using the vSphere (HTML5 Web) Host Client 6.5, and perform a simple configuration task of adding a new VMFS 6 datastore.
In this step by step tutorial with screenshots, we will show you HOW TO: Enable SSH Remote Access on a VMware vSphere Hypervisor 6.5 (ESXi 6.5). This is important if you need to enable SSH remote access for additional troubleshooting of the ESXi hos…
Teach the user how to use configure the vCenter Server storage filters Open vSphere Web Client:  Navigate to vCenter Server Advanced Settings: Add the four vCenter Server storage filters: Review the advanced settings: Modify the values of the four v…
Teach the user how to use vSphere Update Manager to update the VMware Tools and virtual machine hardware version Open vSphere Client: Review manual processes for updating VMware Tools and virtual hardware versions: Create a new baseline group in vSp…

932 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now