Solved

AIX NUMA

Posted on 2014-01-22
6
1,183 Views
Last Modified: 2014-01-22
so NUMA..
we have a p780 that host our lpar for one of our oracle prod DB..

this command is showing

lssrad -va                  
REF1   SRAD        MEM      CPU
0
          0   141814.44      0-47 52-55 60-63 68-71 76-79 84-87 92-95
          1   54702.00      48-51 56-59 64-67 72-75 80-83 88-91 96-99

so that menas we have only 2 NUMA domains?

do we need to pursuit any tuning? how can we decide? and what to check?
0
Comment
Question by:it-rex
  • 3
  • 3
6 Comments
 
LVL 68

Expert Comment

by:woolmilkporc
ID: 39801420
You have two SRADS (Scheduler Resource Affinity Domains) because you have two hardware sockets (MCM modules) in your machine.

You can only increase the number of SRADs by buying/installing more sockets/MCMs.
0
 
LVL 11

Author Comment

by:it-rex
ID: 39801435
do we need to pursuit any tuning? how can we decide? and what to check?
0
 
LVL 68

Expert Comment

by:woolmilkporc
ID: 39801514
The fewer SRADs in a virtual machine the better.
Lpars should be spread in the minimum number of Chips / Nodes to
reduce the number of Remote & Distant Memory.

Optimizing LPAR placement is quite a complicated task.

Here is a developerworks blog on that topic:
https://www.ibm.com/developerworks/community/blogs/aixpert/entry/local_near_far_power7_affinity_nine_conclusions17?lang=en

During LPAR creation on the HMC you can associate an LPAR with an affinity group.
Put critical LPARs in an affinity group of their own, a single LPAR per group.
0
What Security Threats Are You Missing?

Enhance your security with threat intelligence from the web. Get trending threat insights on hackers, exploits, and suspicious IP addresses delivered to your inbox with our free Cyber Daily.

 
LVL 11

Author Comment

by:it-rex
ID: 39801571
so the differnce in memory assigened to each domain

     0   141814.44     0-47 52-55 60-63 68-71 76-79 84-87 92-95
          1   54702.00      48-51 56-59 64-67 72-75 80-83 88-91 96-99

is it something to worry about?
0
 
LVL 68

Accepted Solution

by:
woolmilkporc earned 500 total points
ID: 39801621
I don't know how much memory you have in your machine per socket/MCM
.
If the LPAR demands more memory than can be provided by one physical socket then there is no way around splitting memory across SRADs.

Memory in one SRAD needed by a thread running on a core in the other SRAD is considered "near" or "far"  memory as opposed to "local" memory.
In your case both SRADs are in the same building block (because they're both in REF1 (Node) 0) so we're talking about "near" memory - access to near memory has to go through the "Power Chip to Power Chip Intra-node communication path" which shouldn't cost much time.

The fundamental proposition is still: The fewer SRADs the better. See my hints on LPAR placement optimization.
0
 
LVL 11

Author Comment

by:it-rex
ID: 39801639
thanks
0

Featured Post

Find Ransomware Secrets With All-Source Analysis

Ransomware has become a major concern for organizations; its prevalence has grown due to past successes achieved by threat actors. While each ransomware variant is different, we’ve seen some common tactics and trends used among the authors of the malware.

Join & Write a Comment

I promised to write further about my project, and here I am.  First, I needed to setup the Primary Server.  You can read how in this article: Setup FreeBSD Server with full HDD encryption (http://www.experts-exchange.com/OS/Unix/BSD/FreeBSD/A_3660-S…
Using libpcap/Jpcap to capture and send packets on Solaris version (10/11) Library used: 1.      Libpcap (http://www.tcpdump.org) Version 1.2 2.      Jpcap(http://netresearch.ics.uci.edu/kfujii/Jpcap/doc/index.html) Version 0.6 Prerequisite: 1.      GCC …
Learn several ways to interact with files and get file information from the bash shell. ls lists the contents of a directory: Using the -a flag displays hidden files: Using the -l flag formats the output in a long list: The file command gives us mor…
This video shows how to set up a shell script to accept a positional parameter when called, pass that to a SQL script, accept the output from the statement back and then manipulate it in the Shell.

744 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now