Could someone please give me a simple overview of what MPI is?

Posted on 2011-09-06
Last Modified: 2012-06-27
So I understand that MPI will allow a user to launch one program to run on 10 computers from a master computer.

Q. Is MPI something that one can integrate into an existing developed application?
Q. So how can I connect another computer? Does the extra computer need to be on a lan? or could it be over the internet?

Question by:AivsCoder
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions

Accepted Solution

ssnkumar earned 65 total points
ID: 36493454
I am assuming that, you are asking about "Message Passing Interface".

> Q. Is MPI something that one can integrate into an existing developed application?
You have to develop your application using MPI standard.
MPI is not a plugin kind of a thing - so, you cannot integrate it into an existing developed application.

> Q. So how can I connect another computer? Does the extra computer need to be on a lan? or could it be
> over the internet?
You will need to use socket library (or similar implementation) calls to connect 2 computers.
It doesn't matter whether the computers are on LAN, WAN or Internet.
Each of them should have a network Interface, an IP address which is reachable from the other computer.

You can see how MPI is used to parallelize matrix multiplication here:

Refer the "Practical MPI Programming" for more details at:

Read the MPI standard at:

Hope this will give you a good entry to the subject.

Assisted Solution

AJRDev earned 60 total points
ID: 36497261
Basically, you need:

1. A collection (cluster) of machines.
2. An MPI runtime environment on each one.
3. An API (provided by the runtime) to code against, and make use of its functionality.

Application code really needs to be architected from the ground up as parallel and distributed as you will need to decide which operations will be handed off as seperate processes, and how you will recieve the results.

Author Closing Comment

ID: 36814419
Thanks. Useful.

Featured Post

Enroll in June's Course of the Month

June’s Course of the Month is now available! Experts Exchange’s Premium Members, Team Accounts, and Qualified Experts have access to a complimentary course each month as part of their membership—an extra way to sharpen your skills and increase training.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Examines three attack vectors, specifically, the different types of malware used in malicious attacks, web application attacks, and finally, network based attacks.  Concludes by examining the means of securing and protecting critical systems and inf…
Your data is at risk. Probably more today that at any other time in history. There are simply more people with more access to the Web with bad intentions.
Video by: Grant
The goal of this video is to provide viewers with basic examples to understand and use nested-loops in the C programming language.
Need to grow your business through quality cloud solutions? With everything required to build a cloud platform and solution, you may feel like the distance between you and the cloud is quite long. Help is here. Spend some time learning about the Con…

705 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question