We value your feedback.
Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!
Course Of The Month
1 day, 20 hours left to enrollBecome a Premium Member and unlock a new, free course in leading technologies each month.
Solved
How do I force the program to free memory?
Posted on 2001-09-11
I'm using HP-UX.11 (but we have to port software to Sun and other platforms
so the solution must be portable too).
I have understood that when process allocates memory then it of course
gets it, but never really frees it (even when you call delete/free in your program).
So that memory is never released to other processes but kept reserved for
that single process. So when process calls delete the memory is not freed
to other process and when the same process calls new/malloc() the memory
is take from that memory space that has been reserved for that process.
Is there a way to force the program to release the memory or somehow
configure OS so that it releases the memory?
so the solution must be portable too).
I have understood that when process allocates memory then it of course
gets it, but never really frees it (even when you call delete/free in your program).
So that memory is never released to other processes but kept reserved for
that single process. So when process calls delete the memory is not freed
to other process and when the same process calls new/malloc() the memory
is take from that memory space that has been reserved for that process.
Is there a way to force the program to release the memory or somehow
configure OS so that it releases the memory?
[X]
Welcome to Experts Exchange
Add your voice to the tech community where 5M+ people just like you are talking about what matters.
- Help others & share knowledge
- Earn cash & points
- Learn & ask questions
-
4
3
8 Comments
You are correct in the way memory allocation works. When a process executes a malloc() to gain address space the system will use brk(), if necessary, to allocate a chunk of memory to the calling process. That allocated memory will remain a part of the address space for the life of the task and I know of no way to free memory allocated by brk() other than to exit the task.
It is possible to release memory allocated by brk() by calling
sbrk() with a negative increment.
But doing this requires compacting the memory so that the part
you're about to free isn't being used anymore.
If your program is recursive and therefore stack intensive, you might be able to manage memory yourself (and not ever ever ever call malloc)
through brk/sbrk.
Otherwise, compacting the memory will be very difficult and
very computationally expensive. So expensive that it's not worth
doing at all.
Why? Because the way the demanding paging system works, pags
that are not being used will be paged out anyway.
sbrk() with a negative increment.
But doing this requires compacting the memory so that the part
you're about to free isn't being used anymore.
If your program is recursive and therefore stack intensive, you might be able to manage memory yourself (and not ever ever ever call malloc)
through brk/sbrk.
Otherwise, compacting the memory will be very difficult and
very computationally expensive. So expensive that it's not worth
doing at all.
Why? Because the way the demanding paging system works, pags
that are not being used will be paged out anyway.
All about free said by the first 2 comments.
And it's still more worse than that, 'cause most OS don't have a useful garbage collection. So malloc slices the available memory for a process for most calls. Example:
process allocated 100kbyte and 10kbyte
process frees these 100kbyte and these 10kbytes (address space still belongs to the process)
process tries to allocate 101kbytes, now it did not find a continous block of such size and allocates a new 101kbyte block to the process, and so on ...
Imagine a scenario when small blocks are required (like in most C++, or alike, programming languages) and the process is running for a long time, it comes to the point where the process has allocated a lot of memory which is unused by the process but cannot be used 'cause it is sliced down.
AFAIK, the only solution to avoid this is to use your own memory allocation, like chris_calabrese described.
And it's still more worse than that, 'cause most OS don't have a useful garbage collection. So malloc slices the available memory for a process for most calls. Example:
process allocated 100kbyte and 10kbyte
process frees these 100kbyte and these 10kbytes (address space still belongs to the process)
process tries to allocate 101kbytes, now it did not find a continous block of such size and allocates a new 101kbyte block to the process, and so on ...
Imagine a scenario when small blocks are required (like in most C++, or alike, programming languages) and the process is running for a long time, it comes to the point where the process has allocated a lot of memory which is unused by the process but cannot be used 'cause it is sliced down.
AFAIK, the only solution to avoid this is to use your own memory allocation, like chris_calabrese described.
What malloc are you using ahoffmann? I know some older implementations worked like that, but most modern ones would collapse the 100kbyte block and the 10kbyte block into a single 110kbyte block.
SunOS, Solaris <= 2.3, HP-UX <=9.x, AIX < 4.0, IRIX < 6.0 (probaly also OSF and SINIX)
Didn't check newer versions, so my information may be outdated now.
Didn't check newer versions, so my information may be outdated now.
Hmm, I think Phong Vo made that change to the
Bell Labs malloc in around 1992, and that it
made it into sVr4.2 and also into the later BSD's.
Given that all these systems are based on earlier code
from USL and/or BSD, that's actually not too surprising.
This should be fixed in UnixWare, Linux, and the BSD's.
I'd be surprised if it isn't also in newer releases
of the OS' you mention too, though.
Bell Labs malloc in around 1992, and that it
made it into sVr4.2 and also into the later BSD's.
Given that all these systems are based on earlier code
from USL and/or BSD, that's actually not too surprising.
This should be fixed in UnixWare, Linux, and the BSD's.
I'd be surprised if it isn't also in newer releases
of the OS' you mention too, though.
aha, I see I was not talking in miracles ;-)
and also that chris_calabrese seems to be much deeper in the UNIX sources than me.
I don't have UNIX's family tree in my brain, but slightly remember that SunOS (and so Solaris) is a very early branch.
And I think I never watched these symtomes on BSD systems (FreeBSD, NetBSD, Linux).
Nice to get new hints on this (ancient) item. Thanks.
and also that chris_calabrese seems to be much deeper in the UNIX sources than me.
I don't have UNIX's family tree in my brain, but slightly remember that SunOS (and so Solaris) is a very early branch.
And I think I never watched these symtomes on BSD systems (FreeBSD, NetBSD, Linux).
Nice to get new hints on this (ancient) item. Thanks.
Featured Post
We value your feedback.
Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!
Question has a verified solution.
If you are experiencing a similar issue, please ask a related question
Suggested Solutions
| Title | # Comments | Views | Activity |
|---|---|---|---|
| SSH commands for Nas4free | 21 | 554 | |
| auto mounter on solaris | 1 | 80 | |
| aix tls version | 6 | 653 | |
| Need a version of telnet and/or ssh that supports tcp wrappers on AIX 5.1 | 16 | 112 |
Let's say you need to move the data of a file system from one partition to another. This generally involves dismounting the file system, backing it up to tapes, and restoring it to a new partition. You may also copy the file system from one place to…
Java performance on Solaris - Managing CPUs
There are various resource controls in operating system which directly/indirectly influence the performance of application. one of the most important resource controls is "CPU".
In a multithreaded…
This video shows how to set up a shell script to accept a positional parameter when called, pass that to a SQL script, accept the output from the statement back and then manipulate it in the Shell.
In a previous video, we went over how to export a DynamoDB table into Amazon S3. In this video, we show how to load the export from S3 into a DynamoDB table.
Suggested Courses
Course of the Month1 day, 20 hours left to enroll
710 members asked questions and received personalized solutions in the past 7 days.
Join the community of 500,000 technology professionals and ask your questions.