Call handler asking for voice mail

I have an extension setup with a call handler answering it. After the message is played it asks them to leave a message. I have that call handler going into to other call handlers and they all ask callers to leave a message after the greeting. I just want the greeting to be played and callers not to be asked to leave a message until they reach an actual phone and not a call handler.