Solved

Expect.pm, sending long commands

Posted on 2004-09-17
8
379 Views
Last Modified: 2008-01-09
I need to have my Perl script send up to 200 KB of text to an executing process's stdin, and only then await a response. I have been using Expect.pm, but it hangs when asked to send more than ~50KB of text. I've noticed that my shell (BASH on Cygwin on Windows XP) also won't let me append more than ~50KB of text to a program's stdin. Could this limitation be a function of Cygwin or Windows, rather than Expect.pm? How can I get around this?

Thank you.
0
Comment
Question by:bobwood2000
  • 4
  • 3
8 Comments
 
LVL 20

Expert Comment

by:jmcg
ID: 12119070
Expect is using ptty (pseudo teletype) interfaces. There are traditionally limits in how much input can be entered on one line when using canonical text entry on a tty. I don't see how this particular limit could cause the hang you describe.

One thing to try is to have your Perl script break up what it is sending to the program into chunks considerably smaller than 50KB and pause between sending chunks. If a "sleep(1);" is too long, you can try using one of the other mechanisms (such as 'select') for a shorter interval.

Adding a pause is not going to help if there is really a deadlock between consumer and producer. If the process you are feeding the 200KB to is doing something else that can cause it to be blocked besides simply reading its input (for instance, if it is connected with a pipe back to your process or is reporting progress back to the ptty while reading), you may need to modify what you are doing to drain the stream that is getting clogged.

I'm not sure what you meant by the BASH on Cygwin on Windows example. How are you appending text? From a file? From the script itself with a << ("here document") redirection?
0
 

Author Comment

by:bobwood2000
ID: 12129554
Thanks for the feedback. I'll try breaking up the input into smaller chunks and let you know whether that works.

By "BASH on Cygwin on Windows" I meant that my operating system is Windows and BASH is my shell. I'm using Cygwin to provide a Unix-like environment while I'm running Windows, such that Expect.pm will work. Otherwise, Expect.pm doesn't support Windows.
0
 
LVL 20

Expert Comment

by:jmcg
ID: 12129695
OK, I'll be interested to hear what you find out. I've not used Cygwin much, but it's hard to believe there'd be a limitation on the total amount you can pass to a program. The 50KB is approaching the 64KB that can be described by a 16-bit integer, so perhaps there's a limitation on individual buffers that can be attributed to a 16-bit legacy in the implementation.
0
Better Security Awareness With Threat Intelligence

See how one of the leading financial services organizations uses Recorded Future as part of a holistic threat intelligence program to promote security awareness and proactively and efficiently identify threats.

 
LVL 20

Expert Comment

by:jmcg
ID: 12194986
Anything to report?

I've been pulled in other directions than paying attention to Experts Exchange this month. I'm still interested in finding out what the problem was and whether I can offer any more help.
0
 

Accepted Solution

by:
bobwood2000 earned 0 total points
ID: 12196334
Yeah, breaking into chuncks didn't seem to do it. My "solution" has been just to not process data that is > 50 KB. This actually works well enough for my current project.
0
 
LVL 20

Expert Comment

by:jmcg
ID: 12199922
Shall we close this question (I think it might be worth keeping in the database) and refund your points, since we didn't get you a resolution?
0
 

Author Comment

by:bobwood2000
ID: 12206173
Yes, sounds good. Thanks.
0

Featured Post

Threat Intelligence Starter Resources

Integrating threat intelligence can be challenging, and not all companies are ready. These resources can help you build awareness and prepare for defense.

Join & Write a Comment

In the distant past (last year) I hacked together a little toy that would allow a couple of Manager types to query, preview, and extract data from a number of MongoDB instances, to their tool of choice: Excel (http://dilbert.com/strips/comic/2007-08…
Checking the Alert Log in AWS RDS Oracle can be a pain through their user interface.  I made a script to download the Alert Log, look for errors, and email me the trace files.  In this article I'll describe what I did and share my script.
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…
Sending a Secure fax is easy with eFax Corporate (http://www.enterprise.efax.com). First, Just open a new email message.  In the To field, type your recipient's fax number @efaxsend.com. You can even send a secure international fax — just include t…

709 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now