Solved, sending long commands

Posted on 2004-09-17
Last Modified: 2008-01-09
I need to have my Perl script send up to 200 KB of text to an executing process's stdin, and only then await a response. I have been using, but it hangs when asked to send more than ~50KB of text. I've noticed that my shell (BASH on Cygwin on Windows XP) also won't let me append more than ~50KB of text to a program's stdin. Could this limitation be a function of Cygwin or Windows, rather than How can I get around this?

Thank you.
Question by:bobwood2000
  • 4
  • 3
LVL 20

Expert Comment

ID: 12119070
Expect is using ptty (pseudo teletype) interfaces. There are traditionally limits in how much input can be entered on one line when using canonical text entry on a tty. I don't see how this particular limit could cause the hang you describe.

One thing to try is to have your Perl script break up what it is sending to the program into chunks considerably smaller than 50KB and pause between sending chunks. If a "sleep(1);" is too long, you can try using one of the other mechanisms (such as 'select') for a shorter interval.

Adding a pause is not going to help if there is really a deadlock between consumer and producer. If the process you are feeding the 200KB to is doing something else that can cause it to be blocked besides simply reading its input (for instance, if it is connected with a pipe back to your process or is reporting progress back to the ptty while reading), you may need to modify what you are doing to drain the stream that is getting clogged.

I'm not sure what you meant by the BASH on Cygwin on Windows example. How are you appending text? From a file? From the script itself with a << ("here document") redirection?

Author Comment

ID: 12129554
Thanks for the feedback. I'll try breaking up the input into smaller chunks and let you know whether that works.

By "BASH on Cygwin on Windows" I meant that my operating system is Windows and BASH is my shell. I'm using Cygwin to provide a Unix-like environment while I'm running Windows, such that will work. Otherwise, doesn't support Windows.
LVL 20

Expert Comment

ID: 12129695
OK, I'll be interested to hear what you find out. I've not used Cygwin much, but it's hard to believe there'd be a limitation on the total amount you can pass to a program. The 50KB is approaching the 64KB that can be described by a 16-bit integer, so perhaps there's a limitation on individual buffers that can be attributed to a 16-bit legacy in the implementation.
Free Tool: Path Explorer

An intuitive utility to help find the CSS path to UI elements on a webpage. These paths are used frequently in a variety of front-end development and QA automation tasks.

One of a set of tools we're offering as a way of saying thank you for being a part of the community.

LVL 20

Expert Comment

ID: 12194986
Anything to report?

I've been pulled in other directions than paying attention to Experts Exchange this month. I'm still interested in finding out what the problem was and whether I can offer any more help.

Accepted Solution

bobwood2000 earned 0 total points
ID: 12196334
Yeah, breaking into chuncks didn't seem to do it. My "solution" has been just to not process data that is > 50 KB. This actually works well enough for my current project.
LVL 20

Expert Comment

ID: 12199922
Shall we close this question (I think it might be worth keeping in the database) and refund your points, since we didn't get you a resolution?

Author Comment

ID: 12206173
Yes, sounds good. Thanks.

Featured Post

Networking for the Cloud Era

Join Microsoft and Riverbed for a discussion and demonstration of enhancements to SteelConnect:
-One-click orchestration and cloud connectivity in Azure environments
-Tight integration of SD-WAN and WAN optimization capabilities
-Scalability and resiliency equal to a data center

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Sending email via Perl on Windows 3 183
Merge files & delete row based on criteria using Perl. 1 104
iSeries PERL Scripts 7 171
Using Perl DBI to query oracle 3 46
I have been pestered over the years to produce and distribute regular data extracts, and often the request have explicitly requested the data be emailed as an Excel attachement; specifically Excel, as it appears: CSV files confuse (no Red or Green h…
There are many situations when we need to display the data in sorted order. For example: Student details by name or by rank or by total marks etc. If you are working on data driven based projects then you will use sorting techniques very frequently.…
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…

809 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question