How to read URL's from a site and pass them into a bash script

1) Read URLs off a page.

You may be able to use wget or curl... if the Webpage is simple HTML.

If the page uses Javascript to generate the set of links you're trying to scrape, then you'll use PhantomJS (headless/screenless Chrome), which will run all Javascript on the page to generate links, before you do your scrape.

2) var="https://apps.COMPANYNAME.com/wiki/display/ABCDEF/APPLICATION+INSTANCE+INFO"

Then use $var in your script.... passed however you like.

Likely you're hitting some problem, which will require you providing more context about your current code + exact problem you're hitting.

Tip: If you provide the actual URL you're trying to scrape, someone can provide you with a correct response, about whether PhantomJS is required or not.

Curl +sed would seem like the most straightforwards, assuming the urls are not split on multiple lines. A sample would help.

Skeleton for simple cases

curl URL |sed -ne 's/href="\(http:[^"]*\)"/\1/p '

Thank you all. Such great input from everyone. Thanks again for all your help.