my own ERR / parsing data from html

Hello Guys,

I need to build a simple ERP for my startup, which is about buying services.

Its input data will be taken from company's administration pages, i.e orders, customers, service etc.

So, 2 main issues:

a) How I can parse all those data from a protected (w/ password) page
b) Which drag n drop tool (like Filemaker) I should use, given I am not a professional programmer?

If this helps,  I am a Mac user.

Thank you

Dim.
Dimitris YannopoulosAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

David FavorLinux/LXD/WordPress/Hosting SavantCommented:
This depends on the Webpage.

1) If your content is generated by static HTML, then you can use any method to fetch the data.

2) If your content is generated using Javascript + CSS (likely the answer is yes), then you must use PhantomJS or some other Javascript/CSS aware headless browser to fetch your content, or you'll never get the correct content as your starting point.

3) How you parse the returned content relates to language you're using. Every language (PERL, PHP, Python, Node, etc...) will provide many library modules implementing a variety of parsing approaches.

You can also use something like this to convert HTML to raw text, if you're only interested in text without HTML context...

lynx -dump -display_charset=utf8 $in > $out

Open in new window


4) To provide user/pass credentials, refer to copious PhantomJS examples on their site.

Tip: You said, "I am not a professional programmer" so you might take this on as a project for learning or if you have a timeline + the resulting code will generate substantial income for you, hire someone to write your code.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Scott Fell, EE MVEDeveloper & EE ModeratorCommented:
Look for a low-code / no-code solution.  I would  start with FileMaker Advanced https://www.filemaker.com/products/filemaker-pro-advanced/  Also check out other options:

 https://www.zoho.com/creator/
https://www.kintone.com/
https://zudy.com/
https://www.appian.com/
https://skyve.org/

From experience, these things often times seem simple until you go down the rabbit hole and you realize how complex and time consuming it can be to not only build out, but maintain.  If this is not your core competency,  it could very well eat up the much needed time required to run your start up.  Can you get most of what you want out of the box from Quickbooks https://quickbooks.intuit.com/, Freshbooks https://www.freshbooks.com/, Wave https://www.waveapps.com/ or perhaps a platform like salesforce with an erp module https://appexchange.salesforce.com/category/erp.
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Mac OS X

From novice to tech pro — start learning today.