Algorithms
Algorithms

Text Analysis

I have some written material that I need to organize. The material is in separate documents. I would like some (easy, non-complicated) automated method that could parse the documents into some sensible format. Initially, I need a table of contents for a writing project I'm involved in. Can a table of contents be generated from separate documents? Is there a way to cluster/classify the text? Neural Network text analysis seems like overkill. Mind Mapping also seems like a lot of work. Maybe MS Word? I can merge the documents into one document if that would help. Any ideas appreciated and points awarded for workable solutions. Thanks.

mzimermanAsked: 2017-03-09

Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

Experts Exchange Solution brought to you by

Enjoy your complimentary solution view.

Get every solution instantly with Premium. Start your 7-day free trial.

I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

LVL 34

Paul SauvéRetiredCommented: 2017-03-09

yes, merging different documents can be merged into MS Word and, with minimal formatting (and knowledge of MS Word), you should be able to generate a table of contents.

mzimermanAuthor Commented: 2017-03-09

I'm aware that a TOC can be generated by Word. I need to be able to group the whole set of documents in some type of automated process in clusters. I need something that can classify the topics in the individual papers. By frequency and relevance perhaps.

LVL 20

Serena HsiMarketing ConsultantCommented: 2017-03-09

There are a few studies on Frequency Analysis for research papers; though I don't believe the intent was to use it as a reference index.

That said, here is a walk-through on how to generate a single index from multiple documents:
https://wordribbon.tips.net/T013128_Creating_a_Single_Index_from_Multiple_Documents.html

LVL 34

Paul SauvéRetiredCommented: 2017-03-09

i think that you are trying to automate the human process of analyzing abstract ideas.

the best i can suggest is that you use a tool called Wordcount developed by Joe Winograd, which is discussed here: https://www.experts-exchange.com/questions/29005206/Need-to-merge-25-Word-Docs-into-one.html#a42024834

this way you will be able to see the number of occurrences of each word in your document (works only in MS Word) which may help you in your analysis.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial