asked on

Text Classifier - Machine Learning

Hey,

I have a few thousand quite text files that need to be classified by category.

I already have a few hundred manually classified.

There are about 50 different categories.

I'm thinking of using MALLET:
http://mallet.cs.umass.edu/index.php

But the problem is that I have no idea how to use MALLET, the instructions not being very good.

Could someone please explain how I would use MALLET for my purpose, or give me some other software to use which could do this?

Thank you for your time!

ADFB

bbao

ever checked its Tutorial and Deverloper's Guide??

http://mallet.cs.umass.edu/mallet-tutorial.pdf
http://homepages.inf.ed.ac.uk/csutton/publications/crf-tutorial.pdf
http://mallet.cs.umass.edu/fst.php

ADFB

ASKER

That's not how to use it, that's how to make it.

I only want to know how to use the application for my purposes, not hold to build it from scratch.

ASKER CERTIFIED SOLUTION

dpearson

membership

This solution is only available to members.

To access this solution, you must be a member of Experts Exchange.

Start Free Trial

ADFB

ASKER

OK, thanks. I think I've figured it out, but I'm still confused about the following:

----------
Applying a Saved Classifier to New Unlabeled Data: To apply a saved classifier to new unlabeled data, use Csv2Classify (for one-instance-per-line data) or Text2Classify (for one-instance-per-file data).

bin/mallet classify-file --input data --output - --classifier classifier
bin/mallet classify-dir --input datadir --output - --classifier classifier

Using the above commands, classifications are written to standard output.
----------

I want it to output to CSV format, but I don't know what to type to get it to do that. What should the command look like to get it to output to CSV?

Thanks!

dpearson

I didn't see anything obvious about the output format. If it's not listed in the "--help" you may need to write a small converter program (e.g. in Perl) to take the output and convert it to CSV format.

If that outside your comfort zone, you can probably email the developers and they could either point you to an existing tool or they could extend Mallet to support CSV output.

Doug