Solved

In Neural Network training, how to represent instances that do not belong to any class

Posted on 2012-03-18
4
349 Views
Last Modified: 2013-11-25
Also, how should that be reflected into the design of the network itself?
I mean if the output of 0001 means 1 and the output of 0010 means 2, can we train the network to produce 0000 for instances that do not belong to any class?
0
Comment
Question by:Lamiaaa
  • 2
4 Comments
 
LVL 31

Expert Comment

by:GwynforWeb
ID: 37735729
Are you using a forward-feeding (ie layers proceeding left-right) or a feedback network?
0
 
LVL 35

Assisted Solution

by:mccarl
mccarl earned 500 total points
ID: 37735762
Theoretically, yes, 0000 would mean no class, but in practical terms, you would have to evaluate the performance of that. It would depend on all the usual things with NN's, such as the input data, number of layers, number of neurons, how you train it, etc.
0
 

Author Comment

by:Lamiaaa
ID: 37735810
Thanks guys,

yes, it is forward-feeding.

Are there any sampling approaches (proposed to solve similar problems) to build a training set that appropriately represent the 0000 cases?

It seems difficult because "every thing else" is a very huge and diverse set!
0
 
LVL 35

Accepted Solution

by:
mccarl earned 500 total points
ID: 37735880
It is a bit hard to say, as only you know your problem domain. One possibility might be a random sample that is the same size as the total of all 'classified' samples, ie. of the total training set, half is "everything else' and the other half is 'one of the target classes'.

I would base this on the performance of the network as it stands. So first, you would include these 'everything else' inputs into your verification set, and see how the network performs. Then depending on the results of the verification step, modify the training set to see what improvements can be gained.
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
mapBully challenge 6 114
Re-position the objects 7 97
How to install SVN Command Line Client? 5 42
Not seen Link button 5 15
This article seeks to propel the full implementation of geothermal power plants in Mexico as a renewable energy source.
Having just graduated from college and entered the workforce, I don’t find myself always using the tools and programs I grew accustomed to over the past four years. However, there is one program I continually find myself reverting back to…R.   So …
This theoretical tutorial explains exceptions, reasons for exceptions, different categories of exception and exception hierarchy.
The viewer will learn how to user default arguments when defining functions. This method of defining functions will be contrasted with the non-default-argument of defining functions.

920 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

16 Experts available now in Live!

Get 1:1 Help Now