Solved

In Neural Network training, how to represent instances that do not belong to any class

Posted on 2012-03-18
4
346 Views
Last Modified: 2013-11-25
Also, how should that be reflected into the design of the network itself?
I mean if the output of 0001 means 1 and the output of 0010 means 2, can we train the network to produce 0000 for instances that do not belong to any class?
0
Comment
Question by:Lamiaaa
  • 2
4 Comments
 
LVL 31

Expert Comment

by:GwynforWeb
ID: 37735729
Are you using a forward-feeding (ie layers proceeding left-right) or a feedback network?
0
 
LVL 35

Assisted Solution

by:mccarl
mccarl earned 500 total points
ID: 37735762
Theoretically, yes, 0000 would mean no class, but in practical terms, you would have to evaluate the performance of that. It would depend on all the usual things with NN's, such as the input data, number of layers, number of neurons, how you train it, etc.
0
 

Author Comment

by:Lamiaaa
ID: 37735810
Thanks guys,

yes, it is forward-feeding.

Are there any sampling approaches (proposed to solve similar problems) to build a training set that appropriately represent the 0000 cases?

It seems difficult because "every thing else" is a very huge and diverse set!
0
 
LVL 35

Accepted Solution

by:
mccarl earned 500 total points
ID: 37735880
It is a bit hard to say, as only you know your problem domain. One possibility might be a random sample that is the same size as the total of all 'classified' samples, ie. of the total training set, half is "everything else' and the other half is 'one of the target classes'.

I would base this on the performance of the network as it stands. So first, you would include these 'everything else' inputs into your verification set, and see how the network performs. Then depending on the results of the verification step, modify the training set to see what improvements can be gained.
0

Featured Post

6 Surprising Benefits of Threat Intelligence

All sorts of threat intelligence is available on the web. Intelligence you can learn from, and use to anticipate and prepare for future attacks.

Join & Write a Comment

Having just graduated from college and entered the workforce, I don’t find myself always using the tools and programs I grew accustomed to over the past four years. However, there is one program I continually find myself reverting back to…R.   So …
Lithium-ion batteries area cornerstone of today's portable electronic devices, and even though they are relied upon heavily, their chemistry and origin are not of common knowledge. This article is about a device on which every smartphone, laptop, an…
The goal of the video will be to teach the user the concept of local variables and scope. An example of a locally defined variable will be given as well as an explanation of what scope is in C++. The local variable and concept of scope will be relat…
The viewer will learn how to user default arguments when defining functions. This method of defining functions will be contrasted with the non-default-argument of defining functions.

744 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

14 Experts available now in Live!

Get 1:1 Help Now