Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people, just like you, are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
Solved

In Neural Network training, how to represent instances that do not belong to any class

Posted on 2012-03-18
4
353 Views
Last Modified: 2013-11-25
Also, how should that be reflected into the design of the network itself?
I mean if the output of 0001 means 1 and the output of 0010 means 2, can we train the network to produce 0000 for instances that do not belong to any class?
0
Comment
Question by:Lamiaaa
  • 2
4 Comments
 
LVL 31

Expert Comment

by:GwynforWeb
ID: 37735729
Are you using a forward-feeding (ie layers proceeding left-right) or a feedback network?
0
 
LVL 35

Assisted Solution

by:mccarl
mccarl earned 500 total points
ID: 37735762
Theoretically, yes, 0000 would mean no class, but in practical terms, you would have to evaluate the performance of that. It would depend on all the usual things with NN's, such as the input data, number of layers, number of neurons, how you train it, etc.
0
 

Author Comment

by:Lamiaaa
ID: 37735810
Thanks guys,

yes, it is forward-feeding.

Are there any sampling approaches (proposed to solve similar problems) to build a training set that appropriately represent the 0000 cases?

It seems difficult because "every thing else" is a very huge and diverse set!
0
 
LVL 35

Accepted Solution

by:
mccarl earned 500 total points
ID: 37735880
It is a bit hard to say, as only you know your problem domain. One possibility might be a random sample that is the same size as the total of all 'classified' samples, ie. of the total training set, half is "everything else' and the other half is 'one of the target classes'.

I would base this on the performance of the network as it stands. So first, you would include these 'everything else' inputs into your verification set, and see how the network performs. Then depending on the results of the verification step, modify the training set to see what improvements can be gained.
0

Featured Post

Free Tool: SSL Checker

Scans your site and returns information about your SSL implementation and certificate. Helpful for debugging and validating your SSL configuration.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Windows Script Host (WSH) has been part of Windows since Windows NT4. Windows Script Host provides architecture for building dynamic scripts that consist of a core object model, scripting hosts, and scripting engines. The key components of Window…
Go is an acronym of golang, is a programming language developed Google in 2007. Go is a new language that is mostly in the C family, with significant input from Pascal/Modula/Oberon family. Hence Go arisen as low-level language with fast compilation…
The viewer will be introduced to the member functions push_back and pop_back of the vector class. The video will teach the difference between the two as well as how to use each one along with its functionality.
In a recent question (https://www.experts-exchange.com/questions/29004105/Run-AutoHotkey-script-directly-from-Notepad.html) here at Experts Exchange, a member asked how to run an AutoHotkey script (.AHK) directly from Notepad++ (aka NPP). This video…

829 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question