Go Premium for a chance to win a PS4. Enter to Win

x
?
Solved

Textarea word filter with XML word list

Posted on 2006-06-15
6
Medium Priority
?
699 Views
Last Modified: 2008-01-09
Hello,

I'm trying to figure out the best way to solve the following problem. I've got a ASP.NET/VB.NET form with a textarea and a XML document with about 600 bad words. OnSubmit I'd like to check and see if any words entered into the textarea are listed in the XML document.

The XML document is structured like this:

<wordlist>
  <word>badword1</word>
  <word>badword2</word>
  <word>bad word or phrase</word>
</wordlist>

My first attempt was to load the XML data into a dataset, loop throught the dataset and use instr on the textarea value to check for words in the XML list. Then the word in question is displayed to the user so they can correct the post. This works somewhat, but is flawed because if there is a bad word inside a good word then the post is flagged, even though there is no bad word - for example the good word "how" is being flagged because it has the word "ho" within which is in the bad word list.

Here's what that code looks like.

    Dim dsFilter as DataSet
    dsFilter = New DataSet()
    dsFilter.ReadXML(MapPath("xml/wordlist.xml"))
   
    Dim intI as Integer = dsFilter.Tables(0).Rows.Count
    Dim intJ as Integer = 0
    Dim strFlag as String = ""

    While intJ < (intI - 1)
   
      If inStr(txtQuickReply.Text, " " & dsFilter.Tables(0).Rows(intJ)(0)) or inStr(txtQuickReply.Text, dsFilter.Tables(0).Rows(intJ)(0) & " ") or inStr(txtQuickReply.Text, " " & dsFilter.Tables(0).Rows(intJ)(0) & " ") or inStr(txtQuickReply.Text, dsFilter.Tables(0).Rows(intJ)(0)) = 1 or inStr(txtQuickReply.Text, " " & dsFilter.Tables(0).Rows(intJ)(0) & ".") or inStr(txtQuickReply.Text, " " & dsFilter.Tables(0).Rows(intJ)(0) & "?") or inStr(txtQuickReply.Text, " " & dsFilter.Tables(0).Rows(intJ)(0) & "!") Then
     
        strFlag = dsFilter.Tables(0).Rows(intJ)(0)
       
      End If
     
      intJ = intJ + 1
   
    End While
   
The only other solution I can think of is to split the textarea content into an aray by space and then do a nested loop - looping through the array of words in the textarea for the outer loop and taking each value of that array and loop through the bad word list to compare for the inner loop. However, I wonder if there is a more efficient solution.

Does anyone have any ideas? Thank you.

Scott
0
Comment
Question by:sneidig
  • 4
  • 2
6 Comments
 
LVL 21

Expert Comment

by:alainbryden
ID: 16916626
you're on the right track. The key now is don't just search for the word but search for " " & word & " " that way you get the word on it's own and not stuck against anything else.

The proper way to do this though would be to use a regular expression checker. Just import regex. Then you can go crazy finding your words in the text, and also make sure that any tags you alow in the box (like html) are skipped so that they can't get away with bad words by saying something like Da[b][/b]mn
0
 
LVL 21

Expert Comment

by:alainbryden
ID: 16916724
Here, I redid your code for you, this should be much easier to manage and edit to make better:

      Dim dsFilter as DataSet
    Dim I as Integer
    Dim strFlag as String, Text As String, Word as String
   
    dsFilter = New DataSet()
    dsFilter.ReadXML(MapPath("xml/wordlist.xml"))
   
      Text = txtQuickReply.Text

    For I = 0 to dsFilter.Tables(0).Rows.Count - 1
   
          Word = dsFilter.Tables(0).Rows(I)(0)
          
          If inStr(Text, " " & Word & " ") or _
             inStr(Text, " " & Word & ".") or _
             inStr(Text, " " & Word & "?") or _
             inStr(Text, " " & Word & "!") Then
     
             strFlag = Word
            End If
    End While



You have to take out those first two statements so that words like 'ho'w and spec'ho' (special?) aren't caught by the filter. Really it's easy to get away with alot in this feature , but at least this way it's easy to tell what you're checking for and you can plug in more variations as you see what they try.
0
 

Author Comment

by:sneidig
ID: 16916876
Thanks for taking a look at this.  If no one has any other has other ideas, I'll probably give you the points tomorrow when I revisit this issue. This works fine except for if the word is the first word in the textarea or else the last word with no puncuation or space. Regular expressions have always been a challenging for me, which is frustrating since much of the time it seems like I can code whatever I want.

I appreciate you taking the time to share your thoughts with me.

Scott
0
VIDEO: THE CONCERTO CLOUD FOR HEALTHCARE

Modern healthcare requires a modern cloud. View this brief video to understand how the Concerto Cloud for Healthcare can help your organization.

 
LVL 21

Accepted Solution

by:
alainbryden earned 2000 total points
ID: 16917366
oh right that's why you had that. Then you can add another line or two

inStr(Text, Word & " ") = 1 or                                     'Word is at the beginning
(inStr(Text, Word) AND len(Text) = len(Word+1)) or     'Only word is a bad word (with room for punctuation)
inStr(" " & Text, Word) > len(Text) - len(Word+1) or ... 'Word is at the end (with room for punctuation)
0
 

Author Comment

by:sneidig
ID: 16922813
Those are some great ideas thanks for your help.

Scott
0
 
LVL 21

Expert Comment

by:alainbryden
ID: 16923333
My pleasure Scott.
0

Featured Post

Free Tool: Site Down Detector

Helpful to verify reports of your own downtime, or to double check a downed website you are trying to access.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Computer science students often experience many of the same frustrations when going through their engineering courses. This article presents seven tips I found useful when completing a bachelors and masters degree in computing which I believe may he…
The SignAloud Glove is capable of translating American Sign Language signs into text and audio.
In this fifth video of the Xpdf series, we discuss and demonstrate the PDFdetach utility, which is able to list and, more importantly, extract attachments that are embedded in PDF files. It does this via a command line interface, making it suitable …
Loops Section Overview

972 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question