Solved

Remove records from mysql

Posted on 2012-04-02
19
405 Views
Last Modified: 2012-06-22
Hi,

I have a voting poll database that received some really odd votes, the records show some very strange IPs.


4,546      Guest      455.513.414.406/24 /      April 2, 2012 @ 6:11 am
4,547      Guest      540.498.503.183/31 /      April 2, 2012 @ 6:11 am

A valid vote looks like this:


4,545      Guest      99.232.208.242 / ###.cable.rogers.com       April 2, 2012 @ 6:12 am

So i would like to run a sql query and search for all results that have these strange ip.

1) Can i run a sql command that will display the results of all strange IP addresses ?
2) Is there a REGEX sql command that that will search for invalid ip addresses ?
3) What would be the equiv. DELETE command to get rid of these queries.

Thaks,
0
Comment
Question by:ifred
  • 9
  • 5
  • 4
  • +1
19 Comments
 
LVL 31

Accepted Solution

by:
awking00 earned 0 total points
ID: 37796567
Can you provide a description of the table (i.e. column names and datatypes)?
0
 

Author Comment

by:ifred
ID: 37796675
1      pollip_id      int(10)
2      pollip_qid      varchar(10)
3      pollip_aid      varchar(10)
4      pollip_ip      varchar(100)
5      pollip_host      varchar(200)
6      pollip_timestamp      varchar(20
7      pollip_user      tinytext      utf8_general_ci
8      pollip_userid      int(10)

pollip_ip is the filed with the ip in question.
0
 
LVL 31

Expert Comment

by:awking00
ID: 37796882
So, which if any or all of these values exist in the pollip_ip field?
4,546      Guest      455.513.414.406/24 /      April 2, 2012 @ 6:11 am
4,547      Guest      540.498.503.183/31 /      April 2, 2012 @ 6:11 am
4,545      Guest      99.232.208.242 / ###.cable.rogers.com       April 2, 2012 @ 6:12 am
0
 

Author Comment

by:ifred
ID: 37796912
455.513.414.406/24

and

 540.498.503.183/31

and

99.232.208.242
0
 
LVL 33

Expert Comment

by:Norie
ID: 37797048
Perhaps a stupid question, but assuming ###.cable.rogers.com is in the host field, is there always a host when the IP is valid?
0
 

Assisted Solution

by:ifred
ifred earned 0 total points
ID: 37797056
yes, i have 6000 records and i did not look at all of them but:

SELECT *
FROM  `wp_pollsip`
WHERE  `pollip_aid` LIKE  '6'
AND  `pollip_host` =  ' '
LIMIT 0 , 30

Does return me 6747 votes that i think are the ones I should null out.
0
 
LVL 33

Expert Comment

by:Norie
ID: 37797136
So you mean you want to delete the records were the host field is empty?

Try this.

DELETE FROM `wp_pollsip` WHERE `poll_host` = '';

Or this.

DELETE FROM `wp_pollsip` WHERE `poll_host` is null;
0
 

Author Comment

by:ifred
ID: 37797145
Not really. Every record has an ip, and i am wondering if one would know a SQL statement i could use that will return all fields where wp_pollsip contains an invalid IP address.
Unfortunately I am not that good with Regex expressions.
0
 
LVL 33

Expert Comment

by:Norie
ID: 37797183
So do you want to delete records with invalid IPs or validate the existing IPs?
0
Maximize Your Threat Intelligence Reporting

Reporting is one of the most important and least talked about aspects of a world-class threat intelligence program. Here’s how to do it right.

 

Author Comment

by:ifred
ID: 37797194
i want to delete records with invalid IP addresses. Usually they have a number higher than 255 in at least one of the octets, those are REALLY invalid.
0
 
LVL 33

Expert Comment

by:Norie
ID: 37797273
No problem, I was trying to do something with regexp but with no luck, so when you posted the table structure I just thought using the host field might work, wishful thinking I suppose.
0
 

Author Comment

by:ifred
ID: 37797300
While it could be one of the way to do this, it is probably not the best way to do it.
Let's see if anybody else can help and thanks anyway.
0
 
LVL 31

Expert Comment

by:awking00
ID: 37797650
455.513.414.406/24
and
 540.498.503.183/31
and
99.232.208.242
So the first two are invalid why? Because they contain '/xx' at the end?
If that's the case, simply delete from wp_pollsip where instr(poll_ip,'/') >0
0
 

Author Comment

by:ifred
ID: 37797666
The first two ones are invalid because these are not valid IP numbers, IP numbers are up to 255 in any octet.
0
 
LVL 33

Expert Comment

by:Norie
ID: 37797724
An IP can't have something like /24 at the end either.
0
 
LVL 35

Assisted Solution

by:Terry Woods
Terry Woods earned 300 total points
ID: 37798256
This picks up numbers greater than 255 or more than 3 digits:

select * from wp_pollsip where pollip_ip regexp '2[6-9][0-9]|25[6-9]|[3-9][0-9]{2}|[0-9]{4}'

(edit: fixed a bug)
0
 

Assisted Solution

by:ifred
ifred earned 0 total points
ID: 37823147
I have fixed this by running a query that looked for "/" in the ip field, as i noticed it was recording this. All the fields with the "/" turned out to be invalid.
0
 
LVL 31

Expert Comment

by:awking00
ID: 37823192
Does MySQL support a regex substring command?
0
 

Author Closing Comment

by:ifred
ID: 37845919
There was not enough good answers, and my main point was still the main reason i solved my problem.
0

Featured Post

IT, Stop Being Called Into Every Meeting

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

Join & Write a Comment

Suggested Solutions

If you find yourself in this situation “I have used SELECT DISTINCT but I’m getting duplicates” then I'm sorry to say you are using the wrong SQL technique as it only does one thing which is: produces whole rows that are unique. If the results you a…
Hello, In my precious Article  (http://www.experts-exchange.com/Database/Reporting/A_15280-Create-Project-in-Microstrategy-Part-I.html)we saw the Configuration part for Microstrategy which included Metadata Creation and DataSource Preparation as …
Excel styles will make formatting consistent and let you apply and change formatting faster. In this tutorial, you'll learn how to use Excel's built-in styles, how to modify styles, and how to create your own. You'll also learn how to use your custo…
Here's a very brief overview of the methods PRTG Network Monitor (https://www.paessler.com/prtg) offers for monitoring bandwidth, to help you decide which methods you´d like to investigate in more detail.  The methods are covered in more detail in o…

757 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

22 Experts available now in Live!

Get 1:1 Help Now