We help IT Professionals succeed at work.
Get Started

How to use PERL to ¨follow" output of syslog, convert to CSV then input to MySQL in real time

rleyba828 asked
Last Modified: 2012-05-09
Hi Team,

 I just need some help on a PIPING problem where I need to capture the output of a syslog file then input this to mysql.  The issues is actually composed of 3 parts.

1. tail -F syslog     --> this captures the lines appended to syslog in real time.

2. https://www.experts-exchange.com/Programming/Languages/Scripting/Perl/Q_26218088.html
    This converts a normal syslog file into CSV format as very graciously supplied by one of the experts exchange members.

3.   load data local infile 'syslog.csv' into table test.syslog fields terminated by ',' enclosed by '"' lines terminated by '\n' (month,day,time,host,message);

     This one appends a normal syslog.csv file into a MySQL database.   However it has to be executed from within the MYSQL prompt and not from the linux shell.

I just need help on how to revise the steps above so they can be contracted I suppose in one simple script that captures live syslog output, convert to csv and append to Mysql.

Thanks in advance for any suggestions offered.

Watch Question
This problem has been solved!
Unlock 1 Answer and 4 Comments.
See Answer
Why Experts Exchange?

Experts Exchange always has the answer, or at the least points me in the correct direction! It is like having another employee that is extremely experienced.

Jim Murphy
Programmer at Smart IT Solutions

When asked, what has been your best career decision?

Deciding to stick with EE.

Mohamed Asif
Technical Department Head

Being involved with EE helped me to grow personally and professionally.

Carl Webster
CTP, Sr Infrastructure Consultant
Ask ANY Question

Connect with Certified Experts to gain insight and support on specific technology challenges including:

  • Troubleshooting
  • Research
  • Professional Opinions
Did You Know?

We've partnered with two important charities to provide clean water and computer science education to those who need it most. READ MORE