Shell Script to Search for ID in log file, skip searched files in next search

Hi Experts,

I need your help to create a shell script.

Below requirement lines may have repeated lines, please excuse me for that. It may be because I have tried to explain what ever first came in my mind.

Requirement is:

Search for data using parent ID from old.log log files which has sequence appended to it as suffix when it gets created.
Each old.log gets created with incremental sequence number after a perticular size has been reached like a log rotate.
I have to search through each old.log file for some data and capture it in Oracle database.

For example, lot of lines will have parent ID and same parent ID can also occur in next old.log sequenced file with an incremental suffix.
Once I searched for parent ID in a file and collected all it's data, I have to parse that data and insert in database.
Parsing meaning, I have to capture few field data like CHILDId, StartTime, FinishTime etc.

The challenge is, parent ID can be in next file too with it's relevant data so I have to search for parent ID in many files.
Data could be scattered all over log files, mostly once parent ID started the same parent ID would be in next log file and not in old log files. If parent ID started in old.log.12111 file then it can continue in next old.log.12112 log file.
old.log files be created every few minutes so script will have to remember which files it searched and skip them next time search.
I do not want to search through same log file next time, but I have to search parent ID in multiple log files to make sure I am not missing any data.
There will be multiple parent ID's in every log file, can be identied by line "PARENT", in below example parent ID is 1849312.
I want to run this script every one hour.

Below is ls -l output.

-rw-rw-r-- 1 user user1 121611 Apr  1 14:48 old.log.12111
-rw-rw-r-- 1 user user1 139872 Apr  1 14:48 old.log.12112
-rw-rw-r-- 1 user user1 147591 Apr  1 14:48 old.log.12113

Sample data from old.log after a grep

[user@server directory]$ grep 1849312 old.log.12111
"PARENT" "user" "1522849159" "1849312:user:NAME" "Triggered PARENT" " "
"PARENTDEF" "user" "1522849159" "user:NAME" "Instantiated PARENT definition" "PARENTId=1849312|PARENTUser=user"
"PARENT" "user" "1522849159" "1849312:user:NAME" "Start PARENT" " "
"CHILD" "user" "1522849159" "1849312:user:NAME:common_name" "Start CHILD" " "
"CHILD" "user" "1522849165" "1849312:user:NAME:common_name" "Started CHILD" "CHILDId=394330"
"CHILD" "user" "1522849165" "1849312:user:NAME:common_name" "Execute CHILD" "CHILDId=394330|Host=hostname"
"CHILD" "user" "1522849165" "1849312:user:NAME:common_name" "Finished CHILD" "CHILDId=394330|State=Exit|Status=5|StartTime=1522849165|FinishTime=1522849165|CPUUsage=0.890900 sec"
"PARENT" "user" "1522849165" "1849312:user:NAME" "Finished PARENT" "State=Exit|Status=5|StartTime=1522849159|FinishTime=1522849165"
[user@server directory]$

Below is script I came up with which needs modification with your expert help.

------------------

#!/bin/bash

touch parent1.txt

# Skip files searched earlier through parent1.txt
file=$(ls -l old.log.* | grep -v -f parent1.txt | awk '{print $9}')

# Check if variable has file names if empty dont do any thing
if [ -z "$file" ]

then

echo "Var is empty"

else

# Read each file for parent ID in current directory
grep "Start parent" $file | awk '{print $4}' | sed 's/"//' | sed 's/:.*//' | while read par

# Search for parent ID in each file
do grep $par $file

# Log all grep results in a file for later processing
done >output.txt

# Get all file names in a file to skip them next time for search
ls -l old.log.* | awk '{print $9}' >> parent.txt

# Get only uniq file names, all files will be uniq because of sequence suffix
cat parent.txt | sort | uniq > parent1.txt

# To get suffix
parent_id=$(tail -1 parent1.txt | sed 's/old.log.//')
# To get prefix file name
old_new="old.log."
# Experimental, thought of incrementing suffice and use it as next file to search, but not sure if I have to do that
new_file=$(($parent_id+1))
# Experimental, to get next file names
old_new_file=$($old_new$new_file)
echo $new_file

fi

Select allOpen in new window

------------------

Thanks in Advance!