With the increasing importance of apps & networks in both business & personal interconnections, perfor. has become one of the key metrics of successful communication. This ebook is a hands-on business-case-driven guide to understanding MySQL query parameter tuning & database perf
Solved
merging two files using awk
Posted on 2000-02-25
Here's the problem.I have 2 files say file1 and file2.The format of the files are 10 segments(represent 1 customer information) repeating inself like
dus0101 customer number
dus0102 customer related information
dus0103 customer related information
... ...
... ...
dus0110 ...
dus0101 customer number
...
The customers in this 2 files are in asending order of customer account number.
Now i need to mearge these 2 files and create another file(say file3) depending on the customer number and the mearged file shud be in asending order of customer number.There might be same customer number in both files.If so skip that from file1 and write from file2 that customer to file3.The logic i can implement it as a c code but the requirement is to use shell script to arrive at this requirement.I can use awk script but i douth if nested awk can be used.Please let me know if you need anything else on this.Is there any other logic i can use
Thanks.
dus0101 customer number
dus0102 customer related information
dus0103 customer related information
... ...
... ...
dus0110 ...
dus0101 customer number
...
The customers in this 2 files are in asending order of customer account number.
Now i need to mearge these 2 files and create another file(say file3) depending on the customer number and the mearged file shud be in asending order of customer number.There might be same customer number in both files.If so skip that from file1 and write from file2 that customer to file3.The logic i can implement it as a c code but the requirement is to use shell script to arrive at this requirement.I can use awk script but i douth if nested awk can be used.Please let me know if you need anything else on this.Is there any other logic i can use
Thanks.
[X]
Welcome to Experts Exchange
Add your voice to the tech community where 5M+ people just like you are talking about what matters.
- Help others & share knowledge
- Earn cash & points
- Learn & ask questions
-
2
-
2
- +1
6 Comments
You could do it with a zsh script (maybe other shells too?)
create script (see below) then call it with 2 file inputs.
script.zsh 3<file1 4<file2 >outputfile
In the script use your logic from above.
Use
read -u 3 file1line
read -u 4 file2line
to get lines from the 2 files. Then use
cut to get the customer numbers. Use if to compare, then do 9 more reads and prints on whichever file has the lower number.
>>zsh script -- Gyles
Can you be more descriptive.I am not familiar with zsh.And i did not understand the logic u explained.
>>about using perl
Yea i can use perl and do it but i need to do it in shell programming.
Can you be more descriptive.I am not familiar with zsh.And i did not understand the logic u explained.
>>about using perl
Yea i can use perl and do it but i need to do it in shell programming.
zsh is really just like bash or sh. The reason I mention it is I know you can read from 2 files.
The following should give you the gist:
#!/bin/zsh
IFS=! # some unused character
read -u 3 file1line
read -u 4 file2line
file1custno = `echo $file1line |cut -d\ -f2-`
file2custno = `echo $file2line |cut -d\ -f2-`
if (file1custno -lt file2custno) then
echo $file1line
#copy next 2 lines 9 times:
read -u 3 file1line
echo $file1line
else
# do file2 instead
fi
All you then need to do is wrap this in a loop to go to the end of each file. You test for EOF by return code for read being non-zero. Once one file is at EOF just read from the other.
The following should give you the gist:
#!/bin/zsh
IFS=! # some unused character
read -u 3 file1line
read -u 4 file2line
file1custno = `echo $file1line |cut -d\ -f2-`
file2custno = `echo $file2line |cut -d\ -f2-`
if (file1custno -lt file2custno) then
echo $file1line
#copy next 2 lines 9 times:
read -u 3 file1line
echo $file1line
else
# do file2 instead
fi
All you then need to do is wrap this in a loop to go to the end of each file. You test for EOF by return code for read being non-zero. Once one file is at EOF just read from the other.
Featured Post
We value your feedback.
Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!
Question has a verified solution.
If you are experiencing a similar issue, please ask a related question
Introduction:
Dialogs (1) modal - maintaining the database.
Continuing from the ninth article about sudoku.
You might have heard of modal and modeless dialogs. Here with this Sudoku application will we use one of each type: a modal dialog …
In this post we will learn different types of Android Layout and some basics of an Android App.
This video will show you how to get GIT to work in Eclipse.
It will walk you through how to install the EGit plugin in eclipse and how to checkout an existing repository.
In this video, Percona Solution Engineer Rick Golba discuss how (and why) you implement high availability in a database environment.
To discuss how Percona Consulting can help with your design and architecture needs for your database and infrastr…
Suggested Courses
Course of the Month10 days, 17 hours left to enroll
718 members asked questions and received personalized solutions in the past 7 days.
Join the community of 500,000 technology professionals and ask your questions.