Solved

Removing Duplicate words from lines in a power shell

Posted on 2015-02-23
5
81 Views
Last Modified: 2015-02-24
Hi

I am trying to find away to remove Duplicate words from a text file using Powershell

   
Name1 PC1234 PC1234 start Tue 2/17 6:53
Name2 PC5678 PC5678 start Tue 2/17 7:51

What I would like is


Name1 PC1234 start Tue 2/17 6:53
Name2 PC5678 start Tue 2/17 7:51

I have managed to get it working using the following but I would like to be able to open a .txt file remove the duplicate on all lines and right the content back to a new file.

$text= "Name1 PC1234 PC1234 start Tue 2/17 6:53"
$text.Length
$text.remove(14)

Open in new window


Thank you of your help
0
Comment
Question by:Si Walton
5 Comments
 
LVL 53

Expert Comment

by:Will Szymkowski
ID: 40626292
Might not be a solution that your looking for, but the easiest way to accomplish this is in Excel and using the remove duplicate button.

Will.
0
 
LVL 83

Accepted Solution

by:
oBdA earned 250 total points
ID: 40626329
So the third column is always a copy of the second?
This will remove the third column:
Get-Content C:\Temp\in.txt | % {$_.Split(" ")[0..1+3..($_.Length -1)] -join " "} | Set-Content C:\Temp\out.txt

Open in new window

0
 
LVL 1

Author Comment

by:Si Walton
ID: 40627722
Hi oBda

Almost there and I understand the $_.Split

How would I be able to get the code to ignore the 1st line in the text file.


Keep this text
Name1 PC1234 PC1234 start Tue 2/17 6:53
Name2 PC5678 PC5678 start Tue 2/17 7:51

Thank you

Si
0
 
LVL 68

Assisted Solution

by:Qlemo
Qlemo earned 250 total points
ID: 40627914
$(
Get-Content C:\Temp\in.txt | select -First 1
Get-Content C:\Temp\in.txt | select -Skip 1 | % {$_.Split(" ")[0..1+3..($_.Length -1)] -join " "}
) | Set-Content C:\Temp\out.txt

Open in new window

0
 
LVL 1

Author Closing Comment

by:Si Walton
ID: 40627936
Hi oBda and Qlemo

Thank you the solutions worked perfectly

Si
0

Featured Post

How your wiki can always stay up-to-date

Quip doubles as a “living” wiki and a project management tool that evolves with your organization. As you finish projects in Quip, the work remains, easily accessible to all team members, new and old.
- Increase transparency
- Onboard new hires faster
- Access from mobile/offline

Join & Write a Comment

In this previous article (https://oddytee.wordpress.com/2016/05/05/provision-new-office-365-user-and-mailbox-from-exchange-hybrid-via-powershell/), we made basic license assignments to users in O365. When I say basic, the method is the simplest way …
Synchronize a new Active Directory domain with an existing Office 365 tenant
Polish reports in Access so they look terrific. Take yourself to another level. Equations, Back Color, Alternate Back Color. Write easy VBA Code. Tighten space to use less pages. Launch report from a menu, considering criteria only when it is filled…
When you create an app prototype with Adobe XD, you can insert system screens -- sharing or Control Center, for example -- with just a few clicks. This video shows you how. You can take the full course on Experts Exchange at http://bit.ly/XDcourse.

744 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now