Solved

How to add records to a vairable in powershell 3 that is loaded from invoke-sql or import-csv

Posted on 2013-12-12
2
360 Views
Last Modified: 2013-12-12
Example:
$CSV = Invoke-Sqlcmd -Query $Query
I'm using Powershell version 4, so the solution should be done with version 3 or 4.

In this example $CSV.count would return 4,567 records. Same issue happens with import-csv and invoke-sql.

I then have to massage the data. I must ADD a duplicate record to the end of $CSV for each record that contains more than 1 filename in the $CSV.FileList field.

CSV$[102].FileList might equal "00310508.tif 00310509.tif 00310510.tif 00310511.tif 00310512.tif 00310513.tif" and I would then have to duplicate this row of data for each filename in the FileList field. The requirement is to have one filename per record in $CSV.

I've found a few ideas on the Internet, but they cause massive memory corruption and so I figure the additional records added to $CSV are simply added and no memory allocation is done to hold the added data.
So, nothing I have found has worked, except to export $CSV to a file, open it in Excel, and add several thousand records to the end of the file (just copied the last record and pasted it repeatedly), and then import the file remembering the original $CSV.count and re-using the newly added records as placeholders and then changing $CSV.count to equal $CSV.count+$new_record_count  and finally exporting it to a file.

Do you know of a way that I can duplicate the last record of $CSV a thousand times using Powershell?
Is there was a way to append records to $CSV and not have memory corruption? Like I said, I need to duplicate the current record that I am processing for each filename in $CSV.FileList.

THANKS!!!!
0
Comment
Question by:johnj_01201
  • 2
2 Comments
 
LVL 1

Accepted Solution

by:
johnj_01201 earned 0 total points
ID: 39714186
Solved. I'm still learning powershell. I was under the impression that a variable assigned to a command like $CSV=invoke-sql or $CSV=import-csv were "special", but it turns out they are like normal string variables in BASIC.
I was able to do this:
$CSV=$CSV+$CSV
to double the size of the original and now I can easily do what I need to.
Additionally, I can simply take the record that needs duplicated and do this:
$CSV=$CSV+$NewRecord
AMAZING!!!
Even the $CSV.count increases like it is supposed to!!!
Thanks Anyways!
0
 
LVL 1

Author Closing Comment

by:johnj_01201
ID: 39714188
Simple and perfect solution as I only wanted to work in powershell and not appending to the actual file. I bet this would solve many of the same issues others are having trying to append to an file instead of thinking about how to do it in memory.
0

Featured Post

Are your AD admin tools letting you down?

Managing Active Directory can get complicated.  Often, the native tools for managing AD are just not up to the task.  The largest Active Directory installations in the world have relied on one tool to manage their day-to-day administration tasks: Hyena. Start your trial today.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

I thought I'd write this up for anyone who has a request to create an anonymous whistle-blower-type submission form created using SharePoint 2010 (this would probably work the same for 2013). It's not 100% fool-proof but it's as close as you can get…
Create and license users in Office 365 in bulk based on a CSV file. A step-by-step guide with PowerShell script examples.
In a recent question (https://www.experts-exchange.com/questions/28997919/Pagination-in-Adobe-Acrobat.html) here at Experts Exchange, a member asked how to add page numbers to a PDF file using Adobe Acrobat XI Pro. This short video Micro Tutorial sh…
Established in 1997, Technology Architects has become one of the most reputable technology solutions companies in the country. TA have been providing businesses with cost effective state-of-the-art solutions and unparalleled service that is designed…

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question