trevor1940

<div>
<blockquote>
 Assuming the data is Unicode
</blockquote>
<br />
Yes the docs state Unicode UTF8<br />
<br />
<br />
Strawberry<br />
<br />

<pre><code id="code-20-42673194-1">perl -v

perl 5 version 20 (v5.20.2) for WIN32 -x64-multi-thread</code></pre>
<br />
There is so much information regarding perl and charsets I'm now confused<br />
<br />
Any suggestions how to test if a script is corrupting the text?<br />
bearing in mind i'm running in a windows command prompt which is rubbish at displaying extended characters
</div>


> Assuming the data is Unicode


Yes the docs state Unicode UTF8


Strawberry



perl -v

perl 5 version 20 (v5.20.2) for WIN32 -x64-multi-thread


There is so much information regarding perl and charsets I'm now confused

Any suggestions how to test if a script is corrupting the text?
bearing in mind i'm running in a windows command prompt which is rubbish at displaying extended characters

<div>
<div class="content wysiwyg-content">
I'm trying to ingest a large text file into PostgreSQL <a href="https://www.experts-exchange.com/questions/29116523/PostgreSQL-Copy-from-File-missing-data-error.html" rel="ugc nofollow">Full details here </a><br />
<br />
I may need to run &nbsp;a script against the file to either remove the problem rows into a separate file, or insert into the database via DBI and was wondering how perl handles diacritics?<br />
<br />
I'm sure perls native I/O file handle is UTF8 but not certain about the diacritics or non roman characters
</div>
</div>


I'm trying to ingest a large text file into PostgreSQL Full details here  (https://www.experts-exchange.com/questions/29116523/PostgreSQL-Copy-from-File-missing-data-error.html)

I may need to run  a script against the file to either remove the problem rows into a separate file, or insert into the database via DBI and was wondering how perl handles diacritics?

I'm sure perls native I/O file handle is UTF8 but not certain about the diacritics or non roman characters

perl: How dose perl handle  diacritics and non roman characters

Perl is a high-level, general-purpose, interpreted, dynamic programming languages with over 25 years of development. Perl 5 runs on over 100 platforms from portables to mainframes and is suitable for both rapid prototyping and large-scale development projects.  Perl gained widespread popularity as a Common Gateway Interface (CGI) scripting language, in part due to its regular expression and string parsing abilities. In addition to CGI, Perl is used for graphics programming, system administration, network programming, finance, bioinformatics, and other applications.