<div>
This is a complicated area of work, and you may find that there is a lot to know in order to make this come out right. &nbsp;I've researched it and run it to ground for both PHP and MySQL. &nbsp;If PostGreSQL is using UTF8 and the issue is that the client input is incompatible with UTF8, this article will lead you in the right direction.<br />
<a href="https://www.experts-exchange.com/Web_Development/Web_Languages-Standards/PHP/A_11880-Unicode-PHP-and-Character-Collisions.html" rel="ugc">https://www.experts-exchange.com/Web_Development/Web_Languages-Standards/PHP/A_11880-Unicode-PHP-and-Character-Collisions.html</a>
</div>


<div>
Hi Ray,<br />
<br />
Nice article. &nbsp;It does not help me. &nbsp;Let me provide an example.<br />
<br />
$q = &quot;inset into t1 (f1,f2,f3) values ('v1','v2','v3');&quot;;<br />
$pg_exec($q);<br />
<br />
Where database is PostgreSQL and has utf-8 encoding, v1 encoding is utf-8, v2 encoding is iso5589-1, and v3 encoding is win1255.<br />
<br />
Error message: &nbsp;&quot;invalid byte sequence for encoding &quot;UTF8&quot;.<br />
<br />
I need something like:<br />
$q = convert_to_utf8_ignoring_a<wbr />lready_utf<wbr />8($q);<br />
$pg_exec($q);<br />
<br />
Update successfully.<br />
<br />
<br />
I need something like:<br />
function convert_to_utf8_ignoring_a<wbr />lready_utf<wbr />8 ($s) {<br />
&nbsp; $new_s = do some magic with $s. &nbsp;break it apart, put it together, ignore utf-8. &nbsp;Make all of $s utf-8.<br />
&nbsp; return $new_s;<br />
}<br />
<br />
<br />
Thanks.
</div>


<div>
There is this function utf8_encode <a href="http://php.net/function.utf8-encode" rel="ugc">http://php.net/function.utf8-encode</a>&nbsp;but it does not 'automatically' recognize UTF-8 strings. &nbsp;You have to know what you are feeding it.
</div>


<div>
Hi Dave. &nbsp;This does not help. Thanks anyhow.
</div>


<div>
The perfect solution will be a function that breaks down the PostgreSQL query and go over each input fields/values and convert to UTF-8. &nbsp;Oh well. &nbsp;Thanks anyhow.
</div>


<div>
<div class="content wysiwyg-content">
I have user input/EDI that may be in different encoding (ISO, Win, etc.). &nbsp;When I insert it into the database PostgreSQL complain &quot;invalid byte sequence for encoding &quot;UTF8&quot;.<br />
<br />
PostgreSQL DB encoding is UTF-8.<br />
<br />
I cannot control the user input/EDI. &nbsp;The SQL query actually has mixed encoding, including UTF-8.<br />
<br />
Is there a way to convert the none UTF-8 strings/chars to UTF-8 and ignore the strings/chars that are already UTF-8?<br />
<br />
Thanks.
</div>
</div>


I have user input/EDI that may be in different encoding (ISO, Win, etc.).  When I insert it into the database PostgreSQL complain "invalid byte sequence for encoding "UTF8".

PostgreSQL DB encoding is UTF-8.

I cannot control the user input/EDI.  The SQL query actually has mixed encoding, including UTF-8.

Is there a way to convert the none UTF-8 strings/chars to UTF-8 and ignore the strings/chars that are already UTF-8?

Thanks.

php postgresql convert mixed encoding to utf-8

PHP is a widely-used server-side scripting language especially suited for web development, powering tens of millions of sites from Facebook to personal WordPress blogs. PHP is often paired with the MySQL relational database, but includes support for most other mainstream databases. By utilizing different Server APIs, PHP can work on many different web servers as a server-side scripting language.

PostgreSQL is an object-relational database management system with an emphasis on extensibility and standards-compliance. As a database server, its primary function is to store data securely, supporting best practices, and to allow for retrieval at the request of other software applications. PostgreSQL implements the majority of the SQL2011 standard, is ACID-compliant and transactional using multiversion concurrency control (MVCC), and handles complex SQL queries using many indexing methods that are not available in other databases. It is cross-platform and runs on many operating systems including Linux, FreeBSD, OS X, Solaris, and Microsoft Windows.