Solved

how do you get these � Marks in your text?

Posted on 2016-09-25
9
74 Views
Last Modified: 2016-10-11
Hi There,
All over my news pages here http://www.bizgro.jobs/news/ you can see rouge glyphs like �
How on earth do they get there and how do I remove them without actually going through every single page and removing them?
Thanks in advance, A
0
Comment
Question by:Amanda Watson
9 Comments
 
LVL 83

Accepted Solution

by:
Dave Baldwin earned 250 total points
ID: 41815374
They indicate a mismatch in character sets.  Your page is set as UTF-8 but the articles are encoded as Western or Latin-1.  When I switch the encoding in Firefox to Western, those glyphs disappear.  Probably the most common reason for that is copying and pasting text that was generated in Word which uses Windows-1252 which is a Latin / Western character encoding.
0
 
LVL 35

Expert Comment

by:Terry Woods
ID: 41815394
There's a solution suggested here: http://wpfab.com/clean-up-weird-characters-in-your-wordpress-posts/

Back up your site first, or limit it to one post, just in case it does something unexpected.

UPDATE wp_posts SET post_content = REPLACE(post_content, '�', '');

Open in new window

0
 
LVL 11

Author Comment

by:Amanda Watson
ID: 41815411
Shall I enter that code into SQL in the database via phpmyAdmin?
0
 
LVL 37

Expert Comment

by:Geert Gruwez
ID: 41815416
this has nothing to do with Delphi
Tag removed
0
Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

 
LVL 11

Author Comment

by:Amanda Watson
ID: 41815421
Well I ran the query and 0 rows were affected so they remain?
Now what, any ideas?
0
 
LVL 48

Expert Comment

by:PortletPaul
ID: 41815521
It may not be as simple as a single update query in the database. There seem to be several reasons for those glyphs including quotes, hyphens, apostrophes and possibly more than just those.

Here is an example (but for some parts I am guessing)
(as is)
�Marketing is telling the truth attractively� � as heard from Peter Daniels. To me, 
marketing is opening yourself up to the world – which is risky � and being proud of what you
 can give and serve others with. I also believe that if a business is not marketing it will have 
poor customer service. We should always be willing to give with no expectation of a return. 
That doesn�t mean we should never ask for remuneration for our goods and services. It just
 means that we have enough of our own self-esteem that we don�t need outward 
affirmation (paid or unpaid) that we have given enough.

Open in new window


(to be)
"Marketing is telling the truth attractively" as heard from Peter Daniels.

To me, marketing is opening yourself up to the world – which is risky -  and being proud of what you can give and serve others with. I also believe that if a business is not marketing it will have poor customer service. We should always be willing to give with no expectation of a return. That doesn't mean we should never ask for remuneration for our goods and services. It just means that we have enough of our own self-esteem that we don't need outward affirmation (paid or unpaid) that we have given enough.

In that example some of the glyphs relate to possible quotation marks or perhaps bullets while others relate to hyphenation or apostrophes.

Most likely is that someone is using a WYSIWYG editor (such as Word) and pasting into into the Wordpress text boxes assuming all formatting is universal (which is not true).

That practice will have to stop if you are to solve this from happening again and again.
2
 
LVL 16

Assisted Solution

by:DansDadUK
DansDadUK earned 250 total points
ID: 41815883
I agree with the analysis of the problem by previous responders, indicating that the most likely cause is "... a mismatch in character sets ..." and "... glyphs relate to possible quotation marks or perhaps bullets while others relate to hyphenation or apostrophes ...".

The ISO-8859-1 Latin-1 character set is an exact subset of the Unicode character set.

But the Windows Latin-1 (CP1252) character set (which is a 'superset' of ISO-8859-1) is not an exact subset of Unicode.

In ISO-8859-1 (and Unicode), the code-point range 0x80 -> 0x9F is reserved for the (little-used) non-graphic C1 control-code characters.

But the (frequently used) Windows Latin-1 (CP1252) character set uses this range to define various additional graphic characters, including 'smart quotes', and 'dot' and 'dash' characters:

C1 range in CP1252
So (as others have said) if text, encoded using this character set includes such characters, is pasted directly into a page which is expecting the character set to be the UTF-8 encoding of Unicode, then these characters will map to the Unicode "REPLACEMENT CHARACTER", used to replace an unknown or unrepresentable character.
0
 
LVL 11

Author Comment

by:Amanda Watson
ID: 41816987
Thanks for the explanation.   Any idea how to remove them easily as per the question?
0
 
LVL 48

Expert Comment

by:PortletPaul
ID: 41817035
As I attempted to demonstrate, it probably isn't as simple as a single update query.

I suggest you try manual correction on one or two, and you will then understand that if you replace all those glyphs with a single character you will still have a large problem to solve. Perhaps worse than before by the way as it will be harder to identify.

Sorry.
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Do you think that WordPress is just for blogs?  Think again!  WordPress is really a fantastic all around platform that you can use to develop websites on.  Integrated into its basic functionality is the ability to create pages using your choice of a…
In Part I (http://www.experts-exchange.com/Web_Development/Blogs/WordPress/A_8410-Getting-Started-In-WordPress-Part-I.html), I introduced you to the powerful WordPress backend, the WordPress administrative Dashboard.  In Part II, I will introduce yo…
The purpose of this video is to demonstrate how to Test the speed of a WordPress Website. Site Speed is an important metric of a site’s health. Slow site speed can result in viewers leaving your site quickly and not seeing your content. This…
The purpose of this video is to demonstrate how to update a WordPress Site’s version. WordPress releases new versions of its software frequently and it is important to update frequently in order to keep your site secure, and to get new WordPress…

920 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

16 Experts available now in Live!

Get 1:1 Help Now