Solved

how do you get these � Marks in your text?

Posted on 2016-09-25
9
115 Views
Last Modified: 2016-10-11
Hi There,
All over my news pages here http://www.bizgro.jobs/news/ you can see rouge glyphs like �
How on earth do they get there and how do I remove them without actually going through every single page and removing them?
Thanks in advance, A
0
Comment
Question by:Amanda Watson
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
9 Comments
 
LVL 83

Accepted Solution

by:
Dave Baldwin earned 250 total points
ID: 41815374
They indicate a mismatch in character sets.  Your page is set as UTF-8 but the articles are encoded as Western or Latin-1.  When I switch the encoding in Firefox to Western, those glyphs disappear.  Probably the most common reason for that is copying and pasting text that was generated in Word which uses Windows-1252 which is a Latin / Western character encoding.
0
 
LVL 35

Expert Comment

by:Terry Woods
ID: 41815394
There's a solution suggested here: http://wpfab.com/clean-up-weird-characters-in-your-wordpress-posts/

Back up your site first, or limit it to one post, just in case it does something unexpected.

UPDATE wp_posts SET post_content = REPLACE(post_content, '�', '');

Open in new window

0
 
LVL 11

Author Comment

by:Amanda Watson
ID: 41815411
Shall I enter that code into SQL in the database via phpmyAdmin?
0
Technology Partners: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

 
LVL 37

Expert Comment

by:Geert Gruwez
ID: 41815416
this has nothing to do with Delphi
Tag removed
0
 
LVL 11

Author Comment

by:Amanda Watson
ID: 41815421
Well I ran the query and 0 rows were affected so they remain?
Now what, any ideas?
0
 
LVL 48

Expert Comment

by:PortletPaul
ID: 41815521
It may not be as simple as a single update query in the database. There seem to be several reasons for those glyphs including quotes, hyphens, apostrophes and possibly more than just those.

Here is an example (but for some parts I am guessing)
(as is)
�Marketing is telling the truth attractively� � as heard from Peter Daniels. To me, 
marketing is opening yourself up to the world – which is risky � and being proud of what you
 can give and serve others with. I also believe that if a business is not marketing it will have 
poor customer service. We should always be willing to give with no expectation of a return. 
That doesn�t mean we should never ask for remuneration for our goods and services. It just
 means that we have enough of our own self-esteem that we don�t need outward 
affirmation (paid or unpaid) that we have given enough.

Open in new window


(to be)
"Marketing is telling the truth attractively" as heard from Peter Daniels.

To me, marketing is opening yourself up to the world – which is risky -  and being proud of what you can give and serve others with. I also believe that if a business is not marketing it will have poor customer service. We should always be willing to give with no expectation of a return. That doesn't mean we should never ask for remuneration for our goods and services. It just means that we have enough of our own self-esteem that we don't need outward affirmation (paid or unpaid) that we have given enough.

In that example some of the glyphs relate to possible quotation marks or perhaps bullets while others relate to hyphenation or apostrophes.

Most likely is that someone is using a WYSIWYG editor (such as Word) and pasting into into the Wordpress text boxes assuming all formatting is universal (which is not true).

That practice will have to stop if you are to solve this from happening again and again.
2
 
LVL 16

Assisted Solution

by:DansDadUK
DansDadUK earned 250 total points
ID: 41815883
I agree with the analysis of the problem by previous responders, indicating that the most likely cause is "... a mismatch in character sets ..." and "... glyphs relate to possible quotation marks or perhaps bullets while others relate to hyphenation or apostrophes ...".

The ISO-8859-1 Latin-1 character set is an exact subset of the Unicode character set.

But the Windows Latin-1 (CP1252) character set (which is a 'superset' of ISO-8859-1) is not an exact subset of Unicode.

In ISO-8859-1 (and Unicode), the code-point range 0x80 -> 0x9F is reserved for the (little-used) non-graphic C1 control-code characters.

But the (frequently used) Windows Latin-1 (CP1252) character set uses this range to define various additional graphic characters, including 'smart quotes', and 'dot' and 'dash' characters:

C1 range in CP1252
So (as others have said) if text, encoded using this character set includes such characters, is pasted directly into a page which is expecting the character set to be the UTF-8 encoding of Unicode, then these characters will map to the Unicode "REPLACEMENT CHARACTER", used to replace an unknown or unrepresentable character.
0
 
LVL 11

Author Comment

by:Amanda Watson
ID: 41816987
Thanks for the explanation.   Any idea how to remove them easily as per the question?
0
 
LVL 48

Expert Comment

by:PortletPaul
ID: 41817035
As I attempted to demonstrate, it probably isn't as simple as a single update query.

I suggest you try manual correction on one or two, and you will then understand that if you replace all those glyphs with a single character you will still have a large problem to solve. Perhaps worse than before by the way as it will be harder to identify.

Sorry.
0

Featured Post

Why Off-Site Backups Are The Only Way To Go

You are probably backing up your data—but how and where? Ransomware is on the rise and there are variants that specifically target backups. Read on to discover why off-site is the way to go.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
PHP AJAX JSON 2 101
AJAX pass along a variable 3 83
How to remove a section of the main menu from Magento 1.9.3 3 69
Modify Filter to cause a field to be not Required 3 51
Like there are many different versions of Wordpress, there are also a handful of related side projects WordPress users should be familiar with.   All of these projects are open source and GPL licensed, which means there are few restrictions to us…
Transferring a wordpress site from a host or local dev server to another host can be a pain. So I've included my steps on how I have accomplished this task. Steps include an assumption that you have Cpanel access or Ftp access.. If you do not hav…
The purpose of this video is to demonstrate how to manually back up a WordPress Database. This will be demonstrated using a Windows 8 PC. The Host used will be IPage.com Log into your Hosting account. IPage will be used for demonstration : Locat…
The purpose of this video is to demonstrate how to Import and export files in WordPress. This will be demonstrated using a Windows 8 PC. Go to your WordPress login page. This will look like the following: mywebsite.com/wp-login.php : Click on Too…
Suggested Courses

739 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question