{"id":908,"date":"2022-07-21T09:25:08","date_gmt":"2022-07-21T09:25:08","guid":{"rendered":"https:\/\/test.thesmsworks.co.uk\/blog\/?p=908"},"modified":"2023-12-05T12:59:55","modified_gmt":"2023-12-05T12:59:55","slug":"unicode-sms","status":"publish","type":"post","link":"https:\/\/thesmsworks.co.uk\/blog\/unicode-sms\/","title":{"rendered":"A guide to unicode in SMS"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"908\" class=\"elementor elementor-908\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-562d4568 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"562d4568\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-431927e8\" data-id=\"431927e8\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-53d717ef elementor-widget elementor-widget-text-editor\" data-id=\"53d717ef\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\n<h1 class=\"wp-block-heading\">A guide to unicode in SMS<\/h1>\n<p>\u00a0<\/p>\n\n<p>Unicode is a character encoding system that allows you to send characters used in different languages.\u00a0<\/p>\n<p>If you use Unicode characters, your texts messages will be restricted to just 70 characters, not the standard 160.<\/p>\n<p>Mostly people use Unicode by mistake, by copying messages from Word or Sheets.<\/p>\n<p>The comma and apostrophe are the most common culprits. The standard and Unicode versions look almost identical. See below.<\/p>\n<h2 class=\"wp-block-heading\"><strong>What is unicode?<\/strong><\/h2>\n\n<p>Unicode was devised as a single encoding protocol that would solve the problem of hundreds of different code sets having evolved over time.<\/p>\n\n<p>Before unicode, encoding different characters was a complete mess with no standard that worked across all languages and platforms.<\/p>\n\n<p>If you wanted to display text consistently, you had to understand all the different encoding protocols that were in play. You had to deploy unwieldy programmes just to handle the interpretation of all the different encodings and the results were often inconsistent.<\/p>\n\n<p>The unicode protocol solved all these issues and has been hugely successful.<\/p>\n\n<p>Unicode allows all the characters used in every language to be encoded under one consistent character set.<\/p>\n\n<p>It also enables other characters to be encoded which allows the\u00a0<strong><a href=\"https:\/\/thesmsworks.co.uk\/emojis-sms\">sending of emojis in text messages<\/a><\/strong>.<\/p>\n\n<p>The\u00a0number\u00a0of emojis that can you\u00a0send increases as the Unicode Consortium\u00a0expands the range.<\/p>\n\n<figure class=\"wp-block-image size-full\"><img fetchpriority=\"high\" decoding=\"async\" width=\"570\" height=\"342\" class=\"wp-image-164\" src=\"http:\/\/test.thesmsworks.co.uk\/blog\/wp-content\/uploads\/2022\/06\/unicode-characters.png\" alt=\"A selection of unicode characters\" srcset=\"https:\/\/thesmsworks.wpenginepowered.com\/wp-content\/uploads\/2022\/06\/unicode-characters.png 570w, https:\/\/thesmsworks.wpenginepowered.com\/wp-content\/uploads\/2022\/06\/unicode-characters-300x180.png 300w\" sizes=\"(max-width: 570px) 100vw, 570px\" \/><\/figure>\n\n<h2 class=\"wp-block-heading\"><strong>The Unicode Consortium<\/strong><\/h2>\n\n<p><strong><a href=\"https:\/\/unicode.org\/consortium\/consort.html\">The unicode consortium<\/a><\/strong>\u00a0was established with the purpose of maintaining and publishing the unicode standard.<\/p>\n\n<p>It\u2019s a US based, not-for-profit whose stated aims are to\u00a0<\/p>\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p><em><strong>&#8230;enable\u00a0people around the world to use computers in any language, by providing freely-available specifications and data to form the foundation for software internationalization in all major operating systems, search engines, applications, and the World Wide Web.<\/strong><\/em><\/p>\n<p>\u00a0<\/p>\n<\/blockquote>\n\n<h2 class=\"wp-block-heading\"><strong>How do you send an SMS using unicode?<\/strong><\/h2>\n\n<p>Using the\u00a0<strong><a href=\"https:\/\/thesmsworks.co.uk\/\">sms api\u00a0<\/a><\/strong>from The SMS Works, you don\u2019t need to take any additional steps to identify non standard characters that are not part of the\u00a0<strong><a href=\"https:\/\/thesmsworks.co.uk\/GSM-character-set\">GSM character set<\/a><\/strong>.\u00a0<\/p>\n\n<p>If we identify non-standard characters or emojis we will automatically identify them and encode them as unicode.<\/p>\n\n<p>No further action is needed and <strong><a href=\"https:\/\/thesmsworks.co.uk\/blog\/sms-delivery-reports\/\">delivery reports<\/a><\/strong> will be generated in the same way.<\/p>\n\n<h2 class=\"wp-block-heading\"><strong>How many characters are used to send a text in unicode?<\/strong><\/h2>\n\n<p>If a text is sent using the standard GSM character set, then\u00a0<strong><a href=\"https:\/\/thesmsworks.co.uk\/maximum-length-sms-text-message\">160 characters is the maximum text length<\/a><\/strong>. If we identify that the message contains non-standard unicode characters, then the number of available characters is reduced to just 70.<\/p>\n\n<p>If you\u2019re planning to use emojis or other non-standard characters you\u2019ll need to be aware that your text will probably use more than one text credit so could cost double what you were expecting.<\/p>\n\n<h2 class=\"wp-block-heading\"><strong>How can I tell if my message contains non standard characters before sending a message?<\/strong><\/h2>\n\n<p>We\u2019ve developed a handy\u00a0<strong><a href=\"https:\/\/thesmsworks.co.uk\/unicode-detector\">unicode character detector.<\/a><\/strong><\/p>\n\n<p>Simply type or copy and paste your message in the window and any unicode characters will be highlighted.<\/p>\n\n<p>You\u2019ll then be able to delete the offending characters and test again to double check.<\/p>\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1024\" height=\"546\" class=\"wp-image-163\" src=\"http:\/\/test.thesmsworks.co.uk\/blog\/wp-content\/uploads\/2022\/06\/unicode-character-detector-1024x546.png\" alt=\"Unicode character detector tool\" srcset=\"https:\/\/thesmsworks.wpenginepowered.com\/wp-content\/uploads\/2022\/06\/unicode-character-detector-1024x546.png 1024w, https:\/\/thesmsworks.wpenginepowered.com\/wp-content\/uploads\/2022\/06\/unicode-character-detector-300x160.png 300w, https:\/\/thesmsworks.wpenginepowered.com\/wp-content\/uploads\/2022\/06\/unicode-character-detector-768x410.png 768w, https:\/\/thesmsworks.wpenginepowered.com\/wp-content\/uploads\/2022\/06\/unicode-character-detector.png 1434w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n<p>Do not copy and paste you text message from Word, Google docs or any other word processing system.<\/p>\n\n<p>It\u2019s tempting to use a standard word processing package to compose your texts, then simply copy and paste them into your application for sending.<\/p>\n\n<p>This is always a bad idea.<\/p>\n\n<p>The apostrophe and comma when copied, are actually in a rich text format which is barely noticeable.<\/p>\n\n<p>A rich text apostrophe has a curve to the left, whereas a GSM character set apostrophe is a more straight and down character. It&#8217;s a subtle difference.<\/p>\n\n<p>Here\u2019s a blow up version of both so you can easily see the difference.<\/p>\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"960\" height=\"540\" class=\"wp-image-161\" src=\"http:\/\/test.thesmsworks.co.uk\/blog\/wp-content\/uploads\/2022\/06\/comma-in-unicode-1.png\" alt=\"comma and apostrophe in unicode\" srcset=\"https:\/\/thesmsworks.wpenginepowered.com\/wp-content\/uploads\/2022\/06\/comma-in-unicode-1.png 960w, https:\/\/thesmsworks.wpenginepowered.com\/wp-content\/uploads\/2022\/06\/comma-in-unicode-1-300x169.png 300w, https:\/\/thesmsworks.wpenginepowered.com\/wp-content\/uploads\/2022\/06\/comma-in-unicode-1-768x432.png 768w\" sizes=\"(max-width: 960px) 100vw, 960px\" \/><\/figure>\n<h2>Unicode replacement tool<\/h2>\n<p>To help customers avoid using more SMS credits than intended, we have an <strong><a href=\"https:\/\/thesmsworks.co.uk\/blog\/unicode-character-replacement\/\">Unicode character replacement tool<\/a><\/strong>.<br \/><br \/>When this is activated in the customer&#8217;s account, the most common Unicode characters are replaced with the GSM equivalent.\u00a0<br \/><br \/>The tool is free to all customers and can help significantly reduce unintended overspend.<\/p>\n<p>Our <strong><a href=\"https:\/\/thesmsworks.co.uk\/blog\/sms-insights\/\">SMS analytics platform<\/a><\/strong> also helps identify how many texts are being sent with Unicode, so that action can be taken to remove Unicode from future texts.<\/p>\n\n<p><strong>Related articles<\/strong><\/p>\n\n<p><a href=\"https:\/\/thesmsworks.co.uk\/emojis-sms\"><strong>Sending emojis in texts<\/strong><\/a>\u00a0Is this a good idea? What do people think of emojis and do they cost more to send?<\/p>\n\n<p><strong><a href=\"https:\/\/thesmsworks.co.uk\/unicode-detector\">Unicode character detector<\/a>\u00a0<\/strong>Eliminate costly unicode characters from your texts with this simple tool.<\/p>\n\n<p><strong><a href=\"https:\/\/thesmsworks.co.uk\/maximum-length-sms-text-message\">What&#8217;s the maximum length of a text message?<\/a>\u00a0<\/strong>Just how long can a text be?<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>A guide to unicode in SMS \u00a0 Unicode is a character encoding system that allows you to send characters used [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":165,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"disabled","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[1],"tags":[],"class_list":["post-908","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/thesmsworks.co.uk\/blog\/wp-json\/wp\/v2\/posts\/908","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thesmsworks.co.uk\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thesmsworks.co.uk\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thesmsworks.co.uk\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/thesmsworks.co.uk\/blog\/wp-json\/wp\/v2\/comments?post=908"}],"version-history":[{"count":0,"href":"https:\/\/thesmsworks.co.uk\/blog\/wp-json\/wp\/v2\/posts\/908\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thesmsworks.co.uk\/blog\/wp-json\/wp\/v2\/media\/165"}],"wp:attachment":[{"href":"https:\/\/thesmsworks.co.uk\/blog\/wp-json\/wp\/v2\/media?parent=908"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thesmsworks.co.uk\/blog\/wp-json\/wp\/v2\/categories?post=908"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thesmsworks.co.uk\/blog\/wp-json\/wp\/v2\/tags?post=908"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}