Unicode is a computing industry standard for the consistent encoding, representation and handling of text expressed in most of the world's writing systems.

learn more… | top users | synonyms (2)

3
votes
2answers
32 views

Problem with reading text file encoded in Western encoding (ISO-8859-1)

I'm having a problem with encoding of ISO-8859-1 text file (subtitles in Polish language), which looks something like that: Mieszka³ sam,|¿adnej ¿ony, dzieci. It should be : "Mieszkał sam, żadnej ...
0
votes
0answers
13 views

View mac shared folder from linux (mint/ubuntu)

When i open shared folder hosted on mac (local network). All folder name's display like this: –ü–∞–ø–∫–∞ ¬´–û–±—â–∏–µ¬ª Mac has internal encoding (MAC) Linux has UTF-8 ╰─$ locale LANG=en_US....
2
votes
0answers
51 views

Unicode issue when ssh'ing from GNOME Terminal to OS X

When I ssh from GNOME Terminal (tried different 14.04/16.04 distros, currently on Mint 18) to OS X, I have a unicode issue, e.g. the prompt is not properly displayed. On OS X, I have bash 4.x as a ...
16
votes
5answers
2k views

How can I convert Persian numerals in UTF-8 to European numerals in ASCII?

In Persian numerals, ۰۱۲۳۴۵۶۷۸۹ is equivalent to 0123456789 in European digits. How can I convert Persian number (in UTF-8) to ASCII? For example, I want ۲۱ to become 21.
0
votes
0answers
18 views

How to force rsyslog ommysql use UTF8?

I'm using ommysql in rsyslog for transferring data into MySQL $ModLoad ommysql local6.* :ommysql:localhost,Syslog,rsyslog,1 but Cyrillic data goes like "·Ð¾Ð²Ð°Ð½Ð¸Ðµ иÑ�точнÐ" in ...
1
vote
0answers
21 views

Change existing dovecot maildir installation from m-UTF7 charset to UTF8 to avoid breaking TAB

In an existing dovecot installation with many pre-existing folders using regional characters I would like to change m-UTF7 (.&AMk-l&AOk-ments envoy&AOk-s) foldernames to UTF8 (.Éléments ...
5
votes
1answer
110 views

Can a script determine which characters a terminal can display?

I'm working on a script that displays UTF-8 characters as output. In my Gnome Terminal, this prints out a pretty maple leaf (🍁): $ echo -e '\xF0\x9F\x8D\x81' In rxvt, it prints out a box (the ...
4
votes
1answer
91 views

XTerm doesn't display *some* unicode characters properly?

I don't have a general problem with XTerm and Unicode. For the most part, things are working. This works great: $ echo "¿dónde está la llama?" ¿dónde está la llama? As does this: $ echo -e "\xE2\...
4
votes
2answers
141 views

How do I type arbitrary unicode characters in xterm?

Moving away from using gnome-terminal and terminator since they are excruciatingly slow. (20-30 seconds to change focus to them for whatever reason) xterm is nice and fast. However, I need to be able ...
4
votes
3answers
1k views

Updated my arch linux server and now I get tmux: need UTF-8 locale (LC_CTYPE) but have ANSI_X3.4-1968

I recently updated my Arch Linux server and during that process tmux got updated. I was using tmux while the upgrade was going on and used it afterwards, but all during the same SSH session. Now, ...
0
votes
1answer
63 views

Debian Jessie with Xfce: cannot change locale (LANG) after installing new locale

I am running Debian Jessie with xfce. I used to have the system in English (en_US.utf8 as LANG since I installed debian only with English). Lately, I installed new locales and even if I made sure I ...
0
votes
1answer
87 views

problem editing utf8 text file with vim

I have a problem editing a html file on a server via vim. The file is utf-8 encoded. While editing with vim (v7.3, no plugins active) I can see umlauts and editing and saving a line before the umlaut ...
0
votes
0answers
43 views

Special characters are not recognized even with UTF-8 in KDE

So, I have Manjaro KDE pre 16 and I have some character encoding issues. Characters like ã á and such are not recognised and are represented by the ? sign. And all programs seem to use this encoding ...
0
votes
0answers
52 views

can't run any python 2 programs due to encoding error

After a system update, I'm not able to run any python 2 program. I get the error. UnicodeDecodeError: 'utf8' codec can't decode byte 0xf6 in position 203: invalid start byte python3 says it uses ...
1
vote
1answer
43 views

Linux console can't display any language other than English while the terminal under Gnome can

I'm still new to Linux and Unix-like systems and I've tried to search on the internet about my issue. Unfortunately I don't get a feasible answer right now. My problem is that the console(tty) on my ...
-1
votes
3answers
112 views

Why am I getting an error “print_unicode: line 9: printf: missing unicode digit for \u Unicode 0187” with this script

I have written them following shell script to view what the Unicode characters look like on my terminal. #!/bin/bash X=0 while [ $X -lt 65536 ]; do HEX=`bc <<< "obase=16; $X"` HEX="...
1
vote
1answer
39 views

GraphViz: how to get UTF-8 AND external PostScript procedures?

Goal: draw a flowchart which contains non-Latin1 symbols. Problem: GraphViz does not provide all node shapes necessary for drawing a flowchart (e.g. "Document", "Predefined Process" etc). Fortunately,...
1
vote
2answers
165 views

Unable to use correctly Powerline with xterm

I am trying to set up Powerline in my xterm. Im running ArchLinux. I have followed the steps from here and I am at this point here: So basicaly it works but I just cannot make the arrows appear. This ...
2
votes
1answer
97 views

Why is this find command not returning filenames containing non-ASCII characters only?

I'm trying to determine the root cause of why this find command is not working; it shouldn't match the file called this_should_not_match below: $ > find . -type f -name "*[^ -~]*" ./__º╚t ./...
0
votes
1answer
31 views

Glyphs are displayed as “brackets” ( [] )

So I've installed FontAwesome from the official Debian (jessie) packages (fonts-font-awesome) and using a command such as echo -e "\uf26b" will display me a bracket (or like pasting it into ...
1
vote
2answers
27 views

How can I paginate a UTF-8 file and see the right characters?

If I use cat on a file containing UTF-8, it displays properly: % cat /tmp/sample <concept code="endangeredLanguage"> <description value="The language is endangered at the given date"@en/&...
3
votes
1answer
268 views

Grep is not matching non-ascii characters

I found a problematic sequence of a supposedly UTF-8 encoded text file. The strange thing is that grep seems unable to match this non-ASCII line. $ iconv -f utf8 -t iso88591 corrupt_part.txt --output ...
2
votes
0answers
105 views

OpenSSL converting chars to UTF-8 literals

I'm running a simple PKI web application in Php that uses OpenSSL shell commands and stores information in a text database. I have to deal with non-ASCII input characters (eg. German) but when a new ...
2
votes
1answer
49 views

libvte unicode font handling

I am trying to display some ANSI text which contains characters from the Unicode private use area. I have two fonts which contain these characters. The first is a PCF (bitmap) font, and the second is ...
3
votes
1answer
79 views

Changing fonts in the Mate terminal application

How would I change the font of my terminal in FreeBSD to the Noto Sans font? I am interested in Noto's support for a wide variety of Unicode characters. I downloaded the font using the package manager ...
4
votes
2answers
523 views

Specify encoding with libreoffice --convert-to csv

Excel files can be converted to CSV using: $ libreoffice --convert-to csv --headless --outdir dir file.xlsx Everything appears to work just fine. The encoding, though, is set to something wonky. ...
1
vote
1answer
69 views

How to re-enable the Ctrl+Shift+U shortcut in Cinnamon Mint 17.3?

The Ctrl+Shift+U shortcut for writing Unicode characters seems to work inside of the software manager's search bar. Everywhere else such as Gedit, Terminal and Google Chrome pressing Ctrl+Shift+U does ...
3
votes
1answer
76 views

How to erase unicode symbols in terminal?

Some symbols take up two character cells. Consider this script: #!/usr/bin/env bash echo '银^Htest' echo 'а^Htest' Output: test test How do I know their code points of fullwidth symbols? Some ...
0
votes
2answers
21 views

Looking for a (preferably “all-zsh”) alternative to printenv that can handle Unicode in variable names

zsh supports variable names with Unicode characters (if the multibyte option is set), but printenv (at least GNU's version 8.23 thereof) doesn't seem to be able to handle such variable names. For ...
0
votes
1answer
67 views

Linux alternative to alt+numpad codes

I sometimes need to type "alt codes" to get symbols and on linux, it can be inefficient to use shift+ctrl+u then type the code, for example shift+ctrl+u+00a7 for § when on Windows it's alt+21. So ...
1
vote
1answer
529 views

urxvt powerline symbols

I use urxvt. So i was playing with oh-my-zsh themes and found out that some of them have "The PowerLine Symbols". (if you do not know what it is - take a look. https://gist.githubusercontent.com/...
1
vote
0answers
57 views

KDE5 : a mix of UTF-8 and ISO-8859-1

Since (I think) I upgraded Plasma to version 5, KDE applications seem to open my files (encoded in UTF-8) as in ISO-8859-1. I am not very familiar with locales problems... I am french, so a lot of ...
13
votes
3answers
650 views

How to convert an emoticon specified by a U+xxxxx code to utf-8?

Emoticons seem to be specified using a format of U+xxxxx wherein each x is a hexadecimal digit. For example, U+1F615 is the official Unicode Consortium code for the "confused face" 😕 As I am ...
2
votes
1answer
1k views

How can I correctly decompress a ZIP archive of files with Hebrew names?

(Question self-migrated from superuser.com) Someone sent me a ZIP file containing files with Hebrew names (and created on Windows, not sure with which tool). I use LXDE on Debian Stretch. The Gnome ...
1
vote
1answer
53 views

What's a clean sans font that supports UTF-8, that is suitable for console use?

I'm looking for a font for my console that supports the more unique utf-8 characters. (like ► λ ✔ ✓ ✘ ✢ ➤ ✖ ❯ ❮ ✚ ✹ ➜ ═ ✭). Despite some googling, I haven't been able to find a font that I like. Any ...
2
votes
0answers
42 views

Command like `column -t` but encoding-type agnostic? [closed]

Essentially, I am looking for an encoding-type agnostic version of the column -t command in linux. I need to convert delimited files to flat and then write to an outfile. The specific delimiter ...
4
votes
1answer
191 views

How to create string with invalid unicode characters, in Zsh?

For some testing purposes I need a string with invalid unicode characters. How to create such string in Zsh?
3
votes
2answers
105 views

How to find out which unicode codepoints are defined in a TTF file?

I need to automate a process of verification which Unicode characters have actual glyphs defined for them in a True Type Font file. How do I go around doing that? I can't seem to find information on ...
3
votes
4answers
175 views

How do I create a text file (1 gigabyte) containg random characters with UTF-8 character encoding?

The following command does not use UTF-8: head -c 1M </dev/urandom >myfile.txt
2
votes
1answer
94 views

Devanagari (combined) words are not displaying correctly

I use Trisquel 7.0 LTS with GNOME 3 Flashback installed. Combined devanagari fonts like: श्री is not displaying (and hence printing) correctly. Example- The latter should be displayed as follows: ...
11
votes
4answers
411 views

Get the display width of a string of characters

What would be the closest to a portable way to get the display width (on a terminal at least (one that displays characters in the current locale with the correct width)) of a string of characters from ...
4
votes
2answers
131 views

Why doesn't my Perl play nice with Unicode?

On my new Arch installation, perl doesn't seem to play nice with Unicode. For example, given this input file: ελα ρε 王小红 This command should give me the last two characters of each line: $ perl -...
1
vote
1answer
983 views

How do I find which font provides a particular Unicode glyph?

On the Feodora 23 system I upgraded from F22, the U1F32D symbol 🌭 shows up just fine in the terminal, but on the one I installed from scratch, I get the box-with-numbers placeholder. I just checked ...
0
votes
1answer
45 views

Non-English letters in html2text?

I'm making a script which uses html2text, however, it can't handle non-English letters. I'd like to use letters such as á, é í, ó ú, æ, ø, ö, ä, ð, þ. It just shows questions marks instead of the ...
1
vote
1answer
32 views

What is wrong with URI handling on Linux Mint?

I'm using Linux Mint 17.2 XFCE. I face very strange problem on my Linux Mint 17.2 XFCE. When I open files, that are located in paths with non-latin names (for example /home/yanpas/Загрузки) I see ...
1
vote
1answer
82 views

GNU nano 2.2.6 won't show ₹ (rupees sign)

I have a file which contain ₹ (rupees) sign. but with nano Update: Is there something wrong with my locale? :~$ cat /etc/default/locale LANG="en_GB.UTF-8" LANGUAGE="en_GB:en" LC_NUMERIC="en_GB....
0
votes
1answer
116 views

How to save and use latin unicode in a shell script?

How can I use accented Latin characters like these (or any other unicode char really) in my echo statements comments? À à Á á Â â Ã ã É é Ê ê Í í Ó ó Õ õ Ú ú Ç ç Ñ ñ
3
votes
0answers
377 views

ViM and Python says the encoding is ANSI_X3.4-1968

In ViM, the following command (using Python 3.4.3) outputs ANSI_X3.4-1968: :!python -c "import sys; print(sys.stdout.encoding)" However, I want UTF-8 everywhere. In .vimrc, I do have set encoding=...
14
votes
1answer
1k views

How to make tr aware of non-ascii(unicode) characters?

I'm trying to remove some characters from file(UTF-8). I'm using tr for this purpose: tr -cs '[[:alpha:][:space:]]' ' ' <testdata.dat File contains some foreign characters (like "Латвийская" ...
3
votes
1answer
53 views

Manpage typography and proper dashes

Should manpages avoid using unicode characters like the m-dash (—)? I've noticed most manpages use hyphens/minuses in their taglines where, I believe, an actual dash would have been more correct ...