Unicode is a computing industry standard for the consistent encoding, representation and handling of text expressed in most of the world's writing systems.

learn more… | top users | synonyms (2)

1
vote
2answers
196 views

Updated my arch linux server and now I get tmux: need UTF-8 locale (LC_CTYPE) but have ANSI_X3.4-1968

I recently updated my Arch Linux server and during that process tmux got updated. I was using tmux while the upgrade was going on and used it afterwards, but all during the same SSH session. Now, ...
0
votes
1answer
14 views

Debian Jessie with Xfce: cannot change locale (LANG) after installing new locale

I am running Debian Jessie with xfce. I used to have the system in English (en_US.utf8 as LANG since I installed debian only with English). Lately, I installed new locales and even if I made sure I ...
0
votes
1answer
46 views

problem editing utf8 text file with vim

I have a problem editing a html file on a server via vim. The file is utf-8 encoded. While editing with vim (v7.3, no plugins active) I can see umlauts and editing and saving a line before the umlaut ...
0
votes
0answers
15 views

Special characters are not recognized even with UTF-8 in KDE

So, I have Manjaro KDE pre 16 and I have some character encoding issues. Characters like ã á and such are not recognised and are represented by the ? sign. And all programs seem to use this encoding ...
0
votes
0answers
29 views

can't run any python 2 programs due to encoding error

After a system update, I'm not able to run any python 2 program. I get the error. UnicodeDecodeError: 'utf8' codec can't decode byte 0xf6 in position 203: invalid start byte python3 says it uses ...
1
vote
1answer
28 views

Linux console can't display any language other than English while the terminal under Gnome can

I'm still new to Linux and Unix-like systems and I've tried to search on the internet about my issue. Unfortunately I don't get a feasible answer right now. My problem is that the console(tty) on my ...
-1
votes
3answers
40 views

Why am I getting an error “print_unicode: line 9: printf: missing unicode digit for \u Unicode 0187” with this script

I have written them following shell script to view what the Unicode characters look like on my terminal. #!/bin/bash X=0 while [ $X -lt 65536 ]; do HEX=`bc <<< "obase=16; $X"` ...
1
vote
0answers
18 views

GraphViz: how to get UTF-8 AND external PostScript procedures?

Goal: draw a flowchart which contains non-Latin1 symbols. Problem: GraphViz does not provide all node shapes necessary for drawing a flowchart (e.g. "Document", "Predefined Process" etc). ...
0
votes
1answer
47 views

Unable to use correctly Powerline with xterm

I am trying to set up Powerline in my xterm. Im running archlinux. I have followed the steps from here and I am at this point here: So basicaly it works but I just cannot make the arrows appear. This ...
2
votes
1answer
85 views

Why is this find command not returning filenames containing non-ASCII characters only?

I'm trying to determine the root cause of why this find command is not working; it shouldn't match the file called this_should_not_match below: $ > find . -type f -name "*[^ -~]*" ./__º╚t ...
0
votes
0answers
23 views

Glyphs are displayed as “brackets” ( [] )

So I've installed FontAwesome from the official Debian (jessie) packages (fonts-font-awesome) and using a command such as echo -e "\uf26b" will display me a bracket (or like pasting it into ...
1
vote
2answers
19 views

How can I paginate a UTF-8 file and see the right characters?

If I use cat on a file containing UTF-8, it displays properly: % cat /tmp/sample <concept code="endangeredLanguage"> <description value="The language is endangered at the given ...
3
votes
1answer
82 views

Grep is not matching non-ascii characters

I found a problematic sequence of a supposedly UTF-8 encoded text file. The strange thing is that grep seems unable to match this non-ASCII line. $ iconv -f utf8 -t iso88591 corrupt_part.txt --output ...
1
vote
0answers
65 views

OpenSSL converting chars to UTF-8 literals

I'm running a simple PKI web application in Php that uses OpenSSL shell commands and stores information in a text database. I have to deal with non-ASCII input characters (eg. German) but when a new ...
1
vote
0answers
29 views

libvte unicode font handling

I am trying to display some ANSI text which contains characters from the Unicode private use area. I have two fonts which contain these characters. The first is a PCF (bitmap) font, and the second is ...
3
votes
1answer
49 views

Changing fonts in the Mate terminal application

How would I change the font of my terminal in FreeBSD to the Noto Sans font? I am interested in Noto's support for a wide variety of Unicode characters. I downloaded the font using the package manager ...
4
votes
2answers
219 views

Specify encoding with libreoffice --convert-to csv

Excel files can be converted to CSV using: $ libreoffice --convert-to csv --headless --outdir dir file.xlsx Everything appears to work just fine. The encoding, though, is set to something wonky. ...
1
vote
1answer
43 views

How to re-enable the Ctrl+Shift+U shortcut in Cinnamon Mint 17.3?

The Ctrl+Shift+U shortcut for writing Unicode characters seems to work inside of the software manager's search bar. Everywhere else such as Gedit, Terminal and Google Chrome pressing Ctrl+Shift+U does ...
3
votes
1answer
63 views

How to erase unicode symbols in terminal?

Some symbols take up two character cells. Consider this script: #!/usr/bin/env bash echo '银^Htest' echo 'а^Htest' Output: test test How do I know their code points of fullwidth symbols? Some ...
0
votes
2answers
17 views

Looking for a (preferably “all-zsh”) alternative to printenv that can handle Unicode in variable names

zsh supports variable names with Unicode characters (if the multibyte option is set), but printenv (at least GNU's version 8.23 thereof) doesn't seem to be able to handle such variable names. For ...
0
votes
1answer
38 views

Linux alternative to alt+numpad codes

I sometimes need to type "alt codes" to get symbols and on linux, it can be inefficient to use shift+ctrl+u then type the code, for example shift+ctrl+u+00a7 for § when on Windows it's alt+21. So ...
1
vote
1answer
300 views

urxvt powerline symbols

I use urxvt. So i was playing with oh-my-zsh themes and found out that some of them have "The PowerLine Symbols". (if you do not know what it is - take a look. ...
1
vote
0answers
32 views

KDE5 : a mix of UTF-8 and ISO-8859-1

Since (I think) I upgraded Plasma to version 5, KDE applications seem to open my files (encoded in UTF-8) as in ISO-8859-1. I am not very familiar with locales problems... I am french, so a lot of ...
13
votes
3answers
585 views

How to convert an emoticon specified by a U+xxxxx code to utf-8?

Emoticons seem to be specified using a format of U+xxxxx wherein each x is a hexadecimal digit. For example, U+1F615 is the official Unicode Consortium code for the "confused face" 😕 As I am ...
2
votes
1answer
413 views

How can I correctly decompress a ZIP archive of files with Hebrew names?

(Question self-migrated from superuser.com) Someone sent me a ZIP file containing files with Hebrew names (and created on Windows, not sure with which tool). I use LXDE on Debian Stretch. The Gnome ...
1
vote
1answer
46 views

What's a clean sans font that supports UTF-8, that is suitable for console use?

I'm looking for a font for my console that supports the more unique utf-8 characters. (like ► λ ✔ ✓ ✘ ✢ ➤ ✖ ❯ ❮ ✚ ✹ ➜ ═ ✭). Despite some googling, I haven't been able to find a font that I like. Any ...
2
votes
0answers
41 views

Command like `column -t` but encoding-type agnostic? [closed]

Essentially, I am looking for an encoding-type agnostic version of the column -t command in linux. I need to convert delimited files to flat and then write to an outfile. The specific delimiter ...
4
votes
1answer
123 views

How to create string with invalid unicode characters, in Zsh?

For some testing purposes I need a string with invalid unicode characters. How to create such string in Zsh?
3
votes
2answers
65 views

How to find out which unicode codepoints are defined in a TTF file?

I need to automate a process of verification which Unicode characters have actual glyphs defined for them in a True Type Font file. How do I go around doing that? I can't seem to find information on ...
3
votes
4answers
125 views

How do I create a text file (1 gigabyte) containg random characters with UTF-8 character encoding?

The following command does not use UTF-8: head -c 1M </dev/urandom >myfile.txt
2
votes
1answer
77 views

Devanagari (combined) words are not displaying correctly

I use Trisquel 7.0 LTS with GNOME 3 Flashback installed. Combined devanagari fonts like: श्री is not displaying (and hence printing) correctly. Example- The latter should be displayed as follows: ...
10
votes
4answers
315 views

Get the display width of a string of characters

What would be the closest to a portable way to get the display width (on a terminal at least (one that displays characters in the current locale with the correct width)) of a string of characters from ...
4
votes
2answers
102 views

Why doesn't my Perl play nice with Unicode?

On my new Arch installation, perl doesn't seem to play nice with Unicode. For example, given this input file: ελα ρε 王小红 This command should give me the last two characters of each line: $ perl ...
1
vote
1answer
965 views

How do I find which font provides a particular Unicode glyph?

On the Feodora 23 system I upgraded from F22, the U1F32D symbol 🌭 shows up just fine in the terminal, but on the one I installed from scratch, I get the box-with-numbers placeholder. I just checked ...
0
votes
1answer
36 views

Non-English letters in html2text?

I'm making a script which uses html2text, however, it can't handle non-English letters. I'd like to use letters such as á, é í, ó ú, æ, ø, ö, ä, ð, þ. It just shows questions marks instead of the ...
1
vote
1answer
29 views

What is wrong with URI handling on Linux Mint?

I'm using Linux Mint 17.2 XFCE. I face very strange problem on my Linux Mint 17.2 XFCE. When I open files, that are located in paths with non-latin names (for example /home/yanpas/Загрузки) I see ...
1
vote
1answer
68 views

GNU nano 2.2.6 won't show ₹ (rupees sign)

I have a file which contain ₹ (rupees) sign. but with nano Update: Is there something wrong with my locale? :~$ cat /etc/default/locale LANG="en_GB.UTF-8" LANGUAGE="en_GB:en" ...
0
votes
1answer
78 views

How to save and use latin unicode in a shell script?

How can I use accented Latin characters like these (or any other unicode char really) in my echo statements comments? À à Á á Â â Ã ã É é Ê ê Í í Ó ó Õ õ Ú ú Ç ç Ñ ñ
3
votes
0answers
274 views

ViM and Python says the encoding is ANSI_X3.4-1968

In ViM, the following command (using Python 3.4.3) outputs ANSI_X3.4-1968: :!python -c "import sys; print(sys.stdout.encoding)" However, I want UTF-8 everywhere. In .vimrc, I do have set ...
11
votes
1answer
611 views

How to make tr aware of non-ascii(unicode) characters?

I'm trying to remove some characters from file(UTF-8). I'm using tr for this purpose: tr -cs '[[:alpha:][:space:]]' ' ' <testdata.dat File contains some foreign characters (like "Латвийская" ...
3
votes
1answer
44 views

Manpage typography and proper dashes

Should manpages avoid using unicode characters like the m-dash (—)? I've noticed most manpages use hyphens/minuses in their taglines where, I believe, an actual dash would have been more correct ...
5
votes
1answer
475 views

Untar filenames in a character encoding different from encoding used in the filesystem

I occasionally get tarballs where the filenames are encoded in ISO-8859-1 or some other pre-Unicode scheme. My system uses UTF-8, so when I untar these archives with the usual options (tar xvf ...
0
votes
0answers
128 views

Display full-color unicode glyphs in terminal

I am trying to figure out why in gnome-terminal (or other terminals, like Konsole, and terminator), unicode glyphs are shown as outlines; where as on iTerm on OSX, they are shown as full-color images. ...
0
votes
1answer
96 views

How to display unicode characters in ncmpcpp

I am using Arch Linux and have UTF-8 encoding enabled. But how can I display a unicode character in ncmpcpp via the config file of ncmpcpp? I already added the line filesystem_charset "UTF-8" to ...
3
votes
0answers
61 views

cursor and combining diacritics in shell

I frequently deal with combining diacritics, especially the combining acute accent (U0301, or \xcc\x81). I have a keyboard set up to insert this character, and that works fine in the shell. $ echo а́ ...
0
votes
1answer
129 views

How can I enter unicode characters on KDE?

On Arch Linux that currently has the mix of KDE 4/Plasma 5. As a Web Developer I need to enter some Unicode Characters into Chrome for testing. I do not have a consistent set of character that I ...
0
votes
0answers
217 views

Nothing helps Gnome Terminal to not default to ANSI_x3.4-1968

I would really like gnome-terminal to default to a UTF-8 encoding, but whatever I do, I can't get it to do it. I don't have sudo access, so I cannot edit /etc/environment. I'm on a university-managed ...
4
votes
2answers
580 views

Extract only chinese characters

I am working on a text written in Italian and Chinese and I need to extract only Chinese characters using AWK. How can I do this? I tried: [The range of Chinese Unicode chars is 4E00 thru 9FFF (344 ...
2
votes
1answer
205 views

How can I make Debian 8's terminal show box-drawing characters? [closed]

I just upgraded to Debian 8 with a fresh install and my terminal prompt (prompt adam2 8bit with ZSH) no longer displays some characters correctly: I've checked the terminal encoding (set to Unicode ...
1
vote
1answer
85 views

What is the difference between locale en_AG and en_AG.utf8?

Running locale -av in the terminal window gives me (only showing first two items of output): locale: en_AG archive: /usr/lib/locale/locale-archive ...