Unicode is a computing industry standard for the consistent encoding, representation and handling of text expressed in most of the world's writing systems.

learn more… | top users | synonyms (2)

3
votes
2answers
33 views

Specify encoding with libreoffice --convert-to csv

Excel files can be converted to CSV using: $ libreoffice --convert-to csv --headless --outdir dir file.xlsx Everything appears to work just fine. The encoding, though, is set to something wonky. ...
1
vote
1answer
25 views

How to re-enable the Ctrl+Shift+U shortcut in Cinnamon Mint 17.3?

The Ctrl+Shift+U shortcut for writing Unicode characters seems to work inside of the software manager's search bar. Everywhere else such as Gedit, Terminal and Google Chrome pressing Ctrl+Shift+U does ...
3
votes
1answer
41 views

How to erase unicode symbols in terminal?

Some symbols take up two character cells. Consider this script: #!/usr/bin/env bash echo '银^Htest' echo 'а^Htest' Output: test test How do I know their code points of fullwidth symbols? Some ...
0
votes
2answers
16 views

Looking for a (preferably “all-zsh”) alternative to printenv that can handle Unicode in variable names

zsh supports variable names with Unicode characters (if the multibyte option is set), but printenv (at least GNU's version 8.23 thereof) doesn't seem to be able to handle such variable names. For ...
0
votes
1answer
24 views

Linux alternative to alt+numpad codes

I sometimes need to type "alt codes" to get symbols and on linux, it can be inefficient to use shift+ctrl+u then type the code, for example shift+ctrl+u+00a7 for § when on Windows it's alt+21. So ...
1
vote
1answer
104 views

urxvt powerline symbols

I use urxvt. So i was playing with oh-my-zsh themes and found out that some of them have "The PowerLine Symbols". (if you do not know what it is - take a look. ...
1
vote
0answers
17 views

KDE5 : a mix of UTF-8 and ISO-8859-1

Since (I think) I upgraded Plasma to version 5, KDE applications seem to open my files (encoded in UTF-8) as in ISO-8859-1. I am not very familiar with locales problems... I am french, so a lot of ...
14
votes
3answers
506 views

How to convert an emoticon specified by a U+xxxxx code to utf-8?

Emoticons seem to be specified using a format of U+xxxxx wherein each x is a hexadecimal digit. For example, U+1F615 is the official Unicode Consortium code for the "confused face" 😕 As I am ...
2
votes
1answer
63 views

How can I correctly decompress a ZIP archive of files with Hebrew names?

(Question self-migrated from superuser.com) Someone sent me a ZIP file containing files with Hebrew names (and created on Windows, not sure with which tool). I use LXDE on Debian Stretch. The Gnome ...
1
vote
1answer
39 views

What's a clean sans font that supports UTF-8, that is suitable for console use?

I'm looking for a font for my console that supports the more unique utf-8 characters. (like ► λ ✔ ✓ ✘ ✢ ➤ ✖ ❯ ❮ ✚ ✹ ➜ ═ ✭). Despite some googling, I haven't been able to find a font that I like. Any ...
2
votes
0answers
31 views

Command like `column -t` but encoding-type agnostic? [closed]

Essentially, I am looking for an encoding-type agnostic version of the column -t command in linux. I need to convert delimited files to flat and then write to an outfile. The specific delimiter ...
4
votes
1answer
75 views

How to create string with invalid unicode characters, in Zsh?

For some testing purposes I need a string with invalid unicode characters. How to create such string in Zsh?
3
votes
2answers
39 views

How to find out which unicode codepoints are defined in a TTF file?

I need to automate a process of verification which Unicode characters have actual glyphs defined for them in a True Type Font file. How do I go around doing that? I can't seem to find information on ...
3
votes
4answers
100 views

How do I create a text file (1 gigabyte) containg random characters with UTF-8 character encoding?

The following command does not use UTF-8: head -c 1M </dev/urandom >myfile.txt
3
votes
0answers
57 views

Devanagari (combined) words are not displaying correctly

I use Trisquel 7.0 LTS with GNOME 3 Flashback installed. Combined devanagari fonts like: श्री is not displaying (and hence printing) correctly. Example- The latter should be displayed as follows: ...
8
votes
4answers
182 views

Get the display width of a string of characters

What would be the closest to a portable way to get the display width (on a terminal at least (one that displays characters in the current locale with the correct width)) of a string of characters from ...
4
votes
2answers
80 views

Why doesn't my Perl play nice with Unicode?

On my new Arch installation, perl doesn't seem to play nice with Unicode. For example, given this input file: ελα ρε 王小红 This command should give me the last two characters of each line: $ perl ...
1
vote
1answer
941 views

How do I find which font provides a particular Unicode glyph?

On the Feodora 23 system I upgraded from F22, the U1F32D symbol 🌭 shows up just fine in the terminal, but on the one I installed from scratch, I get the box-with-numbers placeholder. I just checked ...
0
votes
1answer
26 views

Non-English letters in html2text?

I'm making a script which uses html2text, however, it can't handle non-English letters. I'd like to use letters such as á, é í, ó ú, æ, ø, ö, ä, ð, þ. It just shows questions marks instead of the ...
1
vote
1answer
23 views

What is wrong with URI handling on Linux Mint?

I'm using Linux Mint 17.2 XFCE. I face very strange problem on my Linux Mint 17.2 XFCE. When I open files, that are located in paths with non-latin names (for example /home/yanpas/Загрузки) I see ...
1
vote
1answer
55 views

GNU nano 2.2.6 won't show ₹ (rupees sign)

I have a file which contain ₹ (rupees) sign. but with nano Update: Is there something wrong with my locale? :~$ cat /etc/default/locale LANG="en_GB.UTF-8" LANGUAGE="en_GB:en" ...
0
votes
1answer
53 views

How to save and use latin unicode in a shell script?

How can I use accented Latin characters like these (or any other unicode char really) in my echo statements comments? À à Á á Â â Ã ã É é Ê ê Í í Ó ó Õ õ Ú ú Ç ç Ñ ñ
3
votes
0answers
157 views

ViM and Python says the encoding is ANSI_X3.4-1968

In ViM, the following command (using Python 3.4.3) outputs ANSI_X3.4-1968: :!python -c "import sys; print(sys.stdout.encoding)" However, I want UTF-8 everywhere. In .vimrc, I do have set ...
11
votes
1answer
263 views

How to make tr aware of non-ascii(unicode) characters?

I'm trying to remove some characters from file(UTF-8). I'm using tr for this purpose: tr -cs '[[:alpha:][:space:]]' ' ' <testdata.dat File contains some foreign characters (like "Латвийская" ...
3
votes
1answer
40 views

Manpage typography and proper dashes

Should manpages avoid using unicode characters like the m-dash (—)? I've noticed most manpages use hyphens/minuses in their taglines where, I believe, an actual dash would have been more correct ...
5
votes
1answer
276 views

Untar filenames in a character encoding different from encoding used in the filesystem

I occasionally get tarballs where the filenames are encoded in ISO-8859-1 or some other pre-Unicode scheme. My system uses UTF-8, so when I untar these archives with the usual options (tar xvf ...
0
votes
0answers
93 views

Display full-color unicode glyphs in terminal

I am trying to figure out why in gnome-terminal (or other terminals, like Konsole, and terminator), unicode glyphs are shown as outlines; where as on iTerm on OSX, they are shown as full-color images. ...
0
votes
1answer
76 views

How to display unicode characters in ncmpcpp

I am using Arch Linux and have UTF-8 encoding enabled. But how can I display a unicode character in ncmpcpp via the config file of ncmpcpp? I already added the line filesystem_charset "UTF-8" to ...
3
votes
0answers
49 views

cursor and combining diacritics in shell

I frequently deal with combining diacritics, especially the combining acute accent (U0301, or \xcc\x81). I have a keyboard set up to insert this character, and that works fine in the shell. $ echo а́ ...
0
votes
1answer
81 views

How can I enter unicode characters on KDE?

On Arch Linux that currently has the mix of KDE 4/Plasma 5. As a Web Developer I need to enter some Unicode Characters into Chrome for testing. I do not have a consistent set of character that I ...
0
votes
0answers
166 views

Nothing helps Gnome Terminal to not default to ANSI_x3.4-1968

I would really like gnome-terminal to default to a UTF-8 encoding, but whatever I do, I can't get it to do it. I don't have sudo access, so I cannot edit /etc/environment. I'm on a university-managed ...
4
votes
2answers
512 views

Extract only chinese characters

I am working on a text written in Italian and Chinese and I need to extract only Chinese characters using AWK. How can I do this? I tried: [The range of Chinese Unicode chars is 4E00 thru 9FFF (344 ...
2
votes
1answer
182 views

How can I make Debian 8's terminal show box-drawing characters? [closed]

I just upgraded to Debian 8 with a fresh install and my terminal prompt (prompt adam2 8bit with ZSH) no longer displays some characters correctly: I've checked the terminal encoding (set to Unicode ...
1
vote
1answer
57 views

What is the difference between locale en_AG and en_AG.utf8?

Running locale -av in the terminal window gives me (only showing first two items of output): locale: en_AG archive: /usr/lib/locale/locale-archive ...
3
votes
3answers
159 views

How to determine if current locale uses UTF-8 encoding?

I would like to determine if the user's locale uses UTF-8 encoding. This seems a little bit ugly: [[ $LANG =~ UTF-8$ ]] && echo "Uses UTF-8 encoding.." is there a more general/portable ...
6
votes
3answers
310 views

Mint 17 (Cinnamon): CTRL+Shift+U not letting me enter unicode symbols

I realize there's probably a simple answer to this question. I come from Ubuntu (Unity) and am used to type unicode symbols with Ctrl+Shift+U, followed by the symbol's code and Enter. This doesn't ...
1
vote
0answers
23 views

Understanding script and font relation (character-map)

When I use charactermap, I found that if I change font, only Latin script changes. Character by all other scripts sounds independent with change in font! So, I want to know what is relationship ...
0
votes
0answers
34 views

Searching text data in Hebrew, Arabic or Aramaic

How can I search for a (sub-)string in a database that has several languages, including Hebrew? I am assuming that the text being right-to-left is a question of the presentation, but the logical ...
3
votes
1answer
93 views

Deleting ghost files with non-ASCII characters

I have some weird files and folders in my trash on Mac OS X. After I "empty" the trash, the files still remain. I attempted to manually delete the files: $ cd ...
5
votes
0answers
215 views

mutt: how to display emoji characters correctly?

I'd like to be able to see emoji characters properly in mutt, but e.g. 💗 shows up as ^J in mutt's pager. Running :set pager=view and re-opening the message displays the character correctly with ...
1
vote
0answers
103 views

SQLplus and oracle,bad utf8 display

I have set export NLS_LANG=Italian_ITALY.UTF8 db is on utf8 SELECT * FROM NLS_DATABASE_PARAMETERS NLS_CHARACTERSET |AL32UTF8 But ...
1
vote
1answer
85 views

Cannot get vim to recognize unicode

I am having the most trouble ever getting vim to recognize unicode. At the top of my vimrc I have set encoding=utf-8 set fileencoding=utf-8 and LANG shows echo $LANG en_US.UTF-8 but when I open ...
2
votes
1answer
45 views

Cyrillic file names broken after upgrading Slackware

After upgrading glibc and some other libraries on Slackware instead of cyrillic names I see the garbage: | Was before | Is now | |------------+------------------| | Вождение | ...
0
votes
1answer
488 views

Can't use apt because python encoding issue

I'm getting a python unicode error every time I try to install or update anything with apt or aptitude, preventing me to update my system. The error I'm getting is the following: File ...
4
votes
1answer
104 views

Print out unicode values of stdin?

I use od to print me the octal or hex of a file/stdin/string. This lets me see the ASCII, or UTF-8 encoded, values of my stdin. But we don't live in ASCIIland anymore. Is there any command that will ...
4
votes
1answer
85 views

How to convert ęąśćżńł TXT to PDF with enscript?

I have problem converting a file to PDF. I create the file with echo ęąśćżńł > text and convert: enscript -O text -o - | ps2pdf - out.pdf However, out.pdf has an encoding problem:
15
votes
4answers
2k views

Is there an alternative to sed that supports unicode?

For example: sed 's/\u0091//g' file1 Right now, I have to do hexdump to get hex number and put into sed as follows: $ echo -ne '\u9991' | hexdump -C 00000000 e9 a6 91 ...
4
votes
2answers
879 views

xterm not displaying unicode

i have never been able to get my terminal to display unicode symbols. for example, before i had my present os, i mapped ctrl+a to the greek mu in vim, and it works on other computers, but not on my ...
2
votes
1answer
253 views

emacs text mode UTF-8 characters

I can't get emacs (version 24.4.1) in text mode (-nw launch option) to display Unicode characters directly. It outputs them in escaped form, e.g. ä becomes \344. When I save the file, it is encoded as ...
1
vote
0answers
90 views

How many bytes can a keypress return? And should a metafied key return more?

I've been tooling around w/ this input reader lately. Currently it only prints a report to stdout for each key pressed while it runs, but I would like to graduate it to a higher purpose sooner than ...