Unicode is a computing industry standard for the consistent encoding, representation and handling of text expressed in most of the world's writing systems.

learn more… | top users | synonyms (2)

4
votes
1answer
45 views

ImageMagick (or other) for UTF-8 text to image

I'm trying to create many single-character images using convert. The purpose is to provide a plastics specialist with images to print onto keyboard keycaps. The ImageMagick documentation suggests ...
1
vote
1answer
17 views

Recovering Mojibaked Files

I have recently been encountering several broken files whose contents got thoroughly baked in conversions between UTF-8 and ISO-Latin-1. How can I repair these files? The process that created the ...
2
votes
2answers
50 views

English Fonts with Persian Glyph

I'm trying to solve this problem for sometime. In the title bar of my web browsers and places like that; If there is a Farsi (Persian) string, it is shown like **** or something similar. I searched ...
2
votes
1answer
32 views

losing unicode support urxvt when logged in as user, root shell has them

I am on a minimal debian testing install. I've set up rxvt-unicode, herbstluftwm, and SLiM. With my username, after SLiM logs me in, all of the urxvt terminal instances i start lack unicode support. ...
1
vote
1answer
30 views

Why doesn't `restore` display my UTF-8 encoded filenames correctly in interactive mode?

When using the interactive mode of the restore utility to restore backups made with dump UTF-8-encoded filenames doesn't display correctly, see example below. The ??s should be ös ... $ sudo restore ...
3
votes
2answers
62 views

How to make the login shell xterm use utf-8?

I use xterm (X-Win32 2012 Build 30 from StarNet Communications Corp) to login from a Windows 7 PC to a Red Enterprise Linux 6 (RHEL6). My problem is that all multi-byte utf-8 characters comes out ...
1
vote
2answers
88 views

how to put color variables in bash $'…'

I have defined in one file which I source from .bashrc, color constants.. like these.. txtgrn='\e[0;32m' # Green txtylw='\e[0;33m' # Yellow txtblu='\e[0;34m' # Blue txtpur='\e[0;35m' # ...
1
vote
1answer
64 views

UTF-8 in Terminator

I use the Terminator terminal emulator, and out of pure boredom, I installed and attempted to run this program: https://github.com/thiderman/doge However, it requires UTF-8 encoding to work. I opened ...
2
votes
2answers
79 views

Missing unicode characters

I've just switched from KDE to lightweight slim+xmonad environment and my fonts are not rendering correctly. I use DejaVu font family (default for Debian 7.x) which supports all characters I need ...
2
votes
0answers
120 views

How can I make the TTY use the appropriate charset?

Note: forked of this per recommendation here. While I got the X keyboard layout right on my own after I fixed that stupid typo, I still can't set the console charset, key map, font map, or whatever ...
0
votes
1answer
366 views

Problems with the locale; can't make Arch Linux use UFT-8 [closed]

Note: The real problems behind this are presented here, as per a recommendation on meta. This question should be closed as a non-reproducible off-topic because its main problem is solved by correcting ...
4
votes
1answer
170 views

Non-printable-ASCII characters in sshd banner

It's possible to configure a banner for sshd that is to be displayed as a connection is opened, via Banner /etc/motd.ssh in sshd_config. Note that this is displayed before the authentication occurs, ...
1
vote
1answer
123 views

Can vim display ASCII characters only, and treat other bytes as binary data?

I already know vim -b, however, depending on the locale used, it displays multi-byte characters (like UTF-8) as single letters. How can I ask vim to only display ASCII printable characters, and ...
3
votes
1answer
124 views

gnome-terminal unicode chars not showing - Locale is set to en_US.utf8

I've become stumped trying to get my terminal to show unicode characters. I've set the LOCALE/LANG environment variables to en_US.utf8: locale LANG=en_US.utf8 LC_CTYPE=en_US.utf8 ...
2
votes
1answer
48 views

Can't obtain the connected forms of some unicode grapheme clusters with combining diacritical marks

In Arabic and some other languages a character has two or three forms which will find its appropriate one automatically when you type a word (according to its previous and next characters). How can ...
4
votes
2answers
473 views

How to mount an NTFS drive as utf8 over NFS

Question How to mount a nfs share (NTFS formatted fileystem) as utf8 in CentOS 6.5? What I tried mount -o iocharset=utf8 mount -o nfs=utf8 mount -o utf8=1 mount -o utf8 Problem: When I ...
3
votes
4answers
159 views

Do any text-based web browsers support unicode box-drawing characters?

I have some html like this: &#x250c&#x2500&#x2500&#x2500&#x2500&#x2500&#x2500&#x2500&#x2500 ...
2
votes
1answer
98 views

Printing UTF-8 (including Chinese) text

I am trying to print a large quantity (several megabytes) of UTF-8 encoded text which consists of Chinese and Latin characters (and maybe a sprinkling of others). I would like to print it in several ...
3
votes
1answer
78 views

Are there terminal emulators that support bi-directional text?

I tried searching for this but came out empty-handed. Is it possible for me to get my terminal emulator to display right-to-left Unicode grapheme clusters properly? Use case: I'm writing a script ...
2
votes
2answers
127 views

Is it possible to show mathematical symbols in the terminal?

I want to do some program that can help me to check scientific formulars via terminal. It is possible or not if i want to show mathematical symbols (e.g. integral, diff Greek's Alphabets) on Linux's ...
5
votes
2answers
255 views

Convert between Unicode Normalization Forms on the unix command-line

In Unicode, some character combinations have more than one representation. For example, the character ä can be represented as "ä", that is the codepoint U+00E4 (two bytes c3 a4 in UTF-8 encoding), ...
2
votes
1answer
323 views

Double line box_drawing characters in terminal

This piece of code in wikipedia: $ char=( 6a 6b 6c 6d 6e 71 74 75 76 77 78 ) $ for i in ${char[*]}; do printf "0x$i \x$i \e(0\x$i\e(B\n"; done includes one-line box-drawing characters. Are there ...
4
votes
2answers
156 views

Swedish unicode characters in xdm / xlogin

I decided to localize my XDM login screen but I'm stuck with corrupted Swedish characters. I'm using Debian Wheezy with the following /etc/X11/xdm/Xresources Xcursor.theme: whiteglass ...
2
votes
1answer
79 views

console displaying quote character from gcc wongly

After an upgrade to debian wheezy my text consoles displays questions marks where there should be quotes Under X I see things correctly window.cpp:1056:21: error: base operand of ‘->’ is not a ...
2
votes
1answer
381 views

Some UTF-8 characters not being recognized by grep or sed

Trying to determine all characters in a file. The file sample consists of: a eɪ abandon əˈbændən ability əˈbɪləti able ˈeɪbəl able ˈeɪbl abortion əˈbɔrʃən abortion əˈbɔrʃn about əˈbaʊt above əˈbʌv ...
1
vote
2answers
3k views

Converting from ascii to utf-8 format - iconv not working [closed]

I have a requirement to convert from ASCII text format to UTF-8. Below is what I am performing through the iconv command: [root@main tmp]# cat File1 1 5 6 [root@main tmp]# file File1 File1: ASCII ...
1
vote
1answer
205 views

Non-ASCII characters handled incorrectly on command line

I have a problem with non-ASCII characters in the Terminal on Mac. If I write: echo ÆØÅ Then press Enter, Arrow Up, Arrow Left, so the cursor is between the Ø and the Å, then write X, then the Å is ...
5
votes
2answers
444 views

How to convert UTF-8 txt files to all uppercase in bash?

I have some UTF-8 .txt files which I would like to convert to all uppercase. If it was just ASCII, I could use: tr [:lower:] [:upper:] But since I'm working with diacritics and stuff, it doesn't ...
3
votes
1answer
66 views

Squid doesn't block non-ascii domans

I have the following lines in /etc/squid/squid.conf: acl bad_url url_regex "/etc/squid/block.acl" http_access deny bad_url All of the urls in block.acl must be blocked by the proxy server. It works ...
2
votes
1answer
278 views

GNU Screen doesn't echo unicode characters correct

When I do this in my terminal: echo -e "\xF0\x9f\x8d\xba" I get a cool beer mug in my terminal: 🍺 However, when I start screen, and try the same, I'm getting a �. How do I get the nice beer mug? ...
2
votes
1answer
115 views

Incorrect sorting according en_US.UTF-8

I'm seeing a weird behavior of the sort command when I sort by en_US.UTF-8. I'm trying to sort this file (LC_COLLATE=en_US.UTF-8 sort testdata): 㐀 㐃㐄 ▼▽◢ ㎏㎜㎝ bqz ㄠㄨㄩ─┃┆ ...
4
votes
3answers
206 views

How can I get rid of this invisible file?

Background I have a folder named akorg✽. That Unicode character causes headaches for me when software makes incorrect assumptions about the text encoding of my file paths, so I'd like to remove it ...
3
votes
1answer
185 views

UTF-8 Characters in Byobu Screen Status Line

I'm running Byobu with Screen backend. I have a custom status script that wget's an RSS feed and shows the latest headline in it. If there are non-ASCII characters, they are not printed correctly. ...
5
votes
2answers
99 views

Keyboard combination to insert non keyboard characters

on windows one could with Alt+235 print ë into (any) textfield. I tried the same on linux and it seems to be not working. Depending on the application the result is different, but never the wanted ...
0
votes
2answers
771 views

what is “an invisible whitespace character that takes up space”

One can look up Unicode Characters with Regular Expressions. On Jan Goyvaerts website I found a RegExp whose meaning I don't understand : \p{Zs} or \p{Space_Separator}: a whitespace character that ...
2
votes
2answers
190 views

Sort lines by unicode value

I'm trying to sort a text file linewise by their Unicode values. As far as I can tell, this means numerals first, then letters, then CJK-Ideographs. However, sort (with LC_ALL=C) fails horribly at ...
4
votes
2answers
287 views

What would break if the C locale was UTF-8 instead of ASCII?

The C locale is defined to use the ASCII charset and POSIX does not provide a way to use a charset without changing the locale as well. What would happen if the encoding of C were switched to UTF-8 ...
2
votes
2answers
307 views

Insert Unicode Characters at Console Login

My password contains "special" characters like ü. How can I login at the console (no X running) when the default keyboard layout does not provide these characters? Or, differently put: how can I ...
11
votes
2answers
891 views

grep: Find all lines that contain Japanese kanjis

In a huge UTF-8 text file, I want to show all lines that contains Japanese kanjis. What grep (or other) expression does this? If I am not mistaken, kanjis are the characters between \u4e00 and ...
4
votes
1answer
153 views

Why is uniq ignoring Unicode and lines with a single letter?

I'm trying to combine both the American and British dictionaries into one large dictionaries, and I'm trying to remove all the duplicates from the superset, but it seems that uniq is not outputting ...
1
vote
1answer
189 views

how to make terminal utf-8

How can I make my terminal(bash) window uft-8, that it can show utf-8 characters? my operating system is : ubuntu 12.04 my desktop : gnome-shell How about native shell(outside of desktop)?
0
votes
1answer
671 views

How to change terminal character encoding

Today I uninstalled the GUI packages on my home CentOS installation. Now, when the machine starts, I get the login prompt. It acts finicky. Sometimes pressing enter just once after answering each ...
2
votes
1answer
140 views

Looking for an ISO creator

I'm looking for a ISO image creator, already tried isomaster, but it doesn't work with unicode chars, it just take it as bad chars, so what other tool can I use? I don't need booting, just archive ...
6
votes
3answers
372 views

How to replace all percent-encoded UTF-8 substrings with plain UTF-8 text?

I've got a html file with a lot of %-encoded UTF-8 text in URLs. For example "%D1%80%D0%B5%D1%81%D1%83%D1%80%D1%81%D1%8B" stands for "ресурсы" ("resources" in Russian). The task is to replace all ...
1
vote
1answer
679 views

How can I get full Unicode font coverage for Gentoo Linux?

I've installed over 159 new fonts, all that were possible in Gentoo mirror. But even then, gnucharmap doesn't have: Arabic mathematical alphabet symbols 01ee00 1eebb Arabic Extended-A ࢠ ࣾ Chakma ...
2
votes
0answers
446 views

Problems changing PS1 to use special character

I'm trying to get my zsh to look something like this: https://bbs.archlinux.org/viewtopic.php?pid=1068202#p1068202. Whenever I print the └───╼ part of the PS1 to my terminal (or in the .zshrc for ...
6
votes
2answers
500 views

shell script/utility replace 2 byte unicode in binary file

I have many large Unicode files. I would like to replace each Unicode byte pair with a new Unicode byte pair. For example, the original file contains "C3 B9 C3 AB C3 B8 C3 B0" and I would like to ...
3
votes
0answers
771 views

Bad utf8 display with tmux

When I press the "é" key multiple times on my keyboard, here is what tmux print (notice the spaces) : arcanis@~ > é é é é é é é é é é é é é It also broke emacs when the file contains utf8 ...
2
votes
1answer
163 views

Home folder name with Unicode characters? [duplicate]

Possible Duplicate: Does character 'ä' in usernames cause bugs in linux systems? Is it possible to create a user with a Unicode login name (and home folder name) ? For ...
2
votes
1answer
401 views

Replace python built with UCS4 with UCS2

I've got fedora fc15 installed with python 2.7.1-7.fc15. It is built with ucs4 and I've got some packages here at work that are built with ucs2. I now cannot build other packages that use these ucs2 ...