Unicode is a computing industry standard for the consistent encoding, representation and handling of text expressed in most of the world's writing systems.

learn more… | top users | synonyms (2)

0
votes
0answers
6 views

change multiple filenames - python script [migrated]

first i am newbie in python. i have a bulk of files (117 files), i think their names are UTF-8 .Here is one filename sample: 1|جاÙا JAVA : ÙÙÙÙ٠اÙخصائص Attributes ÙÙ ...
1
vote
0answers
13 views

Change existing dovecot maildir installation from m-UTF7 charset to UTF8 to avoid breaking TAB

In an existing dovecot installation with many pre-existing folders using regional characters I would like to change m-UTF7 (.&AMk-l&AOk-ments envoy&AOk-s) foldernames to UTF8 (.Éléments ...
5
votes
1answer
92 views

Can a script determine which characters a terminal can display?

I'm working on a script that displays UTF-8 characters as output. In my Gnome Terminal, this prints out a pretty maple leaf (🍁): $ echo -e '\xF0\x9F\x8D\x81' In rxvt, it prints out a box (the ...
4
votes
1answer
42 views

XTerm doesn't display *some* unicode characters properly?

I don't have a general problem with XTerm and Unicode. For the most part, things are working. This works great: $ echo "¿dónde está la llama?" ¿dónde está la llama? As does this: $ echo -e ...
4
votes
2answers
110 views

How do I type arbitrary unicode characters in xterm?

Moving away from using gnome-terminal and terminator since they are excruciatingly slow. (20-30 seconds to change focus to them for whatever reason) xterm is nice and fast. However, I need to be able ...
2
votes
2answers
651 views

Updated my arch linux server and now I get tmux: need UTF-8 locale (LC_CTYPE) but have ANSI_X3.4-1968

I recently updated my Arch Linux server and during that process tmux got updated. I was using tmux while the upgrade was going on and used it afterwards, but all during the same SSH session. Now, ...
0
votes
1answer
33 views

Debian Jessie with Xfce: cannot change locale (LANG) after installing new locale

I am running Debian Jessie with xfce. I used to have the system in English (en_US.utf8 as LANG since I installed debian only with English). Lately, I installed new locales and even if I made sure I ...
0
votes
1answer
59 views

problem editing utf8 text file with vim

I have a problem editing a html file on a server via vim. The file is utf-8 encoded. While editing with vim (v7.3, no plugins active) I can see umlauts and editing and saving a line before the umlaut ...
0
votes
0answers
30 views

Special characters are not recognized even with UTF-8 in KDE

So, I have Manjaro KDE pre 16 and I have some character encoding issues. Characters like ã á and such are not recognised and are represented by the ? sign. And all programs seem to use this encoding ...
0
votes
0answers
33 views

can't run any python 2 programs due to encoding error

After a system update, I'm not able to run any python 2 program. I get the error. UnicodeDecodeError: 'utf8' codec can't decode byte 0xf6 in position 203: invalid start byte python3 says it uses ...
1
vote
1answer
30 views

Linux console can't display any language other than English while the terminal under Gnome can

I'm still new to Linux and Unix-like systems and I've tried to search on the internet about my issue. Unfortunately I don't get a feasible answer right now. My problem is that the console(tty) on my ...
-1
votes
3answers
61 views

Why am I getting an error “print_unicode: line 9: printf: missing unicode digit for \u Unicode 0187” with this script

I have written them following shell script to view what the Unicode characters look like on my terminal. #!/bin/bash X=0 while [ $X -lt 65536 ]; do HEX=`bc <<< "obase=16; $X"` ...
1
vote
0answers
28 views

GraphViz: how to get UTF-8 AND external PostScript procedures?

Goal: draw a flowchart which contains non-Latin1 symbols. Problem: GraphViz does not provide all node shapes necessary for drawing a flowchart (e.g. "Document", "Predefined Process" etc). ...
0
votes
1answer
73 views

Unable to use correctly Powerline with xterm

I am trying to set up Powerline in my xterm. Im running archlinux. I have followed the steps from here and I am at this point here: So basicaly it works but I just cannot make the arrows appear. This ...
2
votes
1answer
92 views

Why is this find command not returning filenames containing non-ASCII characters only?

I'm trying to determine the root cause of why this find command is not working; it shouldn't match the file called this_should_not_match below: $ > find . -type f -name "*[^ -~]*" ./__º╚t ...
0
votes
0answers
24 views

Glyphs are displayed as “brackets” ( [] )

So I've installed FontAwesome from the official Debian (jessie) packages (fonts-font-awesome) and using a command such as echo -e "\uf26b" will display me a bracket (or like pasting it into ...
1
vote
2answers
22 views

How can I paginate a UTF-8 file and see the right characters?

If I use cat on a file containing UTF-8, it displays properly: % cat /tmp/sample <concept code="endangeredLanguage"> <description value="The language is endangered at the given ...
3
votes
1answer
115 views

Grep is not matching non-ascii characters

I found a problematic sequence of a supposedly UTF-8 encoded text file. The strange thing is that grep seems unable to match this non-ASCII line. $ iconv -f utf8 -t iso88591 corrupt_part.txt --output ...
1
vote
0answers
77 views

OpenSSL converting chars to UTF-8 literals

I'm running a simple PKI web application in Php that uses OpenSSL shell commands and stores information in a text database. I have to deal with non-ASCII input characters (eg. German) but when a new ...
1
vote
0answers
35 views

libvte unicode font handling

I am trying to display some ANSI text which contains characters from the Unicode private use area. I have two fonts which contain these characters. The first is a PCF (bitmap) font, and the second is ...
3
votes
1answer
62 views

Changing fonts in the Mate terminal application

How would I change the font of my terminal in FreeBSD to the Noto Sans font? I am interested in Noto's support for a wide variety of Unicode characters. I downloaded the font using the package manager ...
4
votes
2answers
330 views

Specify encoding with libreoffice --convert-to csv

Excel files can be converted to CSV using: $ libreoffice --convert-to csv --headless --outdir dir file.xlsx Everything appears to work just fine. The encoding, though, is set to something wonky. ...
1
vote
1answer
46 views

How to re-enable the Ctrl+Shift+U shortcut in Cinnamon Mint 17.3?

The Ctrl+Shift+U shortcut for writing Unicode characters seems to work inside of the software manager's search bar. Everywhere else such as Gedit, Terminal and Google Chrome pressing Ctrl+Shift+U does ...
3
votes
1answer
66 views

How to erase unicode symbols in terminal?

Some symbols take up two character cells. Consider this script: #!/usr/bin/env bash echo '银^Htest' echo 'а^Htest' Output: test test How do I know their code points of fullwidth symbols? Some ...
0
votes
2answers
20 views

Looking for a (preferably “all-zsh”) alternative to printenv that can handle Unicode in variable names

zsh supports variable names with Unicode characters (if the multibyte option is set), but printenv (at least GNU's version 8.23 thereof) doesn't seem to be able to handle such variable names. For ...
0
votes
1answer
46 views

Linux alternative to alt+numpad codes

I sometimes need to type "alt codes" to get symbols and on linux, it can be inefficient to use shift+ctrl+u then type the code, for example shift+ctrl+u+00a7 for § when on Windows it's alt+21. So ...
1
vote
1answer
378 views

urxvt powerline symbols

I use urxvt. So i was playing with oh-my-zsh themes and found out that some of them have "The PowerLine Symbols". (if you do not know what it is - take a look. ...
1
vote
0answers
42 views

KDE5 : a mix of UTF-8 and ISO-8859-1

Since (I think) I upgraded Plasma to version 5, KDE applications seem to open my files (encoded in UTF-8) as in ISO-8859-1. I am not very familiar with locales problems... I am french, so a lot of ...
13
votes
3answers
616 views

How to convert an emoticon specified by a U+xxxxx code to utf-8?

Emoticons seem to be specified using a format of U+xxxxx wherein each x is a hexadecimal digit. For example, U+1F615 is the official Unicode Consortium code for the "confused face" 😕 As I am ...
2
votes
1answer
697 views

How can I correctly decompress a ZIP archive of files with Hebrew names?

(Question self-migrated from superuser.com) Someone sent me a ZIP file containing files with Hebrew names (and created on Windows, not sure with which tool). I use LXDE on Debian Stretch. The Gnome ...
1
vote
1answer
47 views

What's a clean sans font that supports UTF-8, that is suitable for console use?

I'm looking for a font for my console that supports the more unique utf-8 characters. (like ► λ ✔ ✓ ✘ ✢ ➤ ✖ ❯ ❮ ✚ ✹ ➜ ═ ✭). Despite some googling, I haven't been able to find a font that I like. Any ...
2
votes
0answers
42 views

Command like `column -t` but encoding-type agnostic? [closed]

Essentially, I am looking for an encoding-type agnostic version of the column -t command in linux. I need to convert delimited files to flat and then write to an outfile. The specific delimiter ...
4
votes
1answer
144 views

How to create string with invalid unicode characters, in Zsh?

For some testing purposes I need a string with invalid unicode characters. How to create such string in Zsh?
3
votes
2answers
82 views

How to find out which unicode codepoints are defined in a TTF file?

I need to automate a process of verification which Unicode characters have actual glyphs defined for them in a True Type Font file. How do I go around doing that? I can't seem to find information on ...
3
votes
4answers
142 views

How do I create a text file (1 gigabyte) containg random characters with UTF-8 character encoding?

The following command does not use UTF-8: head -c 1M </dev/urandom >myfile.txt
2
votes
1answer
82 views

Devanagari (combined) words are not displaying correctly

I use Trisquel 7.0 LTS with GNOME 3 Flashback installed. Combined devanagari fonts like: श्री is not displaying (and hence printing) correctly. Example- The latter should be displayed as follows: ...
11
votes
4answers
361 views

Get the display width of a string of characters

What would be the closest to a portable way to get the display width (on a terminal at least (one that displays characters in the current locale with the correct width)) of a string of characters from ...
4
votes
2answers
113 views

Why doesn't my Perl play nice with Unicode?

On my new Arch installation, perl doesn't seem to play nice with Unicode. For example, given this input file: ελα ρε 王小红 This command should give me the last two characters of each line: $ perl ...
1
vote
1answer
973 views

How do I find which font provides a particular Unicode glyph?

On the Feodora 23 system I upgraded from F22, the U1F32D symbol 🌭 shows up just fine in the terminal, but on the one I installed from scratch, I get the box-with-numbers placeholder. I just checked ...
0
votes
1answer
37 views

Non-English letters in html2text?

I'm making a script which uses html2text, however, it can't handle non-English letters. I'd like to use letters such as á, é í, ó ú, æ, ø, ö, ä, ð, þ. It just shows questions marks instead of the ...
1
vote
1answer
30 views

What is wrong with URI handling on Linux Mint?

I'm using Linux Mint 17.2 XFCE. I face very strange problem on my Linux Mint 17.2 XFCE. When I open files, that are located in paths with non-latin names (for example /home/yanpas/Загрузки) I see ...
1
vote
1answer
72 views

GNU nano 2.2.6 won't show ₹ (rupees sign)

I have a file which contain ₹ (rupees) sign. but with nano Update: Is there something wrong with my locale? :~$ cat /etc/default/locale LANG="en_GB.UTF-8" LANGUAGE="en_GB:en" ...
0
votes
1answer
92 views

How to save and use latin unicode in a shell script?

How can I use accented Latin characters like these (or any other unicode char really) in my echo statements comments? À à Á á Â â Ã ã É é Ê ê Í í Ó ó Õ õ Ú ú Ç ç Ñ ñ
3
votes
0answers
312 views

ViM and Python says the encoding is ANSI_X3.4-1968

In ViM, the following command (using Python 3.4.3) outputs ANSI_X3.4-1968: :!python -c "import sys; print(sys.stdout.encoding)" However, I want UTF-8 everywhere. In .vimrc, I do have set ...
12
votes
1answer
753 views

How to make tr aware of non-ascii(unicode) characters?

I'm trying to remove some characters from file(UTF-8). I'm using tr for this purpose: tr -cs '[[:alpha:][:space:]]' ' ' <testdata.dat File contains some foreign characters (like "Латвийская" ...
3
votes
1answer
45 views

Manpage typography and proper dashes

Should manpages avoid using unicode characters like the m-dash (—)? I've noticed most manpages use hyphens/minuses in their taglines where, I believe, an actual dash would have been more correct ...
5
votes
1answer
555 views

Untar filenames in a character encoding different from encoding used in the filesystem

I occasionally get tarballs where the filenames are encoded in ISO-8859-1 or some other pre-Unicode scheme. My system uses UTF-8, so when I untar these archives with the usual options (tar xvf ...
1
vote
0answers
134 views

Display full-color unicode glyphs in terminal

I am trying to figure out why in gnome-terminal (or other terminals, like Konsole, and terminator), unicode glyphs are shown as outlines; where as on iTerm on OSX, they are shown as full-color images. ...
0
votes
1answer
101 views

How to display unicode characters in ncmpcpp

I am using Arch Linux and have UTF-8 encoding enabled. But how can I display a unicode character in ncmpcpp via the config file of ncmpcpp? I already added the line filesystem_charset "UTF-8" to ...
3
votes
0answers
65 views

cursor and combining diacritics in shell

I frequently deal with combining diacritics, especially the combining acute accent (U0301, or \xcc\x81). I have a keyboard set up to insert this character, and that works fine in the shell. $ echo а́ ...