Unicode is a computing industry standard for the consistent encoding, representation and handling of text expressed in most of the world's writing systems.
2
votes
1answer
25 views
Incorrect sorting according en_US.UTF-8
I'm seeing a weird behavior of the sort command when I sort by en_US.UTF-8.
I'm trying to sort this file (LC_COLLATE=en_US.UTF-8 sort testdata):
㐀
㐃㐄
▼▽◢
㎏㎜㎝
ｂｑｚ
ㄠㄨㄩ─┃┆
...
4
votes
3answers
110 views
How can I get rid of this invisible file?
Background
I have a folder named akorg✽. That Unicode character causes headaches for me when software makes incorrect assumptions about the text encoding of my file paths, so I'd like to remove it ...
5
votes
2answers
69 views
Keyboard combination to insert non keyboard characters
on windows one could with Alt+235 print ë into (any) textfield. I tried the same on linux and it seems to be not working. Depending on the application the result is different, but never the wanted ...
0
votes
2answers
107 views
what is “an invisible whitespace character that takes up space”
One can look up Unicode Characters with Regular Expressions. On Jan Goyvaerts website I found a RegExp whose meaning I don't understand :
\p{Zs} or \p{Space_Separator}: a whitespace character that ...
2
votes
2answers
68 views
Sort lines by unicode value
I'm trying to sort a text file linewise by their Unicode values. As far as I can tell, this means numerals first, then letters, then CJK-Ideographs. However, sort (with LC_ALL=C) fails horribly at ...
2
votes
2answers
138 views
Insert Unicode Characters at Console Login
My password contains "special" characters like ü. How can I login at the console (no X running) when the default keyboard layout does not provide these characters?
Or, differently put: how can I ...
9
votes
2answers
299 views
grep: Find all lines that contain Japanese kanjis
In a huge UTF-8 text file, I want to show all lines that contains Japanese kanjis.
What grep (or other) expression does this?
If I am not mistaken, kanjis are the characters between \u4e00 and ...
4
votes
1answer
80 views
Why is uniq ignoring Unicode and lines with a single letter?
I'm trying to combine both the American and British dictionaries into one large dictionaries, and I'm trying to remove all the duplicates from the superset, but it seems that uniq is not outputting ...
2
votes
1answer
114 views
Looking for an ISO creator
I'm looking for a ISO image creator, already tried isomaster, but it doesn't work with unicode chars, it just take it as bad chars, so what other tool can I use?
I don't need booting, just archive ...
0
votes
1answer
338 views
How can I get full Unicode font coverage for Gentoo Linux?
I've installed over 159 new fonts, all that were possible in Gentoo mirror.
But even then, gnucharmap doesn't have:
Arabic mathematical alphabet symbols 01ee00 1eebb
Arabic Extended-A ࢠ ࣾ
Chakma
...
6
votes
2answers
301 views
shell script/utility replace 2 byte unicode in binary file
I have many large Unicode files. I would like to replace each Unicode byte pair with a new Unicode byte pair. For example, the original file contains
"C3 B9 C3 AB C3 B8 C3 B0"
and I would like to ...
2
votes
1answer
119 views
Home folder name with Unicode characters? [duplicate]
Possible Duplicate:
Does character 'ä' in usernames cause bugs in linux systems?
Is it possible to create a user with a Unicode login name (and home folder name) ? For ...
2
votes
1answer
206 views
Replace python built with UCS4 with UCS2
I've got fedora fc15 installed with python 2.7.1-7.fc15. It is built with ucs4 and I've got some packages here at work that are built with ucs2. I now cannot build other packages that use these ucs2 ...
3
votes
1answer
206 views
tr not replacing apostrophe
I want to convert all apostrophes in this file to X:
Bob's book
Bob’s book
Bob′s book # (Might look the same but actually different)
The first apostrophe is replaced as expected:
$ cat file | tr ...
2
votes
2answers
529 views
How to do a regex search in a UTF-16LE file while in a UTF-8 locale?
EDIT: Due to a comment Warren Young made, it made me realize that I was not clear on one quite relevant point. My search string is already in UTF-16LE order (not in Unicode Codepoint order, which is ...
3
votes
2answers
354 views
How to count the number of lines in a UTF-16LE/CR-LF/BOM file?
The immediate thought is wc, but then the next not-so-immediate thought is... Is *nix's wc purely for *nix line endings \x0a?... It seems so.
I've semi-wangled my way around it, but I feel there ...
3
votes
1answer
871 views
Unicode characters in uxterm and dwm statusbar
This is a realm I've never really meddled in before. So I apologize if I'm missing something completely obvious.
I would like to display chinese characters in dwm's status bar, more specifically I ...
4
votes
2answers
239 views
How to print Unicode glyph names for input string?
I'd like to be able to run
unicode-names 'abç'
and see the corresponding Unicode character names:
LATIN SMALL LETTER A
LATIN SMALL LETTER B
LATIN SMALL LETTER C WITH CEDILLA
Printing a string as ...
1
vote
1answer
1k views
Tmux border split in rxvt
I'm attempting to connect to my Arch server running tmux from my work Windows PC. I've found that while Console2 does a decent job with most things, it's not perfect, and I get all sorts of graphical ...
0
votes
1answer
139 views
QT applications does support Unicode
My system is Gentoo amd64, and the desktop environment is Xfce4. So far, most applications works well, except the terminal and QT-family applications.
The Chromium,Thunar, Thunderbird and many other ...
4
votes
1answer
427 views
How do get unix sort to sort in same order as Java (by unicode value)
I shell out sorting to the unix sort command in a Java program I've written. However I am having problems arising from Java's string comparison behaving differently than the comparisons done by sort.
...
4
votes
2answers
222 views
Is it possible to use split to make character chunks out of Chinese unicode bytes?
For a while, I've been dealing with Chinese unicode text. Of course, the usual rules apply. I can grep for characters the same way I'd do so for words. This is very useful to me.
But there's one ...
16
votes
2answers
4k views
Awesome symbols and characters in a bash prompt
I just ran across a screenshot of someone's terminal:
Is there a list of all of the characters which can be used in a Bash prompt, or can someone get me the character for the star and the right ...
4
votes
1answer
98 views
How to write any Unicode Key without Pre-programmed key for it in kbd?
I am trying to find some Unix tool to input any Unicode key. I am fine with X application or console but I use Vi/m and it may have this property. For example, suppose I want to input key "U+0303" or ...
7
votes
3answers
448 views
Does character 'ä' in usernames cause bugs in linux systems?
I want to use my first name as an username but it contains character 'ä'.
I found this thread.
Now I understand, why some some characters are disabled, but what about 'ä'? Can this character cause ...
4
votes
3answers
4k views
How to specify characters using hexadecimal codes in `grep`?
I am using following command to grep character set range for hexadecimal code 0900 (instead of अ) to 097F (instead of व). How I can use hexadecimal code in place of अ and व?
bzcat archive.bz2 | grep ...
6
votes
2answers
132 views
What is the connection between a gedit bug and a Unix-&-Linux Q/A href?
While answering a Unix-&-Linux question, I observed that Gedit and two other editors, Leafpad and Medit (I tested 12 editors altogether) exhibit the a certain bug. As it turns out, the bug is ...
3
votes
2answers
576 views
Where has my `uniq` or `sort -u` line gone, with some unicode characters
What is going on in the following code snippet? I'm not getting my expected output.
I'd think it was a bug, but it happens for 2 different programs (uniq and sort), so I suspect it is something ...
7
votes
2answers
538 views
coreutils that are utf aware?
When I used cut today, I found out it doesn't treat a utf-8 character as a character, but 3 characters because it's 3 bytes long.
This seems to be generally true for many tools.
Are there versions ...
5
votes
1answer
793 views
What fonts are good for unicode glyphs
So I was looking at this answer on stackoverflow and realized that my fonts aren't covering a whole lot of the utf-8 unicode spectrum (as I get lots of squares). Does anyone know a font that will ...
8
votes
4answers
3k views
In bash, how can I convert a Unicode Codepoint [0-9A-F] into the printabale character?
I have a list of Unicode Codepoints, but I don't know of a "simple" way to convert these hex values into the actual characters they represent...
I've heard that zsh has echo -e '\u0965', but I use ...
4
votes
1answer
1k views
How can I type Unicode characters into KDE's Konsole terminal from a Gnome desktop?
I use Ubuntu.. In 'gnome-terminal', I can type Unicode Codepoints by first typing Ctrl-Shift-u followed by the Codepoint hex value, eg. C-S-u 2468 produces ⑨
konsole, my preferred terminal, does ...
2
votes
3answers
559 views
What a good text editor with RTL (right-to-left) support?
gvim doesn't seem to support it out of the box on my Ubuntu lucid.
6
votes
5answers
742 views
2
votes
1answer
1k views
Terminal charset / font
I want to write a game which runs in a terminal. I do some terminal coloring and wanted to use some unicode characters for nice ascii art "graphics". But a lot of unicode characters aren't supported ...
2
votes
1answer
207 views
Printing conjunct unicode characters using single keystroke
I want to print a conjunct unicode characters (which do not have dedicated unicode value assigned to it, but which can be print using the combination of unicode characters) using a single key stroke ...
2
votes
2answers
219 views
How to install fonts for X?
I would like to setup a Linux system with ScrotWM as the window manager, but I noticed that X is aware of only a few fonts. I would like to have UTF-8 fonts that support multiple languages, including ...
4
votes
1answer
586 views
Text editor with font-size selection for specific human languages (ie. Unicode Block) eg Devanagari
Pre Linux, I used Windows.. (too many years in the wilderness :) ... however there was a ray of sunshine in amongst all the general virus/re-install flack.. and that was Notepad++, a text Editor I ...
11
votes
2answers
4k views
Filtering invalid utf8
I have a text file in an unknown or mixed encoding. I want to see the lines that contain a byte sequence that is not valid UTF-8 (by piping the text file into some program). Equivalently, I want to ...
4
votes
4answers
1k views
Is there a (light-weight) replacement for `rxvt-unicode`?
I am currently using rxvt-unicode as a terminal emulator. Since I also like the configurability of terminal emulators from GNOME and KDE, I wonder whether there is some kind of replacement for ...
