Questions tagged [unicode]

Unicode is a computing industry standard for the consistent encoding, representation and handling of text expressed in most of the world's writing systems.

Filter by
Sorted by
Tagged with
1
vote
0answers
26 views

Editing a UTF-8 binary file

If I open a binary file in vim it shows the following text: ð<9F><92>¦. Encoding is set to UTF-8. But when I search for its content with strings --encoding=S myfile I see the 💦 emoji. As ...
1
vote
0answers
15 views

zsh some unicode input shown as code in angle brackets in prompt line (but not output)

In my cygwin / mintty setup, when I have the unicode characters and U+1F60C (😌 relieved face) in my Windows clipboard, type echo ', paste, type ' and enter, zsh displays it as inverse video <d83d&...
0
votes
1answer
30 views

Unicode character in PS1 makes wrapping behave weirdly (not a duplicate)

I wanted to put the Unicode character Δ into PS1, but when I did, when typing in long commands, the terminal wouldn't wrap to a newline but would overwrite the current line! The problem doesn't occur ...
3
votes
0answers
45 views

Is this a bug in 'tr'? [duplicate]

My terminal is set to UTF-8. If I type this: echo -n 'ýá' | xxd I can see this output: 00000000: c3bd c3a1 Which is fine. Now I would like to remove the 'ý' character from the string, so I use: ...
0
votes
0answers
14 views

How can I type Russian characters with accents in KDE?

I use KDE and have enabled the Russian keyboard layout. This works fine except that I see no opportunity to add accents to vowels. Is this in fact possible? I wish to use them in applications such as ...
0
votes
0answers
25 views

Xterm does not display unicode character [duplicate]

Fellow people of the internet, I got an issue with Xterm, as i try to use a zsh theme using unicode characters. However, Xterm refuses to print them, which is a bit annoying. My Xressources is a ...
0
votes
1answer
43 views

How to turn mojibake text to readable form?

I got mojibake text (from MP3 ID3 fields) that need to be converted to the right form. I tried to: echo 'c2 8d 44 e2 80 99 c2 b2 c2 8d 44 e2 80 99 c2 b2' | xxd -p -r | iconv -f sjis -t utf8; echo ...
-3
votes
2answers
159 views

Proposed additional POSIX “Character Classes” [closed]

There are a handful of "character classes" defined in POSIX as in LC_CTYPE locale definition with the following (12) names: alnum alpha blank cntrl digit graph lower print punct space upper xdigit ...
0
votes
1answer
17 views

How to take accent in account on centos [6|7] in bash

I'll give you an exemple, it would help. on my ubuntu LTS 18.04 touch /tmp/"Éléments supprimés" ls -l /tmp/*suppr* -rw-rw-r-- 1 USER USER 0 mars 4 08:28 '/tmp/Éléments supprimés' on my centos 6 ...
0
votes
1answer
53 views

Replace character in file based on position

I work on the encoding of a file, from unknown-8bit to UTF-8. but I got an error message. iconv: illegal input sequence at position 136828 So I did a search in the file with the position like this : ...
0
votes
2answers
78 views

How to fix strange characters in my .txt file?

I edited a .txt file in Visual Studio on Windows and then copied that into a HPC server. The file looks fine to me at first, But when I opened it in the linux environment, weird characters showed up (...
4
votes
1answer
79 views

weird unicode behaviour

I'm using Arch Linux and one thing I just can't seem to get right is the Unicode fonts. I'll give you an example of what goes wrong. Here's a screenshot of gucharmap: The selected glyph in the top ...
0
votes
0answers
14 views

Is there a way to disable bidirectional selection?

Apparently, mixing regular latins, cyrillics and other left-to-right scripts with the opposite Middle Eastern ones is "a bit" messy. I am not sure, if it is all about Unicode RLM and non-printing ...
2
votes
0answers
43 views

Why did bash (or PuTTY) interpret the two characters 'cd' as the single character '㏅'?

I ssh'd into a CentOS VM today through PuTTY -- right after I logged in and got a bash shell, I tried to cd to another directory, but the displaying of what I typed lagged a bit, and then instead of '...
0
votes
1answer
58 views

stop bash from printing invalid unicode sequences

Doing echo -e "\uDDAA" (which is not a valid utf-8 codepoint) in bash, prints ���. How can I make it not print anything if its not a valid codepoint? what im trying to do is add in front of all ...
7
votes
1answer
427 views

Sort LC_ALL=C vs LC_ALL=C.utf8

Does the linux sort command differentiate between C and C.utf-8 locale? the sort manual says to use LC_ALL=C to sort by byte value, but i saw that C.utf-8 allows also utf8 values (and not just ASCII) ...
1
vote
3answers
100 views

How to insert unicode to file

I'm using fish-shell on CentOS8. I would like to insert the following to file. function fish_title echo "🔥 AmericaN 🔥" end But upon trying to paste it into the file, I see the following: ...
0
votes
5answers
329 views

How to draw a continuous line in terminal?

I've been searching for this for a while and didn't get a satisfactory answer for it. I've taken this screenshot from the output of Gnu/Linux's tree command. I want to know how to draw or print ...
2
votes
0answers
40 views

rxvt-unicode-256color (Debian, 9.22-6): braille characters only shown after showing arabic character

I'm trying to display braille characters in my urxvt terminal, e.g. I'd like to see a dot when running echo -e "\u2840". To my confusion, this only works if I run echo -e "\u0641" first in that ...
2
votes
1answer
144 views

Extract mail header and decode MIME encoded-word

As part of a script, I want to take a file containing an email and extract a header, e.g., the subject header. The following almost works: formail -c -x subject < FILE But it does not decode ...
0
votes
1answer
17 views

Cedilla does not work under Softmaker Office

Infos here Cedilla works in all other apps but SoftMaker office where it delivers a ć. What might I be missing? This might be some QT/GTK issue but I'm not sure about how to fix.
0
votes
2answers
70 views

Unicode Strings in Text file

I have a text file containing the following unicode strings with regular text. Cat a.txt {"relationship":{"type:Memberkey","id""824-\u0001\u0019BFGHDICA2166-01-01","source"} Here \u0001 and \u0019 ...
2
votes
2answers
120 views

Get the Unicode code point of a character in zsh

How can I get the Unicode code point of a character in zsh? e.g., if I have: s=abc How can I get the code point of s[2] (i.e. code point of "b" = 0x0062)?
1
vote
0answers
29 views

Why two unicode-characters are not allowed in xkb?

I wonder why a sequence of Unicode-characters is not allowed on one key-press in xkb. Eg. I use the Indian keyboard for typing in Devanagari. This keyboard is based on the inscript keyboard layout. In ...
4
votes
1answer
131 views

Can't use different font families in groff -ms

I'm using groff with ms macros and outputting it to PostScript. On Linux Void. I want to have a different font and also output Unicode characters. I have converted my font as written in this question. ...
1
vote
1answer
55 views

xterm does not display one unicode character

I think my xterm supports unicode. For instance, it displays the Euro sign: echo -e '\xe2\x82\xac' but it does not display one particular character: PL_BRANCH=$'\ue0a0' echo $PL_BRANCH this ...
2
votes
1answer
311 views

How to use a string in Chinese characters as input for another command in bash?

I'm currently using a command to convert some Chinese characters into pinyin, which requires the string in my bash to be Unicode safe and put the result in another variable. I can run the following ...
1
vote
1answer
50 views

Create Unicode Login In *Unix

I want to create Unicode logins for *Unix flavor OS, when i use useradd like below, I got that user name is invalid [root@mail ~]# useradd ياسين useradd: invalid user name 'ياسين
1
vote
0answers
42 views

type string as if it were a keyboard

I have a bunch of unicode symbols in a file and a script to select and copy one of them (dmenuunicode script in this repository which I've forked). But instead pasting them I would like to save one ...
0
votes
0answers
23 views

Posix locale unicode encodings; which is correct? [duplicate]

According to the GNU gettext manual, an example locale would be es_ES.UTF-8. Running locale -a on my Debian 9 system shows $ locale -a C C.UTF-8 en_GB.utf8 en_US.utf8 POSIX Notice the locale lists ...
0
votes
0answers
40 views

pureos tty terminal not rendering special characters

I'm running pureos (debian derivative) on an HP laptop. Certain characters don't render properly in tty terminal (ctl-alt-f#). As an example the character which I believe to be utf8 U+0091(alternate ...
1
vote
3answers
92 views

How to set debian 9/10 and putty to show utf-8 chars?

Before opening this question, I google a lot and tried all the suggested fix Problem pm2 monit util is showed in this way instead of Strange this: pm2 list is showed right My remote system $ ...
1
vote
0answers
69 views

Issues with Word Processors (calligra, libreoffice and wps-office)

I am trying to write the following text in LibreOffice writer: এই লাইন এডিট করতে গেলে যে সমস্যা হয়। If I double click on লাইন and hit backspace it gets deleted and if I start retyping লাইন right ...
0
votes
1answer
94 views

Unicode Tables in Vim

I have been toying around with i3 and like many others ran into a few snags working with Unicode characters. The majority of them resolved by installing fonts or pointing config files to the installed ...
0
votes
0answers
52 views

Unicode hexadecimal editor

I am looking for a Linux editor or viewer with side by side panels displaying hexadecimal bytes and the visual representation and or code point of: at a minimum UTF-8 at a maximum the entire Unicode ...
2
votes
1answer
58 views

Is there a character that sorts before the newline character, for managing sort order in 'ls'?

I'm developing some file naming guidelines, and I'm trying to find a way to allow a draft document to list before a final revision. Example: Currently my naming convention looks like this: ...
0
votes
1answer
887 views

How to fix UTF-8 / locale problem in openSUSE Linux (in terminal / file names and program dialogues)

I have some file / folder names which are not 7-bit clean and they are not displayed correctly in my openSUSE system. Example for the folder /music/Gabriel_Fauré: # ls -1d /music/Gabriel_Faur? /...
2
votes
1answer
117 views

Displaying orbital node characters in groff ms macros

I'm trying to display the characters for ascending and descending orbital nodes (☊ and ☋) in groff, however when I export the document to postscript they simply don't show.
1
vote
0answers
28 views

Unable to encode the unicode character during writing to a file in python

Here i am extracting the bible verses from locally stored html files using python actually this python is not written by me i got from somewhere, when i run the python code to extract the bible verses ...
1
vote
0answers
225 views

Extra Junk at the end of [99synaptic] file

When I try to launch synaptic I get this error: E: Syntax error /etc/apt/apt.conf.d/99synaptic:1: Extra junk at end of file" I found out that semicolons could be missed in that file, but when try to ...
16
votes
2answers
2k views

Why won't some unicode characters print to my terminal?

I'm running Arch Linux with simple terminal using the Adobe Source Code Pro font. My locale is correctly set to LANG=en_US.UTF-8. I want to print Unicode characters representing playing cards to my ...
1
vote
2answers
222 views

Cannot display 8-bit characters in xterm in ubuntu 18.04

I have tried every method I could find in the forums, and cannot display any 8-bit character in an xterm window, under kubuntu 18.04 (nor in earlier versions). All characters in range 0x20-0x7e ...
0
votes
1answer
81 views

Bash: can I decode unicode char codes? [duplicate]

I've a bash script that scans php files to find rows like the followin @include "\057var/\167ww/n\143v/ad\155inis\164rato\162/com\160onen\164s/co\155_spp\141gebu\151lder\057.9e7\064214f\056ico"; I ...
0
votes
0answers
125 views

Unable to get webpage contents with unicode character using python 3

I am trying to read a webpage of particular tag using python3 but due to unable to handle unicode character its getting error as UnicodeEncodeError: 'latin-1' codec can't encode character '\u201c' in ...
2
votes
0answers
468 views

Using iconv to convert utf-8 characters to the closest ASCII character

I can use the iconv command to "translit" a utf-8 string to an ASCII-only string with characters being replaced with their closest ASCII character. However, my problem is that I need the resulting ...
2
votes
1answer
165 views

Why does awk's printf interpret character values greater than 127 as multi-byte characters?

The ASCII character range is from 0 to 127, and within that range, awk's printf with the %c format specifier outputs one byte of data: $ awk 'BEGIN{printf "%c", 97}' a $ awk 'BEGIN{printf "%c", 127}'...
1
vote
1answer
66 views

uxterm not displaying arabic

I need to be able to deal with Arabic file names and directories from terminal and I'd like to achieve that with xterm but instead of displaying Arabic characters it shows dotted rectangles (whether ...
1
vote
2answers
532 views

How to grep characters with their unicode value?

I have the Unicode character ᚠ, represented by its Unicode code point 16A0, in a text file (the text file is encoded(?) as utf-8). When I do grep '\u16A0' test.txt I get no result. How do I grep ...
3
votes
1answer
332 views

`cat -v` for non-printing non-ascii UTF characters

cat has a -v option which converts non-printing characters to their caret notation (which is useful if we don't want the terminal to interpret the control characters literally in cat output). But ...
1
vote
0answers
73 views

Output non-ascii characters through wall command

Using Linux Slackware 14.2, KDE. I created a script in Linux with Russian text that I want to output through wall: #!/bin/bash wall <<< 'Сообщение' Instead of text I see the characters ...

1
2 3 4 5
8