Questions tagged [unicode]

Unicode is a computing industry standard for the consistent encoding, representation and handling of text expressed in most of the world's writing systems.

Filter by
Sorted by
Tagged with
1 vote
1 answer
25 views

Fontawesome icons are not pasted correctly

I am using Fedora and installed fontawesome via sudo dnf install fontawesome fonts. Later because it didn't work I also additionally installed the font manually via downloading the zip from the Github ...
Sinthoras's user avatar
2 votes
0 answers
58 views

How do I disable UTF-8 in an xterm (or X, really)?

I have a system running Debian unstable where I don't want to have UTF-8 in my xterms (or at all). But I recently discovered that somehow I now have UTF-8 in my xterms and other windows. It might have ...
ftpltl's user avatar
  • 21
0 votes
0 answers
33 views

ls: single-column vs. multi-column layout, non-Unicode characters in filenames

Create a directory ~/test with abcdefghijklmnopqrstuvwxyz and zyxwvutsrqponmlkjihgfedcba files in it. ls ~/test will list them using multi-column layout: abcdefghijklmnopqrstuvwxyz ...
jsx97's user avatar
  • 181
2 votes
2 answers
77 views

Search and replace composed Unicode characters

I have a deep folder structure on a Debian machine where the directory names and the filenames contain some "special" characters (ä,ö,ü).  However, these are not in "ISO-8859-1" ...
rockZ's user avatar
  • 749
3 votes
1 answer
98 views

'ls name' and 'ls | grep name' with accent different

I am on Xigmanas (NAS freebsd). I'll explain the situation as simply as possible: :; set | egrep 'LC_A|LANG' GDM_LANG=fr_FR.UTF-8 LANG=fr_FR.UTF-8 LC_ALL=fr_FR.UTF-8 SLIM_LANG=fr_FR.UTF-8 :; ls -i ...
Dhénin Jean-Jacques's user avatar
0 votes
0 answers
53 views

Terminal: Help understanding behavior with UTF-8 text

I am trying to understand the following behavior I am observing on my Ubuntu system. Consider the following two files: $ hexdump -C 1.txt 00000000 d9 82 d8 a8 d8 a7 d9 86 d9 8a 5e d9 84 d9 86 d8 |.....
malat's user avatar
  • 3,032
1 vote
0 answers
16 views

XQuartz xterm UTF-8 resource name

I was using UTF-8 resources names like these ones: wengé*Background: #321 wengé*Foreground: #ffb and this was working with XQuartz 2.8.1 through this direct call like from within the ...
dan's user avatar
  • 933
0 votes
0 answers
39 views

Make GNOME Characters use different emoji font?

How do I configure which emoji font GNOME Character app uses? Currently it's using Noto Emoji Color. GNOME 45.3 Arch Linux
01AutoMonkey's user avatar
1 vote
1 answer
29 views

Crossmark symbol (\u274c) doesn't work in debian 12

I have moved from Ubuntu 22.04 to Debian 12, I have a bash function that outputs crossmark if command failed and checkmark if command succeed. The checkmark works, but the crossmark doesn't. Here is ...
Liso's user avatar
  • 131
0 votes
1 answer
84 views

What puts the terminal in Unicode mode?

I have a Debian server which is not properly displaying Unicode characters when logged in locally, without starting X11. Unicode works after running unicode_start (until the terminal is closed). It ...
Fadeway's user avatar
  • 111
1 vote
1 answer
35 views

How to use unix `mv` to rename files with unicode spaces(not U+20)?

$ ls cn* cn blah blah.txt $ ls cn\ * ls: cannot access 'cn *': No such file or directory $ ls cn*|hexdump -C 00000000 63 6e e2 80 85 62 6c 61 68 c2 a0 62 6c 61 68 2e |cn...blah..blah.| 00000010 74 ...
Remi Arntzen's user avatar
4 votes
2 answers
178 views

Why is ls sorting Chinese filenames by length?

I've run into a bit of a weird behaviour that I don't fully understand with ls and Chinese filenames. I'm running macOS 13.6.1 with SIP enabled (no core OS modifications), MacPorts installed, and US ...
nneonneo's user avatar
  • 1,098
2 votes
1 answer
317 views

Can awk be told to count the character string length rather than byte string length for '%10s' printf formats?

Try this for an output of |Ü| X|: echo 'Ü X' | awk '{printf("|% 2s|% 2s|\n", $1, $2)}' Obviously awk counts the byte length, not the character length of the Ü, so the count is 2 and no left ...
Harald's user avatar
  • 898
0 votes
2 answers
83 views

groff -mandoc creating "ESC[1m" versus overstriking with backspace for bold text

I found that groff uses different ways to indicate bold text for the utf8 output format. On FreeBSD 14, groff emits escape codes for a terminal (ESC, [1m): $ printf ".Dd today\n.Sh NAME\n" | ...
Jens's user avatar
  • 1,762
0 votes
1 answer
98 views

Why is MB_CUR_MAX 6 instead of 4 for UTF-8? (Linux, glibc)

MB_CUR_MAX is defined by glibc as 'a positive integer expression that is the maximum number of bytes in a multibyte character in the current locale.' If I print the value I get 1. I assume that this ...
Sebastian Carlos's user avatar
0 votes
2 answers
156 views

I need to create a pipe to convert string from UTF-8 to UTF-7-IMAP

To automate the command line creation of hundreds of directories in IMAP maildirs, I would need to be able to convert UTF-8 strings to UTF-7-IMAP on the fly. In php, I found a way to do it with a ...
Chris972's user avatar
0 votes
2 answers
111 views

Listing filenames with special characters

I have a zsh shell (with oh-my-zsh default config). Why I ls filenames with special characters, they are printed as: ''$'\316\262''=0.35-L=32-m=10.jld2' This should be: β=0.35-L=32-m=10.jld2 but the ...
a06e's user avatar
  • 1,727
1 vote
0 answers
39 views

Debian terminal not displaying correct Unicode half-block characters [duplicate]

I have a program that prints Unicode half-block characters (U+2580, U+2584), but on Debian 10 terminals (just the fullscreen terminal, no X), it's printing diamonds instead of half-blocks. The two ...
Jason C's user avatar
  • 1,383
0 votes
0 answers
62 views

Ctrl-Shift-U requires *extra* U in Ubuntu 23.04 Cinnamon?

I'm running a new install of Ubuntu 23.04 with cinnamon desktop 5.6.7 Typing Ctrl-Shift-u in a terminal does nothing unles the next character is another u; then the underlined u appears and I can ...
jimav's user avatar
  • 111
0 votes
0 answers
34 views

How to rename a one file name with another file part name in the same directory?

the database I am using is Unix and I am trying to automate where I want it to rename the file for me when I run it instead of me going to file and manually rename it. For example. Two files in the ...
Mawuko's user avatar
  • 1
0 votes
2 answers
494 views

Entering special characters the same way on Windows and Linux

ctrlshiftu followed by the hex value of a Unicode character enters that character. For example, ctrlshiftu41 enters 'A', whose value is 0x41 in hex and 65 in decimal. There's also the compose key, ...
glibg10b's user avatar
  • 351
1 vote
1 answer
62 views

Expand tabs in file with utf8 characters

I use expand to expand tabs to spaces. For utf8 files expand doesn't work correctly. E.g. in ć\ta tab is expanded to 6 spaces while in a\ta to 7 spaces. How do I make it work for utf8 files?
Marcin Król's user avatar
-1 votes
2 answers
60 views

Is ∞ allowed in UTF-8 Encoded files?

Are lemniscates, ∞, allowed in UTF-8 Encoded files? I am hoping that students with less than six months of computer programming experience can use a search engine to type something like "is ...
Samuel Muldoon's user avatar
2 votes
2 answers
115 views

Unicode Supplementary Multilingual Plane (Plane 1) glyphs in xterm

I'm trying to display Unicode Supplementary Multilingual Plane (Plane 1) glyphs in xterm. Those glyphs are in the U+010000..U+01FFFF range (https://unifoundry.com/pub/unifont/unifont-15.0.01/...
grrr's user avatar
  • 53
7 votes
1 answer
2k views

How should I interpret the fact that a Unicode code point is shown in two completely different ways in two different terminal emulators?

This is kind of a spin off from an older question I asked. Here's the screenshot from that question: In the bottom left is URxvt, and you can see a lighting bolt-like icon at the beginning of the ...
Enlico's user avatar
  • 1,616
4 votes
4 answers
334 views

Collect chars from strings and print their unicode

Context (skip, if you don't care; read, if you suspect I'm totally on the wrong track) For an embedded system with small memory, I want to generate fonts which contain only those glyphs actually ...
Philippos's user avatar
  • 13.5k
1 vote
0 answers
66 views

Pasting non-ascii (utf8) into remote urxvt terminal

For pasting text, in urxvt/rxvt-unicode one can use middle button to paste PRIMARY selection. I can do such Mouse-Middle-Click paste in my local urxvt terminal and even a remote server, in Chinese/...
xpt's user avatar
  • 1,560
0 votes
0 answers
187 views

Script for awscli check not working with crontab schedule

I have written a small code snippet to check the aws cli version #!/usr/bin/env bash if [ -e "/usr/local/bin/aws" ]; then myAWS="/usr/local/bin/aws" else ...
AashkaTe's user avatar
8 votes
3 answers
2k views

Box character doesn't display properly in Linux terminal

I was just writing a C++] program that uses the box characters to display information.  I ran the program on macOS and used the terminal app and it worked fine. When I switched to Debian Linux using ...
sherbit fish's user avatar
2 votes
2 answers
413 views

How to combine settings from multiple locales in Linux?

When I installed Linux I set my locale to en_US.UTF-8. However I want to override some but not all of the settings in that locale. Specifically, I would like the Measurement to be Metric instead of ...
bch6595's user avatar
  • 21
0 votes
1 answer
56 views

Command similar to ascii for ascii extended and/or for unicode?

ascii command in Linux is fast and great. It allows us to search for a character or for a code point and returns all relevant results for a given search. Is there something similar for ASCII extended (...
demacj's user avatar
  • 3
4 votes
1 answer
232 views

How do I create a zip that preserves unicode character composition on linux?

I'm on Debian. I have a file called Sóanr.jpg. According to https://emojidissector.com/, this is made of the following code points: S 0053 LATIN CAPITAL LETTER S o 006F LATIN SMALL LETTER O ...
bennlich's user avatar
  • 143
1 vote
3 answers
80 views

Writing bash arguments with trunctation

I want to print the first two arguments of a bash function, with the unicode character \u2263 on each side using a two space separation. The thing is that the final unicode must display at column 70. ...
Vera's user avatar
  • 1,223
3 votes
1 answer
256 views

Different encoding/Unicode interpretation using terminal vs using shell script

I was working on a keymap script (map keys from one language keyboard layout to another). And after a lot of hard time trying to get everything working I found out that different characters are ...
Andrew15_5's user avatar
3 votes
0 answers
151 views

Unnormalized UTF-8 directory names

I noticed something interesting in one of my directories: $ ls -li total 36 2625309 drwxrwxr-x 2 dotancohen dotancohen 4096 Jul 4 2022 Español 2625385 drwxrwxr-x 2 dotancohen dotancohen 4096 Jul ...
dotancohen's user avatar
  • 15.9k
0 votes
0 answers
96 views

Is there a way to remove specific emoji from being rendered in any application while using Cinnamon desktop?

I am slightly annoyed with some emojis. So I was wondering, how could I remove/prevent some emojis from being rendered at all? Replacing them with some other emoji like cute cat face could work too. ...
user avatar
0 votes
1 answer
70 views

testdisk utility reports nonexistent files from a exFAT drive used with Windows - why?

I tried to recover lost files from an exFAT thumb drive with the testdisk package on linux. It was very good at finding deleted files. However as I went through the entries, I saw weird entries. The ...
ero47543's user avatar
1 vote
0 answers
33 views

Cannot use unicode shortcut on non-english layouts

I’m using US and RU layouts, and while I can use Ctrl+Shift+u, when I have US layout selected, when I try to use it with RU layout selected, it just doesn’t work. Didn’t find anything related to it in ...
Sebekerga's user avatar
1 vote
2 answers
436 views

Looking up and Inputing arbitrary unicode characters in console/terminal

I'm looking for a simple, generic way to input arbitrary unicode characters in a text document on the terminal(e.g. in a terminal editor). A basic method I can imagine is having a simple text(utf-8) ...
Charles Langlois's user avatar
3 votes
3 answers
416 views

My bangla keyboard layout does not match the physical keyboard

Steps: Settings > Region & Language > Add Bangla to Input Sources selected bn. Here, is the gkbd-keyboard-display -l bn output. In LibreOffice Writer, when I work with bangla fonts ...
Ahmad Ismail's user avatar
  • 2,678
1 vote
1 answer
393 views

Remap Keys to output Unicode characters

My goal is to typeset mathematics/physics more efficiently and more readable by remapping my keys to use the proper Unicode symbols. Therefore, I want to remap my keys, such that pressing Alt Gr + ...
Sinthoras's user avatar
10 votes
1 answer
603 views

What value for LANG should I use for "sort -u“ correctly handle Chinese characters?

The context Issues found Issue no. 1 Issue no. 2 Issue no. 3 The question The context Today, I wanted to keep the unique lines in a file containing Chinese characters. I decided to use the sort ...
rdrg109's user avatar
  • 211
6 votes
1 answer
612 views

How to find directories with 4-symbol unicode characters eg `<0328>`

While backing up my directories, the ones with names containing Polish characters like ę, ą, ż, ź, etc got "duplicated". When I do ls -al I get response like: drwxrwxr-x+ 310 root users ...
neciu's user avatar
  • 193
2 votes
1 answer
107 views

Is my text mangled beyond repair?

My mangled Czech text: NOTE ON CZECH BIRTH NUMBER VALIDATION IN CZECH LANGUAGE; in Czechia birth number = personal identification number ======================================================== Do ...
Vlastimil Burián's user avatar
3 votes
1 answer
393 views

How to find (and rename) files with invalid characters (Latin1) on UTF-8 system?

I've got some old files from a Latin1 based system with names that are invalid on my UTF-8 system. They show as various codes or question marks. For example: /tmp/test $ ls -1 'FRg_Pause lecture_'$'\...
MLu's user avatar
  • 2,100
2 votes
0 answers
144 views

XTerm: Bitmap font for ASCII, TrueType font for Unicode

I would like to display Chinese characters in the console, with TrueType fonts and normal characters in Bitmap fonts. So far, I have succeeded in displaying: ASCII TrueType, Unicode TrueType (via ...
xascii's user avatar
  • 21
9 votes
1 answer
1k views

interpret \UXXXXXXXX Unicode codes in text file

I have the following file : $ cat test Villes visit\U000000e9es How can I interpret those \UXXXXXXXX codes, e.g. how can I get : $ cat test | pipe into something Villes visitées
ChennyStar's user avatar
  • 1,745
-1 votes
1 answer
1k views

How to change wsl 2 kali linux non-UNICODE terminal character encoding to UNICODE terminal character?

I am trying to use Airodump-ng in WSL 2 KALI LINUX and they give me the the following warninig: Warning: Detected you are using a non-UNICODE terminal character encoding when I type $locale charmap, I ...
Martin Armand's user avatar
3 votes
1 answer
587 views

used awk to search by unicode in txt file

How i can used awk to search in txt file by unicode like : u+064C u+064D and please how i count results and print the number in first line.
alomndo's user avatar
  • 33
1 vote
2 answers
211 views

Remove all characters from string, except specific multibyte range

How would one use sed or another tool to remove all characters except a specific multibyte range? For instance, the range \xd8\xa0 - \xd9\x8a covers Arabic characters encoded in UTF-8. This was my ...
dotancohen's user avatar
  • 15.9k

1
2 3 4 5
10