The character-encoding tag has no wiki summary.
1
vote
0answers
30 views
Convert ASCII-8BIT to UTF-8 using OSX' .bash_profile
When running certain rails scripts in OSX' Terminal, I get warnings such as the following:
unable to convert "\xA9" from ASCII-8BIT to UTF-8 for ...
1
vote
2answers
87 views
Polish chars in gedit (Fedora 18)
I locked my Fedora18 computer (set to Polish). Later I couldn't log in (password was accepted, but I didn't see my desktop). I used pkill -KILL -u tymon command in root mode (Ctrl+Alt+f2).
After ...
2
votes
0answers
23 views
Search in evolution does not find umlaut in different encoding
I use Evolution 3.6.4 on Fedora 18 x86_64, my main language is German.
I got a mail (on my imapx account) encoded in iso-8859-15 with the word "hügelig" in it. The mail is displayed correctly in ...
0
votes
0answers
30 views
Change default Encoding in Terminator
The Title stays pretty much for itself.
Tried to figure it out myself but I can´t find a config-setting nor a option in the Preferences for the Encoding.
Does anybody know how to change the default ...
3
votes
1answer
91 views
Encoding of a zip file
When I extract some file (mp3) with japanese or korean characters within its filename on Windows, they appear normally, but when I extract it on Linux (Ubuntu/Mint) they appear as something like this
...
4
votes
2answers
110 views
What would break if the C locale was UTF-8 instead of ASCII?
The C locale is defined to use the ASCII charset and POSIX does not provide a way to use a charset without changing the locale as well.
What would happen if the encoding of C were switched to UTF-8 ...
4
votes
2answers
90 views
Same file, different filename due to encoding problem?
I was about to diff a backup from it's source to manually verify that the data is correct. Some chars, like åäö, is not shown correctly on the original data but as the clients (over samba) interpret ...
0
votes
0answers
76 views
Square instead of characters
I've just installed Sabayon, but after the update and reboot I saw every character as a square, in every programme, so is impossible for me doing anything, what could be and what should I do?
1
vote
1answer
239 views
How can I change locale/encoding to avoid getting weird characters in terminal?
I have installed tree on my ubuntu box, when i connect to it from Putty and I launch tree i get this :
$ tree
âââ html.vim -> xml.vim
âââ js.vim -> xml.vim
âââ xml.vim
instead of this :
$ ...
3
votes
1answer
130 views
Encoding Problem: Qt Apps delete all non ASCII chars from files
Qt applications are deleting non-latin characters from ISO-8859 encoded files on my Gentoo system. Actually I'm trying to merge two German files with KDiff3 and P4Merge (making "Whlen" out of ...
2
votes
1answer
162 views
How to get rid of special characters in the output of make on centos
I installed centos6.3. When I run gcc, it outputs errors but the function names are surrounded by special characters like this
‘setup_connection’:
This same is repeated with variable names. I ...
1
vote
1answer
110 views
UTF-8 works in gnome-terminal only after selecting already selected encoding
Running Centos 6.3. In gnome-terminal UTF-8 works, but only after I've chosen (the already chosen) UTF-8 encoding in gnome-terminal settings.
How do I force gnome-terminal to respect its own encoding ...
6
votes
2answers
187 views
How to replace all percent-encoded UTF-8 substrings with plain UTF-8 text?
I've got a html file with a lot of %-encoded UTF-8 text in URLs.
For example "%D1%80%D0%B5%D1%81%D1%83%D1%80%D1%81%D1%8B" stands for "ресурсы" ("resources" in Russian).
The task is to replace all ...
2
votes
2answers
909 views
Bash/Korn shell script edited on Windows throws error '…^M: not found'
Some background on the issue:
I am new to scripting and wrote a simple Bash script in Windows using Notepad++.
cxStopAllServicesOnSERVER.sh
#usr/bin/bash
cd "/some/path"
echo "Hi. Logs can be found ...
7
votes
2answers
518 views
Why are wc -m and wc -c different?
As a C programmer, I was surprised to see that wc -c (which count the number of bytes), and wc -m (which counts the number of characters) output very different results for a long, text file of mine. I ...
7
votes
2answers
1k views
Effect of $LANG on terminal
I'm trying to learn how the $LANG variable behaves with gnome-terminal (and its character encoding preference option). I've been using iso8859-1 (latin1) as my main character-set and all my filenames ...
3
votes
1answer
196 views
tr not replacing apostrophe
I want to convert all apostrophes in this file to X:
Bob's book
Bob’s book
Bob′s book # (Might look the same but actually different)
The first apostrophe is replaced as expected:
$ cat file | tr ...
1
vote
2answers
148 views
How do I set the mysql server character set in FreeBSD 8.2?
My mysql server's current server character set is latin1. My server is started on startup via rc.conf setting mysql_enable="YES". How to set my server to use utf8 as the server character set?
0
votes
1answer
948 views
Script failing with “command not found: ^M”
When I try to run the following script in zsh, via the command /bin/zsh ~/.set_color_scheme.sh I get the following error:
command not found: ^M
The script has u+x permissions and it used to work on ...
0
votes
0answers
120 views
DP: Apache Web Server character encoding [closed]
I'm double posting because I think U guyz may have a clue:
http://serverfault.com/questions/423663/apache-web-server-character-encoding
10x
2
votes
2answers
97 views
Is it possible to add CP-1252 support to CentOS?
We have a CentOS backend running server software that is processing files generated by our clients. Many of our clients are Windows users, and generate these files on their Windows machines in the ...
1
vote
0answers
119 views
Force mysqldump encoding
I have two mysql servers, viewed from the same mysql client, right_server is rendering the french characters correctly, wrong_server is not. Encoding is the same :
$ mysql -h right_server -NBe "SHOW ...
6
votes
2answers
1k views
Printing decimal to ascii character, my command does not output as intended
I wanted to output a string of all the ascii characters with the following command
for i in `seq 32 127`; do printf "%c" $i; done
The output of the above command is:
...
4
votes
1answer
303 views
opendir and readdir encoding strings behind my back?
(You can skip the details to the last couple of lines if you're able to answer the question :) )
I'm on an Ubuntu 12.04. I'm trying to resolve an old issue that I've posted about in the past (if ...
3
votes
1answer
288 views
How to fix diacritics in PDF forms in Evince?
I happen to live in Czech Republic and we have such letters like ě, š, č, ť, etc in the alphabet and use them everywhere, including addresses. Today I was filling a PDF form in Evince and noticed that ...
1
vote
1answer
243 views
Is Native Language Support (NLS) kernel support still necessary?
Does ext4 / cifs system need kernel NLS support ? I'm not sure if it's being handled by user-space program (decoding / encoding) ?
9
votes
3answers
1k views
Understanding Unix file name encoding
I have a hard time understanding how the file name encoding works. On unix.SE
I find contradicting explanations.
File names are stored as characters
To quote another answer:
Several questions about ...
2
votes
1answer
1k views
How to fix Russian letters in a Wine application when adjusting LANG does not help?
An application with a Russian UI shows question marks instead the most of its text (some elements are rendered ok though).
The system locale is English (en_US, en_IE), I've tried Ubuntu ant XUbuntu ...
2
votes
1answer
320 views
File name encoding wrong in KDE, but correct in GTK/tty1/
I'm on a new Linux (installed yesterday). When I access files from old partitions their file names have incorrect encoding (ä instead of ä, same for other umlauts) inside KDE apps like dolphin and ...
2
votes
1answer
141 views
Qt based apps have wrong encoding?
I have Ubuntu 11.04. Yesterday I installed VirtualBox and the encoding was wrong (I couldn't read anything). I know its UI very well so I tried changing the UI display language but it didn't work as ...
2
votes
2answers
1k views
terminal: non-english characters
I used to be able to copy&paste (or type if I load respective keyboard layout)
any kind of characters (eg. é ö ñ ß و 好) in my console/terminal.
Now I bought a new computer and it does not work ...
2
votes
1answer
489 views
file, awk and iconv to automatically adapt tex-file encoding
I have a set of tex-files with mixed encodings, e.g. (subset of output of file -i *.tex)
f1.tex: text/plain; charset=utf-8
f2.tex: text/plain; charset=utf-8
f3.tex: text/x-tex; charset=us-ascii
...
3
votes
1answer
960 views
Why do some characters show as squares in Chrome?
For example in the dev tools I get something like:
Some of these squares are at the end of lines, initially I thought they were carriage returns but it turns out they aren't.
Also, squares appear ...
0
votes
2answers
669 views
Terminal Character Encoding Issue BitchX
I ran BitchX on three different Linux OS-es because I got this weird � (question mark) on two of them (Linux OpenSUSE 11.4 and BackTrack 5 R1) using yakuake/konsole (OpenSUSE) and terminator/tilda (BT ...
3
votes
1answer
617 views
How to use grep/ack with files in arbitrary encoding?
On my Linux desktop I have a UTF-8 locale. When I try to search some KOI8-R encoded files with grep (ack), it fails. If I manually encode the pattern into KOI8-R and pass that as an argument, it ...
3
votes
2answers
743 views
Font encoding in Terminal
I have a problem with my font encoding in terminator
When I first lauch it and then launch vim nerdTree the small ▸ are displayed well.
But if I quit vim and then type reset in my terminator they are ...
1
vote
1answer
499 views
TUI interfaces not displaying correctly
I have an Ubuntu 11.04 server on Amazon EC2 which cannot display TUI interfaces correctly, like on Midnight Commander or tree.
I'm quite sure that this problem was not there when I set it up, and I ...
1
vote
2answers
1k views
Set Gnome terminal's default charset to utf8
Currently, I opened my gnome terminal and the default charset is gb2312.
How can set the default charset to utf8 in Gnome terminal?
I checked the preference setting but seemed not to find it.
...
4
votes
1answer
471 views
How to produce a file encoded in Mac OS Roman
Inside a bash script I have a line that creates and then inside a loop, append strings to a text file, something like
echo $myTextString >> file.txt
I need this final file to be formatted ...
5
votes
2answers
677 views
working with filenames in a different encoding over ssh
I'm ssh'ing to a remote system where a different encoding for the filenames (and for the users' locales) has been used. And this causes some problems.
Problems solved by matching the locale settings
...
2
votes
2answers
288 views
Remove copyright symbol
I'm trying to parse a RSS feed on the command line. The code works so far but the feed contains a copyright symbol which I try to remove (it is latin1 encoded). How do I remove the copyright symbol ...
4
votes
3answers
1k views
Most common encoding for strings in C++ in Linux (and Unix?)
For creating a C++ program that is source code level portable between Windows and Linux and handles internationalization well, there are IMHO three main encodings to consider:
The encoding of the ...
7
votes
2answers
306 views
Does OS X have its own line format?
Obviously there are at least two newline types: DOS and Unix. But does OS X have its own plaintext 'format'?
I opened a text file in nano and was surprised to see: [ Read 26793 lines (Converted from ...
14
votes
2answers
5k views
How can I set VIM's default encoding to UTF-8?
I'd like to contribute to an open source project providing translated strings. One of their requirements is that contributors must use UTF-8 as the encoding for the PO files.
I'm using VIM 7.3 on ...
3
votes
4answers
1k views
How do I re-encode a mixed encoded text file
I've got a log file that is ASCII, except for a few UTF-8 characters (which I can fix for a future version).
For the moment, I need to figure out how to get this file to a ...
4
votes
4answers
1k views
How to convert hex chars to normal chars?
I tried, but I'm stuck at "escaping" the "sed's":
sed -i 's/\\x0/NUL/g' $1
sed -i 's/\\x1/SOH/g' $1
sed -i 's/\\x2/STX/g' $1
sed -i 's/\\x3/ETX/g' $1
sed -i 's/\\x4/EOT/g' $1
sed -i 's/\\x5/ENQ/g' ...
6
votes
1answer
2k views
How to fix character encoding in bash (arch linux)
I have some issues with the encoding of german umlauts in bash.
It mostly is working fine, but when i am typing a invalid command, the error message generated by bash contains strange escape sequences ...
2
votes
1answer
161 views
XML text file with `^@` characters in it?
I have an XML file that I need to parse. When I open it in nano, nano give me the message (converted from Mac format). However between each character, there is a ^@ sequence, like so:
^@t^@h^@e^@ ...
1
vote
0answers
149 views
How to configure character encoding in OpenFT?
When transferring files over:
http://ts.fujitsu.com/products/software/openseas/openft.html
then the charset of files get's scrumbled...I can't seem to find any character encoding settings, how to ...
4
votes
2answers
1k views
special character in filename (\#033OA)
I've got a slight problem with a very stubborn error during an rsync. It's caused by a file with a special character in its filename. There's been others but I could sort that out by doing some ...
