Post Closed as "duplicate" by Isaac, shirish, agc, Kiwy, G-Man of
6 added 31 characters in body
source | link

How to deleteonly keep BMP in the non-standard utf-8 from text file?

This is the content of a text file, and I want to remove the non-standard utf-8 charactersonly keep BMP.

这是无效的字符  𡛂
这是正常的字符  哈

In the How to remove non UTF-8 characters from text file , I find there is a solution, but it doesn't work here.

iconv -f utf-8 -t utf-8 -c test.txt

enter image description here

The utf-8 of 𡛂 is F0A19B82 (located in CJK Unified Ideographs Extension B), utf-8 of 哈 is E59388(located in CJK Unified Ideographs).

If I want to delete all characters(the size greater than 3 Bytes) like 𡛂 in text file , how to do it?

How to delete the non-standard utf-8 from text file?

This is the content of a text file, and I want to remove the non-standard utf-8 characters.

这是无效的字符  𡛂
这是正常的字符  哈

In the How to remove non UTF-8 characters from text file , I find there is a solution, but it doesn't work here.

iconv -f utf-8 -t utf-8 -c test.txt

enter image description here

The utf-8 of 𡛂 is F0A19B82 (located in CJK Unified Ideographs Extension B), utf-8 of 哈 is E59388(located in CJK Unified Ideographs).

If I want to delete all characters(the size greater than 3 Bytes) like 𡛂 in text file , how to do it?

How to only keep BMP in the utf-8 text file?

This is the content of a text file, and I want to only keep BMP.

这是无效的字符  𡛂
这是正常的字符  哈

In the How to remove non UTF-8 characters from text file , I find there is a solution, but it doesn't work here.

iconv -f utf-8 -t utf-8 -c test.txt

enter image description here

The utf-8 of 𡛂 is F0A19B82 (located in CJK Unified Ideographs Extension B), utf-8 of 哈 is E59388(located in CJK Unified Ideographs).

If I want to delete all characters(the size greater than 3 Bytes) like 𡛂 in text file , how to do it?

5 added 31 characters in body
source | link

This is the content of a text file, and I want to remove the non-standard utf-8 characters.

这是无效的字符  𡛂
这是正常的字符  哈

In the How to remove non UTF-8 characters from text file , I find there is a solution, but it doesn't work here.

iconv -f utf-8 -t utf-8 -c test.txt

enter image description here

The utf-8 of 𡛂 is F0A19B82 (located in CJK Unified Ideographs Extension B), utf-8 of 哈 is E59388(located in CJK Unified Ideographs).

If I want to delete all characters(the size greater than 3 Bytes) like 𡛂 in text file , how to do it?

This is the content of a text file, and I want to remove the non-standard utf-8 characters.

这是无效的字符  𡛂
这是正常的字符  哈

In the How to remove non UTF-8 characters from text file , I find there is a solution, but it doesn't work here.

iconv -f utf-8 -t utf-8 -c test.txt

enter image description here

The utf-8 of 𡛂 is F0A19B82 (located in CJK Unified Ideographs Extension B), utf-8 of 哈 is E59388(located in CJK Unified Ideographs).

If I want to delete all characters like 𡛂 in text file , how to do it?

This is the content of a text file, and I want to remove the non-standard utf-8 characters.

这是无效的字符  𡛂
这是正常的字符  哈

In the How to remove non UTF-8 characters from text file , I find there is a solution, but it doesn't work here.

iconv -f utf-8 -t utf-8 -c test.txt

enter image description here

The utf-8 of 𡛂 is F0A19B82 (located in CJK Unified Ideographs Extension B), utf-8 of 哈 is E59388(located in CJK Unified Ideographs).

If I want to delete all characters(the size greater than 3 Bytes) like 𡛂 in text file , how to do it?

4 deleted 1 character in body; edited tags; edited title
source | link

How to delete the none standardnon-standard utf-8 from text file?

This is the content of a text file, and I want to remove the none standardnon-standard utf-8 characters.

这是无效的字符  𡛂
这是正常的字符  哈

In the How to remove non UTF-8 characters from text file , I find there is a solution, but it doesn't work here.

iconv -f utf-8 -t utf-8 -c test.txt

enter image description here

The utf-8 of 𡛂 is F0A19B82 (located in CJK Unified Ideographs Extension B), utf-8 of 哈 is E59388(located in CJK Unified Ideographs).

If I want to delete all characters like 𡛂 in text file , how to do it?

How to delete the none standard utf-8 from text file?

This is the content of a text file, and I want to remove the none standard utf-8 characters.

这是无效的字符  𡛂
这是正常的字符  哈

In the How to remove non UTF-8 characters from text file , I find there is a solution, but it doesn't work here.

iconv -f utf-8 -t utf-8 -c test.txt

enter image description here

The utf-8 of 𡛂 is F0A19B82 (located in CJK Unified Ideographs Extension B), utf-8 of 哈 is E59388(located in CJK Unified Ideographs).

If I want to delete all characters like 𡛂 in text file , how to do it?

How to delete the non-standard utf-8 from text file?

This is the content of a text file, and I want to remove the non-standard utf-8 characters.

这是无效的字符  𡛂
这是正常的字符  哈

In the How to remove non UTF-8 characters from text file , I find there is a solution, but it doesn't work here.

iconv -f utf-8 -t utf-8 -c test.txt

enter image description here

The utf-8 of 𡛂 is F0A19B82 (located in CJK Unified Ideographs Extension B), utf-8 of 哈 is E59388(located in CJK Unified Ideographs).

If I want to delete all characters like 𡛂 in text file , how to do it?

3 added 9 characters in body
source | link
2 added 6 characters in body
source | link
1
source | link