As I recall,
^H means Backspace. I generated it by pressing CTRL+V, CTRL+H.
^H should remove the last character, as it is the same as Backspace and it should act just as if I pressed Backspace at this position.
Why the does the output of
echo abc^H remain
abc and not