I run 32 bit Centos 6.9 Linux with installed development tools for it with command:
yum groupinstall 'Development Tools'
But it installs very old GCC and GDB. What is the best way to install newer tools supported by my system?
You should never replace the packages in the base repositories, however, you can get newer compilers and development tools out of Software Collections. They install alongside the OS packages.