The first rule in Linux:
Always use the package manager to install software. Do not download any rpm/deb and install manually.
If you install the *.rpm file by command rpm, you can uninstall in this way:
rpm -e libgomp
# As I have stated in other post, I don't think you need gcc. Please double check before you proceed.