Navigate the the location below in your registry and make the corresponding change. 

The Value may need to be created.

 

Key: [HKEY_CURRENT_USER\Software\Microsoft\Windows\CurrentVersion\Policies\Explorer]
Value Name: NoInternetIcon
Data Type: REG_DWORD
Data: (0 = disabled, 1 = enabled)

 

Back to Internet Explorer Tweaks