Changing to the Explorer Icon

This has been bothering me for the longest time on my computer, and I don’t understand what happened to make it show up this way…

You know how you see an icon for a file in your folder…(my documents folder or whatever)…There’s an icon to show it’s a photoshop file, there’s an icon to show that it’s a microsoft word file, and ect.

Well, my Explorer icon is not showing up to my html files. Instead, that annoying icon that appears when you have to choose a program from a list appears. It still opens in explorer, but the icon doesn’t show up to tell you that. It’s really annoying. I’ve tried everything, but I can’t seem to find the problem.

Does anyone know how to fix this? I’d appreciate it.