It doesn't take Phil long to realize Clint's talking about Loki. Thor he knew fairly well and knew he respected humans. He doesn't seem them as lowly or creatures anymore. He sees they're worthy. Phil knows that from how Thor treats every person around him.

He thinks the worse and hates Loki even more for it. If he put his hands on Clint... if he...

Well, Loki's simply lucky he's on Asgard.