Why does physisorption decrease with the increase of temperature?

As Physisorption is Exothermic in nature, which means when gas gets adsorbed on the solid surface, Heat is evolved. So, according to Le-Chatelieres when the temperature is an increased reverse process (Desorption) will be favoured. So, Physisorption decreases with the increase of temperature.