With Celsius and Farenheit, degrees are used because both measures of temperature are based on the freezing and boiling points of water as reference points.
Kelvin is an absolute unit of measure where 0K or absolute zero really means the absence of thermal activity. The difference is that kelvin is not relative to an arbitrary reference point like the Celsius and Fahrenheit scales.

