I've always though that Harlequin Ichthyosis was the worst primarily because it affects newborns and almost always kills them. It's a nightmare to see (I don't recommend looking for pictures on the Internet). However, for adults, one of the worst is Scleroderma which can actually lead to death.
Source: 10 Deadly Skin Diseases
Source: 10 Deadly Skin Diseases