Every point in dexterity increases your maximum stamina level. The higher your stamina, the faster you will swing with a weapon skills.