1520s, "at proper times," from regular + -ly (2). Meaning "in accordance with rules" is from 1560s.
regroup
regrowth
regular
regularity
regularize
regularly
regulate
regulation
regulator
Regulus
regurgitate