You can do this with AutoCorrect.  Access it with Proofing tab on Word Options and then the AutoCorrect Options… button.

From the AutoCorrect dialog box and the AutoCorrect tab, make sure that Correct accidental usage of cAPS LOCK key is checked.

That should do it.