That reaction is harder to get working than it looks, because solid magnesium exposed to the atmosphere very quickly forms a layer of magnesium oxide on the surface, the same way aluminum foil does.

What I was actually referring to is the nontrivial amount of heat released when solid NaOH dissolves.