My parents always told me that brain is a muscle, and just like other muscles it atrophies when unused.

But seriously though, I think that your point is well supported by research under the term "desirable difficulty".