Should you ever take more rest and recovery than one day off a week?

Rest and recovery IS important. But should you ever take more rest and recovery than one day off a week? Or can longer rest periods totally derail you?