Is it safe to turn off the HRV through the breaker switch?

My heat recovery ventilator is constantly on and it doesn't have a setting on its remote panel that would allow me to idle it (should I feel that its operation is not needed). Anyway it is also located in the utility room and it would be inconvenient for me to pull its power cable out each time I'd want to turn it off temporarily. So my question is can I safely use the breaker switch (i.e. shut off the power to the connector that supplies the HRV) on my main electric fuse box to cut off power to the HRV when I don't want it to run? Is there any risk of damaging the HRV electronics/mechanics/components (or even my electric fusebox itself) over the long term by turning it on or off through the fusebox breaker switch two or three times per day on a regular basis?