Question about switching doctors

Do I have to remove myself from my current doctors patient list BEFORE starting to look for a new doctor, or can I call around and find a doctor accepting new patients first?

I want to ensure continuity of care during the switch, with little to no time without a doctor.