This is my situation almost exactly. I've been a doula for 10 years with the help of my husband and mother. My children were small it was really hard. In recent years, I have 4 homeschool kiddos and had to take the last year off to plan my highschoolers years. I'm slowly getting back into the swing of things, but only taking 1 client a month if that.For me personally, it is limiting the number of births I attend in this season of my life. I am homeschooling 7 children, the oldest about to graduate! I haven't advertised alot because I have gotten clients word of mouth or on the website that my name happens to be on.
I do have teens so they can take care of the younger ones when I'm at a birth. My husband always brings the nursling up to the hospital (I mostly do hospital births) and it always seems to work out. I have never been able to bring my baby to a hospital birth, but certainly at home.
My clients know going into a birth that I will do all I can to attend their birth barring any emergency. So far, I haven't missed a birth yet! Limiting the births to a couple a year is not so exasperating to my family either.
You certainly did the right thing, IMO. We are only human and our family still must come first :-)