your little girl will let you know wether is a good or bad idea, if she starts going and reacts negative, ie. she cries when you take her and give you stress at home, means you should stop, but that is unlikely, I think you will see that she will be eager to go and play with her little friends.
Hope you take the best option for her, I know you will and she will help you decide.
And about your hubby, ask him to stay taking care of her all weekends long until he agrees (lol

)