The definition of a nanny is someone who looks after children in their own home, I'd say. You could say it's difficult to find a child care provider, which is a neutral term that covers care in your home, someone else's home, or in a child care center.
I'm having a hard time finding a nanny.
I'm having a hard time finding someone who will watch my children in my home.