As Davy said, the phrase "that daughter of yours" is usually only used when something critical is being said. Even among parents, when one of their children misbehaves, the father knows something is wrong when he comes home from work and his wife greets him with "Do you know what that son of yours did today??"
