Your example is grammatically correct, but it has a major problem. The expression "to talk badly with" is so unnatural as to be meaningless. Perhaps you meant "argued with my brother" or "fought with my brother." On a lesser point, it would be more natural to say "My dad would get (or become) very angry." However there is no problem at all with the way you have linked the two conditionals.
Student or Learner