"More and more" I would treat as a phrasal adverb. It could be replaced by "increasingly".
"With his brothers", because of the commas, is parenthetical. I need to do some more study about how to diagram parenthetical elements. In actual speech, they are very common.