what does"Be the death of somebody" mean?

I ran across this sentence in a song, in which the line "because I'll be the death of you" has been confusing me a lot while I was translating this song into our mothertongue...and I've once asked some native English speakers about what it really means, but I got different explanations from different people, some say, it means I'd die for you because my love for you is really deep while some say that I'm driving you mad and let you pay the price for what you'd done to me, I guess they are entirely 2 different explantions about this sentence, so I'd be most grateful if I could get your help here.. thanks for your kind reply in advance:-)

the context:

You take the breath right out of me.
You left a hole where my heart should be.
You got to fight just to make it through,
'Cause I will be the death of you.

It means to exasperate somebody to an intolerable degree.

Although, I should add, that's what the expression normally means. In these song lyrics it seems to be taken literally.

'Cause I will be the death of you. = 'cause I will really get to you.'

ok i get it, thanks