If you are friendly enough with them, you can say "Could you take some of it away?", "Could you remove some?", "Just give me half that amount", "I can probably only eat half that. Please give the rest to someone else". "Take off" isn't wrong though - I just added some alternatives.