That's difficult to answer, because A's statement is rather unnatural. A would probably say 'I haven't got much money with me'. However, if we take the slightly more natural, 'I have very little money with me' the response is 'Neither have I'A: I have only little money with me.
B: So do I.
Retired English Teacher