If your meaning, as you stated, is that you already have most of the information, "started to receive" doesn't make sense. Say "We have received most of the information ...".
If you want to use "started to receive", say something like "We have started to receive information from the client. We have most of what we need".