It is too expensive for me. (I cannot afford it, so unless you lower the price I won't buy it.)
It is too expensive to me. (I don't think it is priced low enough. I would think this whether or no I wanted to buy the item.)
Which one is correct, and how are going to use to and for in this kind of sentence?
Both are correct but the meanings are slightly different as shown above.