Fewer. You can count the number of items, so it should be fewer.
One day, I remember going into the store I usually shopped at, and saw that they had changed from "or less" to "or fewer" and I was so happy. The man I was dating at the time didn't see the big deal at all. I broke up with him.