For the first pair, I'd use "are" ( or "a cookie").
For the second, you could use either. "What" takes is, but it's not unusual to be thinking about the plural.
Strict grammar may require "is" but I'd never notice an "error" if you used "are."
- For Teachers