There are three pronunciations: There's the noun buffet, from the French word meaning stool, and there's the verb buffet, from the French word bufe[/u] (blow).
Buffet, Noun (English)
1) bu-fei ('u' as in book) Standard Pronunciation
2) bu-fei ('u' as in up) Vowel neutralization