Which sentence has the correct punctuation?

1 We bought coffee, tea, milk, sugar

2 We bought coffee tea milk and sugar

3 We brought, coffee, tea, milk, and sugar

4 We bought coffee, tea, milk, and sugar.