What am I?

A time when they're green, a time when they're brown,
But both of these times, cause me to frown.
But just in between, for a very short while,
They're perfect and yellow, and cause me to smile!
What am I talking about here?