The peppers will go from softened to mushy if they sit too long; you want to serve them with some bite left.