Let sit until sweet peppers are slightly softened, 10–20 minutes.
Just before serving, toss herbs and oil with sweet pepper mixture.