Help! Will these brownies taste like olive oil after they're baked?

You could have used the Crisco oil (as long as it's a liquid and not a solid), but your brownies should be ok with the olive oil. I doubt 1/4 cup will make a difference with such a strong flavor like chocolate.