[Oliver frowned a bit deeper, trying to decide if he should tell her. He should be honest, yes, but if Felicity didn't remember this at all, would a lie hurt?]

You were uncomfortable with having me keep things from you and there were some other things that I don't know that I should tell you about. I don't want to burden you, Felicity, or give you knowledge of things you have no emotional context for.