But the younger Olsen, 23, is now getting used to having the attention on her.
"I grew up knowing that everything that was written was fake and so I don't even read any of those things," she tells ET Canada. "So, for me it’s just not part of my life. I don't want it to be part of my life."
Recently, the rumor mill has linked Olsen romantically to True Blood star Alexander Skarsgard, but the actress is remaining mum on the subject – sort of.
"The one time I make it part of my life and you have a conversation with someone, you're just like, 'Okay, well, I guess talking to people is not a [relationship],' " Olsen said.
So is there a special guy in her life?
"You know, I hung out with Tom Colicchio for 20 minutes," she quipped.