"The Rip" star was excited to work with Eastwood on 2009's "Invictus," but it didn't go the way he thought it would.