James Blake of the United States ousted Roger Federer of Switzerland in the Men's Singles quarterfinals at the Olympic Games here on Thursday.