Yale has won a NCAA tournament game for the first time in the school's history.
The Ivy League champs led by as many as 13 in the second half before having its lead cut to 1 point.
A late turnover by Baylor helped Yale secure the victory of 79 to 75.
Yale advances to play Duke in the second round. The two teams met in November with the Blue Devils winning by 19.