In a very nonchalant way I would say almost as an aside not even really looking at him:
"You know Saban's had a really incredible run at Alabama. I figure after he leaves the TN-AL series goes back to TN winning 10 out of 12 like it was just before he got there. That'll last for about a decade or so and then the series'll probably flip again."
At that moment I'd want to excuse myself (very proper-like) to go to the restroom or something, just anything to leave him hanging so he could think about that for a few minutes. When I got back from the restroom I'd come walking up while talking on my phone, "sorry, family emergency, gotta run." Hand him some money and say, "can you take care of the check? Great. Appreciate it." Then leave.