There's a generalized fear surrounding bringing Freeze back in that has nothing to do with football directly. I think the conference fears that Freeze has enough skeletons to get everyone in trouble along with him. Slive didn't like Kiffin at all when he left and made very public remarks about it but after a few years he was forgiven. Same might happen for Freeze one day but IDK. For some reason, Freeze is treated by those who know him better than the rest of us as radioactive which tells me they probably think he was doing far worse than what he's been publicly accused of and beyond that they are afraid it will come out and more than just OM and Freeze would be hit.
People forget more than one school was involved in donating cash for Cam and the Albert Means mess went well beyond Bama. Most of the recruits Freeze took he took from teams like UGA and BAMA but others, including us were in on some of them.