You could have a point if that was the main reason people don't want him.
But it could be because he's not a very good HC, on top of acting like a spoiled petulant juvenile. If his dad wasn't Monte he'd never of landed the Raiders or Tennessee job in the first place. Even when he was here he never bought into UT's traditions or maxims. Just tried to make us the USC of the south until he could finally get back to USC. Then once he got his dream job he ended up being unceremoniously fired. Once again landing a job not based on merit.
Now he has been a good OC and maybe coaching under Saban for a few years made allowed him to develop into a better HC. At least he is finally having success as a HC, unlike his last three attempts. Then again, it is just the C-USA where he can a be a big fish in a little pond.
But I don't doubt he would like to come back. Not like he's wanting to stay a FAU longterm. Just don't see where one year of success in his career and at that level would equate to having success in the SEC. Not to mention I'm sure he'd just be trying to climb the ladder again waiting for a better opportunity at first chance.