I still don't think the losing season was the end. I think it was everyone seeing Cutcliffe come back, watching Tennessee's offense suddenly revive, and then watching it fall apart when Cutcliffe left for Duke. The perception became "it was Chavis and Cutcliffe that made Tennessee competitive in the 90s" rather than Fulmer. That "coach as CEO" stigma is a hard one to bear if you start losing. I mean, I guess the losing season shut the door for him, but short of getting back to 10-11 wins a year, I don't think he was long for the job after the Cutcliffe changeover.
Really, had he just not dropped two Ls that year, he would have probably made it through to the Tajh Boyd era and righted the ship. Just should have picked a better OC ... oh well.