I've never been to LSU or Bama, but I thought the exterior of Neyland was kind of cool. Our stadium (Michigan) is built into the ground and only now with the renovations will be an imposing structure. Neyland is larger than life, and was cool walking around because you could almost see the phases it was built in. I like the history of the game, so it seemed really cool to check that out. Florida Field was very nice from the outside, but just lacked the history, in my opinion. It's easy to have a pretty, new looking stadium. But you can't build tradition. Neyland may not be better than Florida using "exterior" as criteria, but it is just different, and in my opinion, pretty cool.
The atmosphere is a no brainer. I'm heading down for the UGA game this year after going to the UF game last year for my first game at Neyland. It's amazing.