Well, tell him and his mom that, then.  And of course, the  counterargument is that while UGA doesn't have a receiver that's as good as Rogers or Hunter (really, who does?) that both T. King and Malcolm Mitchell are more than good enough to make an opponent think twice about doubling Cordarelle---so he will rarely have to face double coverage, and he'll be targeted the most of anyone on the team.   
I'm sure we WOULD make him a baller in this offense.  But UGA can, and HAS sold him as well or better on what happens there.  And all that matters in the end is what he feels and believes, and I can tell you right now, the Patterson group feels like he'll shine brighter at UGA.