The thing about Kelly is that he's never recruited at an elite level. Even at Oregon. He took over a program that was in solid shape and took it to the next level. He was there 4 years and they finished #11, #3, #4, and #2 in the AP Poll. That didn't translate to top 5 recruiting classes though. His recruiting classes were ranked 30th, 12th, 12th, and 14th respectively. He never pulled a class ranked #1 in the Pac 12; USC consistently out-recruited him and in some years Stanford or UCLA did. He had good recruiting classes at Oregon, especially by their standards, but they weren't elite despite being an elite program at that time.
At the time, he had something of a reputation as a "do more with less" guy - a lot of the guys he coached turned into great players, but many weren't elite recruits (like Mariota or Darron Thomas).