Time for a Checkup
In 2017, I released the first DraftTwitter Top 100 survey for mooks like you to be heard and there was solid participation. As a result of that exercise, there have been two more such survey's.
Although the Third Annual People's Top 100 (formerly the DraftTwitter Top 100) was published just recently (you can see it here) I wanted to give an update on progress for the 27 scouts who participated in the original version of the survey. Of course, we are supposed to wait to review drafts after the third year but why wait?
Methodology
Anyone who has been around awhile understands the measure used to determine a player's value is his % of offensive or defensive snaps. And because a 2nd year safety or offensive lineman will get more snaps than a rotational defensive lineman, the snap %s are rated on a peer position basis.
The peer position rankings were integrated into one list based on each player's differential compared to the top player in their position group.
Based on the above, each peer position player with the highest % of team snaps will be #1 for that position with a score of 100% . Every player would then be ranked based on his differential from the position leader. For example, Tre'Davious White leads the CB group in % snaps and is valued at 100%; the next player in the group, Adoree Jackson's % of defensive snaps was 5% fewer than White's so he is CB2. Lattimore, CB2, generated a rate equal to 91% of White's and so forth.
Note: I had to jack up Mahomes to #1 overall, giving him a 101%. Not in line with the analysis methodology but no one wants to hear any debate so he's #1.
The "P-Rank" or Performance Rank reflects the process above. The DraftTwitter rank is how they were ranked by the scouts in the original report so you can see how each player measured up to our rankings.
Scout Performance
The scouts invited to vote were primarily DraftTwitter maniacs just like you, most amateur, some professional. The ranking methodology above was applied to evaluate the strength of each voter's selections based on the 2018 season. By way of example, your number 1 pick would be worth 100 points, your 2nd would be worth 99 all the way down to your 100th pick which would be worth 1 point. To regard for the % snap valuation method, if you selected Myles Garrett #1 overall in 2017 you were granted 100 points since you would get 100% of his 1st overall pick credit of 100 points. If you had a player at #1 overall who earned only 85% based on snap % value, your 1st round pick would be worth only 85 points (1st overall pick value of 100 points times 85% snap % value).
Each scout received a score based on the aggregate value their entire Top 100 (their Raw Score). Then that score was adjusted downward for each player in a scout's top 100 who was not in the actual final aggregate Top 100 (and thus, the scout got 0 points) and also players selected by the scout who did not generate any meaningful snap count % in 2018 (their Scrubbed Score).
This gives us two scores which are averaged for the final rank. Scouts are ranked below...(drumroll...)
Notes
- Attack of the Killer B's - The above scores are for scouts who averaged a "B" or better, based on my grading system. While we still have a long way to go while monitoring the careers of the 2017 draft class so these rankings will definitely change over the years.
- The A Team - Mathbomb emerged as top dog (not a shock). With Brian J and Jonah Tuls rounding out the top 3.
- Fewest Misses - CJ Agnone @CJagnone53 shocked the world (well, not really) by having zero misses...that is, every player he selected had a % snap count in 2018. Everyone else had a player who was injured, is not a contributing player or is no longer in the league. GMs would love to have that kind of track record.
- Miss Me with All That - Speaking of misses, the top half of the list (the B grades) had far fewer misses than those in the bottom half (not shown) who had 10% more misses on average.
- Joe's over Pros - Based on the information, it looks like the professional contributors were out gunned by the amateurs...since I won't be showing grades below a B, you're going to have to trust me.
That's were we are two years into the 2017 draft class. Can't wait until this time next year when we can see how they look after the requisite 3 years in the league!
Thanks!
Updated 7/21/19
Jim Coburn asked for the detail on the top evaluators by position through 2 seasons and here are the results.
Note: CB reflects a tie for first between NFLDS and MJKist. |
The table above shows the results per position in terms of an evaluator getting 1st, 2nd or 3rd best score. If we award 3 points for first place, 2 points for second and 1 point for third, the table looks like this.
Thanks for your support and if you want to be included in the survey and receive a ballot for the 4th Annual survey for the 2020 NFL draft, please let me know by leaving a comment below.
No comments:
Post a Comment