Jump to content

Colley Matrix

From Wikipedia, the free encyclopedia

The Colley Matrix is a computer-generated sports rating system designed by Dr. Wesley Colley. It is one of more than 40 polls, rankings, and formulas recognized by the NCAA in its list of national champion selectors in college football.[1]

Methodology

[edit]

In his initial paper at Princeton University, Colley states, "The method is based on very simple statistical principles, and uses only Div. I-A[a] wins and losses as input — margin of victory does not matter. The scheme adjusts effectively for strength of schedule, in a way that is free of bias toward conference, tradition, or region."[2] Colley claims that his method is bias free for estimating the ranking of a team given a particular schedule.[2] The resulting values for each team are identified as a ranking, thus being a realization of Pierre-Simon Laplace’s Rule of Succession.[3]

The formula was adjusted in 2007 to account for games against FCS teams.[4]

National champions

[edit]

As an NCAA-designated major selector, the NCAA regards the following teams as Colley's national champion selection.

The NCAA records book indicates that the Colley Matrix has been active since 1992, however this appears to be an error and no Colley selections are listed for 1992–1997.[5]: 112  The season rankings on Colley's own website begin in 1998.[6]

In four years (2011, 2012, 2016, 2017) the Colley Matrix selected a national champion that did not win the BCS or CFP national championship game. In each of the years, the Colley Matrix was the only NCAA-designated "major selector" to select that champion.[5]: 117–118 

"2017 National Champions" signage at the home stadium of the UCF Knights football program; Colley Matrix ranked UCF first for the 2017 NCAA Division I FBS football season
Season Champion Record Ref.
1998 Tennessee 13–0 [7]
1999 Florida State 12–0 [8]
2000 Oklahoma 13–0 [9]
2001 Miami (FL) 12–0 [10]
2002 Ohio State 14–0 [11]
2003 LSU 13–1 [12]
2004 USC 13–0[b] [13]
2005 Texas 13–0 [14]
2006 Florida 13–1 [15]
2007 LSU 12–2 [16]
2008 Florida 13–1 [17]
2009 Alabama 14–0 [18]
2010 Auburn 14–0 [19]
2011 † Oklahoma State 12–1 [20]
2012 † Notre Dame 12–1 [21]
2013 Florida State 14–0 [22]
2014 Ohio State 14–1 [23]
2015 Alabama 14–1 [24]
2016 † Alabama 14–1 [25]
2017 † UCF 13–0 [26]
2018 Clemson 15–0 [27]
2019 LSU 15–0 [28]
2020 Alabama 13–0 [29]
2021 Georgia 14–1 [30]
2022 Georgia 15–0 [31]
2023 Michigan 15–0 [32]

† Years in which Colley Matrix selection did not win BCS or CFP national championship game.

History

[edit]

The Colley Matrix was one of the computer rankings used during Bowl Championship Series (BCS) system of determining national championship game participants. Added in 2001, the Peter Wolfe and Wes Colley/Atlanta Journal-Constitution computer rankings were used in place of The New York Times and Dunkel rankings. The change was made because the BCS wanted computer rankings that did not depend heavily on margin of victory.[33]

In 2018, the Mountain West Conference moved away from using four polls, one being Colley Matrix, to determine the host site for its conference championship game in football, due to "a shift to place a priority on head-to-head competition."[34]

The Colley Matrix has chosen a different national champion from the Bowl Championship Series or College Football Playoff champion four times:[5]: 117–118 

In each of the above instances, the Colley Matrix was the only NCAA recognized selector to choose a champion other than the BCS or CFP winner.[5]: 117–118 

Criticism and controversies

[edit]

The methodology of the rankings have been questioned by others on the grounds of subjectivity and specifics of the statistical math.[3][38] It has also been criticized for not correctly emphasizing a team's strength of schedule, head-to-head results, and for problems with the formula used for the calculation.[3]

In the final BCS rankings for the 2010 season, LSU was incorrectly ranked ahead of Boise State, at No. 10 instead of No. 11. The error was a result of Colley failing to input an FCS playoff game (Appalachian State vs. Western Illinois) correctly, a mistake that affected an order that helped determine bowl pairings that season.[39]

Since created in 1992, the four instances where the Colley Matrix has chosen a different national champion from the BCS/CFP winner are the most of any NCAA recognized selector in that timeframe.[5]: 117–118  Colley Matrix is also the only NCAA recognized selector to ever choose a different champion than the CFP (in use since the 2014 season), which it has done twice.[5]: 117–118 

Colley Matrix is a special case of the Generalized row sum method, a parametric family of ranking methods developed by P. Yu. Chebotarev (1989).[40]: 4 

Notes

[edit]
  1. ^ Division I-A is now known as the NCAA Division I Football Bowl Subdivision (FBS).
  2. ^ USC's record listed for 2004 includes two wins later vacated by the NCAA.

References

[edit]
  1. ^ a b "National champions: UCF Knights finish season ranked No. 1 in Colley Matrix" Orlando Sentinel. Retrieved 2018-09-01.
  2. ^ a b "Colley’s Bias Free College Football Ranking Method: The Colley Matrix Explained" ColleyRankings.com. Retrieved 2018-09-01.
  3. ^ a b c "The problem with RPI, Elo, and the Colley Matrix" Jelly Juke. Retrieved 2018-09-01.
  4. ^ "FCS Grouping System". colleyrankings.com. Retrieved 2021-10-13.
  5. ^ a b c d e f Football Bowl Subdivision Records (PDF). National Collegiate Athletic Association. 2021. Retrieved November 19, 2021 – via NCAA.org.
  6. ^ "Previous Seasons Football Rankings". colleyrankings.com. Retrieved May 23, 2023.
  7. ^ "Colley's Bias Free College Football Rankings: 1998 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  8. ^ "Colley's Bias Free College Football Rankings: 1999 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  9. ^ "Colley's Bias Free College Football Rankings: 2000 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  10. ^ "Colley's Bias Free College Football Rankings: 2001 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  11. ^ "Colley's Bias Free College Football Rankings: 2002 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  12. ^ "Colley's Bias Free College Football Rankings: 2003 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  13. ^ "Colley's Bias Free College Football Rankings: 2004 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  14. ^ "Colley's Bias Free College Football Rankings: 2005 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  15. ^ "Colley's Bias Free College Football Rankings: 2006 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  16. ^ "Colley's Bias Free College Football Rankings:2007 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  17. ^ "Colley's Bias Free College Football Rankings: 2008 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  18. ^ "Colley's Bias Free College Football Rankings: 2009 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  19. ^ "Colley's Bias Free College Football Rankings: 2010 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  20. ^ "Colley's Bias Free College Football Rankings: 2011 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  21. ^ "Colley's Bias Free College Football Rankings: 2012 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  22. ^ "Colley's Bias Free College Football Rankings: 2013 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  23. ^ "Colley's Bias Free College Football Rankings: 2014 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  24. ^ "Colley's Bias Free College Football Rankings: 2015 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  25. ^ "Colley's Bias Free College Football Rankings: 2016 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  26. ^ "Colley's Bias Free College Football Rankings: 2017 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  27. ^ "Colley's Bias Free College Football Rankings: 2018 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  28. ^ "Colley's Bias Free College Football Rankings: 2019 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  29. ^ "Colley's Bias Free College Football Rankings: 2020 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  30. ^ "Colley's Bias Free College Football Rankings: Current Rankings". colleyrankings.com. Retrieved November 19, 2021.
  31. ^ "Colley's Bias Free College Football Rankings: 2022 Rankings". colleyrankings.com. Retrieved November 12, 2023.
  32. ^ "Colley's Bias Free College Football Rankings: 2023 Rankings". colleyrankings.com. Retrieved January 8, 2024.
  33. ^ "BCS formula still subject of debate". ESPN.com. September 16, 2002. Archived from the original on October 18, 2015. Retrieved May 1, 2009.
  34. ^ "Mountain West announces new host procedure for conference football championship game" San Diego Union-Tribune. Retrieved 2018-09-01.
  35. ^ CincyJoe (January 10, 2012). "Oklahoma State Football: 2011 National Champions". cowboysrideforfree.com. Retrieved November 18, 2021.
  36. ^ "Notre Dame is still No. 1, according to one BCS computer" USA Today. Retrieved 2018-09-01.
  37. ^ Connelly, Bill (2017-11-03). "A new, improved CFB strength of schedule measurement". SBNation.com. Retrieved 2022-08-08.
  38. ^ "Statistics of Colley’s Ranking Methodology" Squared Statistics. Retrieved 2018-09-01.
  39. ^ "The Computer Poll Uprising: Creators of the BCS's Most Controversial Component Look Back" Sports Illustrated. Retrieved 2018-09-01.
  40. ^ Csató, L. On the ranking of a Swiss system chess team tournament, Annals of Operations Research 254, 17-36 (2017). https://arxiv.org/abs/1507.05045v5.
[edit]