Preseason Poll

Old college threads.
Locked
User avatar
Cheynem
Sin
Posts: 7220
Joined: Tue May 11, 2004 11:19 am
Location: Grand Rapids, Michigan

Preseason Poll

Post by Cheynem »

Just a note that I'm not planning on running the collegiate polls this year, so if somebody wants to start doing that, go ahead. If nobody does, I can run polls but only at the end of the season.
Mike Cheyne
Formerly U of Minnesota

"You killed HSAPQ"--Matt Bollinger
User avatar
Ciorwrong
Tidus
Posts: 696
Joined: Fri Dec 20, 2013 8:24 pm

Re: Preseason Poll

Post by Ciorwrong »

I made a quick little Google form for the Preseason Poll. I'd ask respondents to list their top 25 in order from best to 25th. I also included optional questions about who respondents feel is going to win ICT and ACF Nationals. I will close this form September 15 unless I don't get a good amount of responses. I'd like to get responses from players of different skill levels as long as the respondents feel they are knowledgeable about the collegiate circuit.

Please email me if there are any issues with the form. Thanks.
Harris Bunker
Grosse Pointe North High School '15
Michigan State University '19
UC San Diego Economics 2019 -

at least semi-retired
Mnemosyne
Wakka
Posts: 174
Joined: Tue May 31, 2011 12:11 am

Re: Preseason Poll

Post by Mnemosyne »

Here is the postseason poll. It would probably be useful for people to post about who is leaving, joining, etc.
Cheynem wrote: 1. Michigan A
2. Maryland
3. Yale
4. Stanford
5. Chicago A
6. Columbia
7. Northwestern
8. Penn
9. Berkeley A
10. Oxford A
11. Minnesota
12. Ohio State
13. Chicago B
14. WUSTL
15. McGill
16. Toronto
17. Berkeley B
18. Princeton
19. Louisville
20. Oklahoma
21. Missouri
22. Virginia
23. Harvard
24. Duke
25. MIT

Dropping Out: Brown

Also Receiving Votes: Cambridge (13), Chicago C (6), Florida (5), Michigan B (3), Oxford B (3), Brown (2), Kenyon (2), and Rutgers (2)

Thanks for voting, everyone.
Nick Collins
C. E. Byrd '12 (Shreveport, LA)
Louisiana Tech '16, '17
University of Virginia
User avatar
naan/steak-holding toll
Auron
Posts: 2515
Joined: Mon Feb 28, 2011 11:53 pm
Location: New York, NY

Re: Preseason Poll

Post by naan/steak-holding toll »

Major changes that I can think of off the top of my head:

Michigan loses Will and Auroni
Chicago loses Max; gains Luke Tierney, Matt Lehmnann, Andy Huff
Berkeley gains Pranav Sivakumar, Rahul Keyal, James Malouf
Columbia loses Wilton, Kailee (from ACF Nats team)
Stanford loses Stephen; gains Ashwin Ramaswami, Ali Saeed, Young Lee
Northwestern loses Dylan
Mizzou gains Joe Stitz
Penn gains Aidan Mehigan
Princeton loses Jason, gains Spence Weinreich
Oxford loses its whole A team
Cambridge gains Jason Golfinos
Ohio State gains Enoch Fu
WUSTL loses Seth Ebner
Minnesota gains John Waldron (and I think someone else)
Harvard loses most of its A-team, gains Ricky Li (from Okemos)
Will Alston
Dartmouth College '16
Columbia Business School '21
User avatar
vengefulsweatermensch
Wakka
Posts: 139
Joined: Tue Jan 22, 2013 9:13 pm

Re: Preseason Poll

Post by vengefulsweatermensch »

Mnemosyne wrote:Here is the postseason poll. It would probably be useful for people to post about who is leaving, joining, etc.
Cheynem wrote: 4. Stanford
Stephen and Benjy are gone. I'm still here; Kyle Sutherlin, Jennie Yang, and Eric Kilgore are still here; Nikhil Desai is back (!!) and, so far as I know, intends to play; Max Rong (formerly of Northwestern) has joined up; various freshmen (Ali and Young from Stevenson, Ashwin from Hooch) are in the mix as well.
Nathan Weiser
LASA '14, Stanford '18, Stanford Law '24
User avatar
Fado Alexandrino
Yuna
Posts: 834
Joined: Sat Jun 12, 2010 8:46 pm
Location: Farhaven, Ontario

Re: Preseason Poll

Post by Fado Alexandrino »

McGill stays the same
Joe Su, OCT
Lisgar 2012, McGill 2015, McGill 2019, Queen's 2020
A Dim-Witted Saboteur
Yuna
Posts: 973
Joined: Tue Aug 02, 2016 12:31 pm
Location: Indiana

Re: Preseason Poll

Post by A Dim-Witted Saboteur »

Michigan State loses Harris Bunker for the semester and also gains Devin Humphreys
Jakob M. (they/them)
Michigan State '21, Indiana '2?
"No one has ever organized a greater effort to get people interested in pretending to play quiz bowl"
-Ankit Aggarwal
User avatar
Ciorwrong
Tidus
Posts: 696
Joined: Fri Dec 20, 2013 8:24 pm

Re: Preseason Poll

Post by Ciorwrong »

Sit Room Guy wrote:Michigan State loses Harris Bunker for the semester and also gains Devin Humphreys
We also lost our science player Lucas Weingartz to graduation.
Harris Bunker
Grosse Pointe North High School '15
Michigan State University '19
UC San Diego Economics 2019 -

at least semi-retired
Slightly Less British
Lulu
Posts: 32
Joined: Sun Nov 27, 2016 11:08 pm

Re: Preseason Poll

Post by Slightly Less British »

Periplus of the Erythraean Sea wrote: Oxford loses its whole A team
We keep Daoud Jackson, but most of the rest of our A team will be last year's B team.
Frances Clark-Murray
Oxford '19 (Quiz Society President '17-'18)
User avatar
Emperor Pupienus
Wakka
Posts: 100
Joined: Sun Oct 12, 2014 1:53 pm

Re: Preseason Poll

Post by Emperor Pupienus »

Periplus of the Erythraean Sea wrote:Major changes that I can think of off the top of my head:

Michigan loses Will and Auroni
Chicago loses Max; gains Luke Tierney, Matt Lehmnann, Andy Huff
Berkeley gains Pranav Sivakumar, Rahul Keyal, James Malouf
Columbia loses Wilton, Kailee (from ACF Nats team)
Stanford loses Stephen; gains Ashwin Ramaswami, Ali Saeed, Young Lee
Northwestern loses Dylan
Mizzou gains Joe Stitz
Penn gains Aidan Mehigan
Princeton loses Jason, gains Spence Weinreich
Oxford loses its whole A team
Cambridge gains Jason Golfinos
Ohio State gains Enoch Fu
WUSTL loses Seth Ebner
Minnesota gains John Waldron (and I think someone else)
Harvard loses most of its A-team, gains Ricky Li (from Okemos)
And of course minor player on not-so-good team Jordan Brownstein is not playing this year for Maryland.
Jason Z.
Nichols School '14
University of Chicago '18

Food or not food?
Charbroil
Auron
Posts: 1146
Joined: Fri Jun 09, 2006 11:52 am
Location: St. Charles, MO

Re: Preseason Poll

Post by Charbroil »

Periplus of the Erythraean Sea wrote: WUSTL loses Seth Ebner and Collin Nadarajah.
I also won't be playing this semester (except maybe through Skype) since I'll be out of the country during much of it.
Charles Hang
Francis Howell Central '09
St. Charles Community College '14
Washington University in St. Louis '19, 2x (President, 2017-19)

Owner, Olympia Academic Competition Questions, LLC
Question Writer, National Academic Quiz Tournaments, LLC and National History Bee and Bowl
User avatar
vinteuil
Auron
Posts: 1454
Joined: Sun Oct 23, 2011 12:31 pm

Re: Preseason Poll

Post by vinteuil »

Great End wrote:
Periplus of the Erythraean Sea wrote:Major changes that I can think of off the top of my head:

Michigan loses Will and Auroni
Chicago loses Max; gains Luke Tierney, Matt Lehmnann, Andy Huff
Berkeley gains Pranav Sivakumar, Rahul Keyal, James Malouf
Columbia loses Wilton, Kailee (from ACF Nats team)
Stanford loses Stephen; gains Ashwin Ramaswami, Ali Saeed, Young Lee
Northwestern loses Dylan
Mizzou gains Joe Stitz
Penn gains Aidan Mehigan
Princeton loses Jason, gains Spence Weinreich
Oxford loses its whole A team
Cambridge gains Jason Golfinos
Ohio State gains Enoch Fu
WUSTL loses Seth Ebner
Minnesota gains John Waldron (and I think someone else)
Harvard loses most of its A-team, gains Ricky Li (from Okemos)
And of course minor player on not-so-good team Jordan Brownstein is not playing this year for Maryland.
but why should i vote for him in my top 25
Jacob R., ex-Chicago
User avatar
Red Panda Cub
Wakka
Posts: 211
Joined: Thu Dec 22, 2011 9:59 pm

Re: Preseason Poll

Post by Red Panda Cub »

Periplus of the Erythraean Sea wrote: Cambridge gains Jason Golfinos
Cambridge also loses Evan Lynch, who top scored for them at ACF Nationals and BSQC. Evan will be at Southampton for a PhD, making them a threat on the UK circuit.
Joey Goldman
Oxford '17
City, University of London '19
nsb2
Lulu
Posts: 91
Joined: Thu Mar 05, 2015 9:05 pm
Location: Berkeley, CA

Re: Preseason Poll

Post by nsb2 »

Periplus of the Erythraean Sea wrote:Minnesota gains John Waldron (and I think someone else)
You're right -- Minnesota also gains solid lit and science player Brian Kalathiveetil.
Pranav Sivakumar
Barrington Station MS '13, Barrington High School --> IMSA '17
UC Berkeley '21
User avatar
Maxwell Sniffingwell
Auron
Posts: 2164
Joined: Sun Feb 12, 2006 3:22 pm
Location: Des Moines, IA

Re: Preseason Poll

Post by Maxwell Sniffingwell »

Periplus of the Erythraean Sea wrote:Northwestern loses Dylan
vengefulsweatermensch wrote:Max Rong (formerly of Northwestern) has joined up
Max is a big loss for us, though obviously not as big a loss as Dylan is. Also worth noting is that Northwestern had essentially no bench last year: of the two returning players other than Adam and I, one is studying abroad in the fall and the other has indicated that he's done playing quizbowl. We'll be replacing Dylan and Max with new recruits.
Greg Peterson

Northwestern University '18
Lawrence University '11
Maine South HS '07

"a decent player" - Mike Cheyne
User avatar
dhumphreys17
Wakka
Posts: 150
Joined: Sat May 23, 2015 3:16 pm

Re: Preseason Poll

Post by dhumphreys17 »

Sit Room Guy wrote:Michigan State loses Harris Bunker for the semester and also gains Jakob Myers
Fixed that for you.
Devin James John Humphreys
Sacred Heart Academy High School (MI), Class of 2017 - 2015 HSNCT, 2016 NSC, 2017 NSC
Michigan State University, B.A. Class of 2020
University of Notre Dame, J.D. Class of 2023 - standby 2023 ICT-DII; coach 2023-24
User avatar
Ciorwrong
Tidus
Posts: 696
Joined: Fri Dec 20, 2013 8:24 pm

Re: Preseason Poll

Post by Ciorwrong »

Thanks a lot to the people who have taken the time to fill out a ballot. I've had the poll up for about a week now and I've gotten less than 10 responses. I'd like at least a dozen or so before I look through the results after September 15. Again, you don't need to be an expert in the collegiate circuit to submit a ballot and I'd like to have opinions from many teams, regions, and players of different ability levels and experience. Thanks!
Harris Bunker
Grosse Pointe North High School '15
Michigan State University '19
UC San Diego Economics 2019 -

at least semi-retired
User avatar
vinteuil
Auron
Posts: 1454
Joined: Sun Oct 23, 2011 12:31 pm

Re: Preseason Poll

Post by vinteuil »

Is Kurtis still eligible?
Jacob R., ex-Chicago
User avatar
sephirothrr
Quizbowl Detective Extraordinaire
Posts: 210
Joined: Sun Mar 23, 2008 11:00 pm
Location: Louisville, KY

Re: Preseason Poll

Post by sephirothrr »

vinteuil wrote:Is Kurtis still eligible?
No, I don't believe so, at least not for Louisville.
Ramapriya
Kentucky Quizbowl Alliance
University of Louisville
duPont Manual High School
Birdofredum Sawin wrote: Fri Apr 04, 2014 1:52 pmIf you don't want to be regarded as a "raving lunatic," it might be advisable to rave less, or at least to do so in a less loony manner.
User avatar
Ciorwrong
Tidus
Posts: 696
Joined: Fri Dec 20, 2013 8:24 pm

Re: Preseason Poll

Post by Ciorwrong »

Just wanted to say that today should be the last day I'm accepting ballots from this. If you were thinking about submitting a poll but hadn't yet, now is the time to do so.

EDIT: The poll is now closed. I will try to have a top 25 made from the poll today.
Harris Bunker
Grosse Pointe North High School '15
Michigan State University '19
UC San Diego Economics 2019 -

at least semi-retired
User avatar
Ciorwrong
Tidus
Posts: 696
Joined: Fri Dec 20, 2013 8:24 pm

Re: Preseason Poll

Post by Ciorwrong »

Hello all. I have some results made from the 14 responses I got. I felt the poll results didn't have too many outliers and were relatively in line with what people have said in discussions, previous polls, etc. Therefore, I thought it would be appropriate to post what I have got. I used python to go through a large CSV that I had to spend a lot of time cleaning up. For example, I had to make sure Minnesota A was equivalent to Minnesota when different voters put one name or the other for the team. By my count, 40 teams received at least one vote.

A note on the points: It's a simple formula that says if you get a 1st place vote, you get 26 points, and if you get a 25th place vote, you get 2 points, and so on. This is similar the way the AP College Football poll does it I believe. [Edit: thanks to Stephen Eltinge for pointing out the initial problem here. Damn 0 index.]

(Unlabeled teams are A teams) Please note that the lowest ranking does not include a ranking of not ranked.

1. Yale A, 363 pts, Highest Ranking: 1, Lowest Ranking: 2
2. Penn, 335, Highest Ranking: 1, Lowest Ranking: 5
3. Berkeley A, 331, Highest Ranking: 2, Lowest Ranking: 6
4. Chicago A, 326, Highest Ranking: 2, Lowest Ranking: 6
5. Columbia, 314, Highest Ranking: 3, Lowest Ranking: 7
6. Ohio State, 285, Highest Ranking: 4, Lowest Ranking: 13
7. Cambridge, 242, Highest Ranking: 6, Lowest Ranking: 19
8. Minnesota, 237, Highest Ranking: 6, Lowest Ranking: 20
9. Stanford, 211, Highest Ranking: 4, Lowest Ranking: 21
10. Berkeley B, 209, Highest Ranking: 7, Lowest Ranking: 24
11. McGill, 197, Highest Ranking: 8, Lowest Ranking: 20
12. Chicago B, 193, Highest Ranking: 7, Lowest Ranking: 19
13. Northwestern, 189, Highest Ranking: 5, Lowest Ranking: 19
14. Toronto, 163, Highest Ranking: 9, Lowest Ranking: 21
15. Missouri, 152, Highest Ranking: 8, Lowest Ranking: 21
16. WUSTL, 144, Highest Ranking: 9, Lowest Ranking: 17
17. Oklahoma, 134, Highest Ranking: 8, Lowest Ranking: 25
18. Virginia, 127, Highest Ranking: 10, Lowest Ranking: 24
19. Michigan, 127, Highest Ranking: 8, Lowest Ranking: 24
20. Duke, 116, Highest Ranking: 13, Lowest Ranking: 25
21. Michigan State, 103, Highest Ranking: 10, Lowest Ranking: 24
22. Oxford, 82, Highest Ranking: 7, Lowest Ranking: 25
23. MIT, 75, Highest Ranking: 15, Lowest Ranking: 23
24. Chicago C, 43, Highest Ranking: 20, Lowest Ranking: 25
25. Maryland, 38, Highest Ranking: 12, Lowest Ranking: 17

I also asked two optional questions about who will win the two collegiate national championships.
Yale got 10/14 votes to win ICT, with Penn, Berkeley and a long, multiple team answer also receiving votes.
Yale got 9/14 votes to win ACF Nats, with Penn and Berkeley also receiving votes.

Thank you to everyone who voted. If anyone is interested in receiving the raw, anonymous voting data, or the program I wrote to analyze the poll, just send me a PM or an email. I had to "clean up" a lot of the data to make sure that A teams were treated the same as unlabeled teams, and to eliminate some errors such as erroneous spaces in team names, so please let me know if you think anything is amiss here.
Last edited by Ciorwrong on Sat Sep 16, 2017 11:19 am, edited 1 time in total.
Harris Bunker
Grosse Pointe North High School '15
Michigan State University '19
UC San Diego Economics 2019 -

at least semi-retired
User avatar
t-bar
Tidus
Posts: 671
Joined: Sun Jan 25, 2009 4:12 pm

Re: Preseason Poll

Post by t-bar »

Progcon wrote:if you get a 1st place vote, you get 26 points, and if you get a 25th place vote, you get 1 point, and so on
Shouldn't the point range go from either 26-2 or 25-1, not 26-1?
Stephen Eltinge
Then: TJ, MIT, Yale, PACE, NAQT
Now: ACF
User avatar
vinteuil
Auron
Posts: 1454
Joined: Sun Oct 23, 2011 12:31 pm

Re: Preseason Poll

Post by vinteuil »

Thanks Harris! Is it also possible to include the traditional "lowest" and "highest" info?
Jacob R., ex-Chicago
User avatar
Ciorwrong
Tidus
Posts: 696
Joined: Fri Dec 20, 2013 8:24 pm

Re: Preseason Poll

Post by Ciorwrong »

t-bar wrote:
Progcon wrote:if you get a 1st place vote, you get 26 points, and if you get a 25th place vote, you get 1 point, and so on
Shouldn't the point range go from either 26-2 or 25-1, not 26-1?
Yeah. My program increments 26-i points where i ranges from I think 0 to 24 inclusive, so the highest score is 26 and the lowest you can get is a 2. This means there are 25 possible values, and thus 25 places. I originally incremented by 25-i but I thought 25th place teams wouldn't get any points because 25-25 = 0 but the 0 indexing confused me and caused me to write something in the forum post that was incorrect. You are right and I apologize for the confusion there. If I do this again, I'll have a 25-1 system instead.
vinteuil wrote:Thanks Harris! Is it also possible to include the traditional "lowest" and "highest" info?
I have added this. I wrote a way to keep tracking of lowest and highest ranking in the program, but this doesn't account for people who chose not to rank a team. There were many teams in the 20-25 range (and even higher) that were not ranked by every voter, so many "lowest ranking" would be "not ranked". If people are interested, I can also add a count of how many people ranked a certain team, but I feel the points do a decent job of making tiers of the ranked teams.
Harris Bunker
Grosse Pointe North High School '15
Michigan State University '19
UC San Diego Economics 2019 -

at least semi-retired
Charbroil
Auron
Posts: 1146
Joined: Fri Jun 09, 2006 11:52 am
Location: St. Charles, MO

Re: Preseason Poll

Post by Charbroil »

Is there any way to get a list of teams that also got votes, as well as how many points each of those teams got?
Charles Hang
Francis Howell Central '09
St. Charles Community College '14
Washington University in St. Louis '19, 2x (President, 2017-19)

Owner, Olympia Academic Competition Questions, LLC
Question Writer, National Academic Quiz Tournaments, LLC and National History Bee and Bowl
User avatar
Ciorwrong
Tidus
Posts: 696
Joined: Fri Dec 20, 2013 8:24 pm

Re: Preseason Poll

Post by Ciorwrong »

Charbroil wrote:Is there any way to get a list of teams that also got votes, as well as how many points each of those teams got?
Also receiving votes:

26. Louisville, 30 pts, Highest Ranking: 14, Lowest Ranking: 19
27. Harvard, 25, Highest Ranking: 16, Lowest Ranking: 23
28. Brown, 13, Highest Ranking: 23, Lowest Ranking: 25
29. Princeton, 13, Highest Ranking: 22, Lowest Ranking: 25
30. Stanford B, 11, Highest Ranking: 20, Lowest Ranking: 23
31. Florida, 11, Highest Ranking: 21, Lowest Ranking: 22
32. YaleB, 10, Highest Ranking: 23, Lowest Ranking: 25
33. Johns Hopkins, 10, Highest Ranking: 22, Lowest Ranking: 22
34. Oxford B, 8, Highest Ranking: 19, Lowest Ranking: 19
35. Berkeley C, 7, Highest Ranking: 22, Lowest Ranking: 25
36. Rutgers, 6, Highest Ranking: 24, Lowest Ranking: 24
37. Michigan B, 6, Highest Ranking: 21, Lowest Ranking: 21
38. Illinois, 5, Highest Ranking: 24, Lowest Ranking: 25
39. Tennessee, 5, Highest Ranking: 22, Lowest Ranking: 22
40. NYU, 4, Highest Ranking: 25, Lowest Ranking: 25
Harris Bunker
Grosse Pointe North High School '15
Michigan State University '19
UC San Diego Economics 2019 -

at least semi-retired
User avatar
1.82
Rikku
Posts: 398
Joined: Thu Feb 05, 2015 9:35 pm
Location: a vibrant metropolis, the equal of Paris or New York

Re: Preseason Poll

Post by 1.82 »

Using a script is a creative idea, but it seems more suited to a poll with 14,000 voters than a poll with 14 voters. I received the poll results from Harris and used Excel to manually create rankings in a more familiar form, using the standard system of 25 points for #1 down to 1 point for #25. This changes the rankings somewhat!

1. Yale Bulldogs: 349 (13), highest #1, lowest #2
2. Pennsylvania Quakers: 321 (1), highest #1, lowest #5
3. California Golden Bears: 317, highest #2, lowest #6
4. Chicago Maroons: 312, highest #2, lowest #6
5. Columbia Lions: 300, highest #3, lowest #7
6. Ohio State Buckeyes: 271, highest #4, lowest #13
7. Cambridge Light Blues: 228, highest #6, lowest #19
8. Minnesota Golden Gophers: 223, highest #6, lowest #20
9. Stanford Cardinal: 198, highest #4, ranked by 13 voters
10. California Golden Bears B: 195, highest #7, lowest #24
11. McGill Redmen: 183, highest #8, lowest #20
12. Chicago Maroons B: 179, highest #7, lowest #19
13. Northwestern Wildcats: 176, highest #5, ranked by 13 voters
14. Toronto Varsity Blues: 150, highest #9, ranked by 13 voters
15. Missouri Tigers: 139, highest #8, ranked by 13 voters
16. Washington (Mo.) Bears: 134, highest #9, ranked by 10 voters
17. Michigan Wolverines: 127, highest #8, ranked by 12 voters
18. Oklahoma Sooners: 121, highest #8, ranked by 13 voters
19. Virginia Cavaliers: 114, highest #10, ranked by 13 voters
20. Duke Blue Devils: 102, highest #13, lowest #25
21. Michigan State Spartans: 79, highest #10, ranked by 12 voters
22. Oxford Dark Blues: 71, highest #7, ranked by 11 voters
23. MIT Engineers: 64, highest #15, ranked by 11 voters
24. Maryland Terrapins: 35, highest #12, ranked by 3 voters
25. Chicago Maroons C: 33, highest #20, ranked by 10 voters

Also receiving votes:

26. Louisville Cardinals: 27, highest #14, ranked by 3 voters
27. Harvard Crimson: 21, highest #16, ranked by 4 voters
28. Florida Gators: 13, highest #21, ranked by 3 voters
29. Princeton Tigers: 9, highest #22, ranked by 4 voters
30. Brown Bears: 9, highest #23, ranked by 4 voters
31. Stanford Cardinal B: 9, highest #20, ranked by 2 voters
32. Oxford Dark Blues B: 7, highest #19, ranked by 1 voters
33. Yale Bulldogs B: 7, highest #23, ranked by 3 voters
34. California Golden Bears C: 5, highest #22, ranked by 2 voters
35. Michigan Wolverines B: 5, highest #21, ranked by 1 voters
36. Rutgers Scarlet Knights: 4, highest #24, ranked by 2 voters
37. Johns Hopkins Blue Jays: 4, highest #22, ranked by 1 voters
38. Tennessee Volunteers: 4, highest #22, ranked by 1 voters
39. Illinois Fighting Illini: 3, highest #24, ranked by 2 voters
40. New York Violets: 2, highest #25, ranked by 2 voters

Going forward, it would be inadvisable to continue using a Google form, since with e-mail we have some idea of whom the voters are. I was planning to do a writeup of Top 25 teams, as has been done in past years, but the wild variance in the results of this poll (of the 14 voters, four had WUSTL in the top ten and four did not rank WUSTL at all) indicates that the level of information possessed by voters is so low that these rankings are not really useful for any purpose.
Last edited by 1.82 on Mon Mar 12, 2018 3:22 pm, edited 2 times in total.
Naveed Chowdhury
Maryland '16
Georgia Tech '17
User avatar
Ciorwrong
Tidus
Posts: 696
Joined: Fri Dec 20, 2013 8:24 pm

Re: Preseason Poll

Post by Ciorwrong »

1.82 wrote:Using a script is a creative idea, but it seems more suited to a poll with 14,000 voters than a poll with 14 voters. I received the poll results from Harris and used Excel to manually create rankings in a more familiar form, using the standard system of 25 points for #1 down to 1 point for #25. This changes the rankings somewhat!

Going forward, it would be inadvisable to continue using a Google form, since with e-mail we have some idea of whom the voters are. I was planning to do a writeup of Top 25 teams, as has been done in past years, but the wild variance in the results of this poll (of the 14 voters, four had WUSTL in the top ten and four did not rank WUSTL at all) indicates that the level of information possessed by voters is so low that these rankings are not really useful for any purpose.
First of all: thanks for doing that Naveed. I appreciate the work it took to remake the rankings by hand. I apologize for any silly mistakes I made.

I fail to see how using a Google form is inadvisable. It allows there to be a ton of different responses, and saved me a ton of arithmetic which I liked. The data I sent to you was also highly edited from what I received, as I removed the person's name and their time stamp and cleaned up a lot of inconsistencies in team naming. All individuals who submitted a poll with the Google form used names of real quizbowlers and several confirmed their submission with a PM. Therefore, I fail to see how email is a better system. There is no incentive to impersonate a quizbowler in an anonymous poll, but maybe people would have to PM the pollster and say "yeah I submitted a ballot" to verify. I had no issue with how it was done personally aside from my error on the 0 index which led to the 26-2 point range. For that I apologize. I also wrote the script in Python for future polls that have larger response rates. It could work for any arbitrary ranking of things which is helpful to me.

I am not sure what there is to gleam from these rankings, but I firmly believe they do an accurate job of showing the perception that the community at large has of each team. Even the high school poll, where there are many more knowledgeable and connected people with many more results and more static teams (i.e. players are in high school for 4 years only for the most part), has strange results, and people who are not knowledgeable about the entire circuit. The high school poll does not have a huge response rate either. Given that only about a dozen people felt comfortable submitting anonymous responses to this poll request, I am not sure there could then ever be rankings that were "useful for any purpose". Are there a ton of people who have in-depth knowledge on all 40+ circuit regulars and all the freshmen coming in? Even if there are a ton of people with that kind of knowledge, and those people happened to not have voted in this poll, why then not make a write up of the 25 teams? If you have the time and the interest, I think it'd be great if you could write a few sentence blurb on each team. In your opinion, do you personally think any supremely talented teams did not make the 25 team cut? I'd genuinely like to hear your thought here.

In summary, the poll does a good job of precisely doing what a poll should do, which is to show the perception of teams in the quizbowl circuit as a whole. I think my confidence interval on final placement or team strength grows as we go down the rankings, but I think there is some value with knowing that, say, Yale, Penn, Berkeley, Chicago, Columbia, Ohio State, etc. are some of the favorite this year, even if that fact is somewhat trivial when looking at how good their players are.

Maybe in the future, it would be advisable to only have pollsters rank the top 10 teams because those are the teams people have the most knowledge about. It's kind of unrealistic to expect a large amount of people throughout the American, Canadian, and British circuits, have a good working knowledge of Chicago C, Stanford B, Toronto, and Duke when those teams are in different regions and some teams, such as my own, might play those teams once a year at most. Cursory quizbowl statistics also do a poor job of estimating team strength for teams that are not the strongest for reasons that have been discussed.
Harris Bunker
Grosse Pointe North High School '15
Michigan State University '19
UC San Diego Economics 2019 -

at least semi-retired
User avatar
vinteuil
Auron
Posts: 1454
Joined: Sun Oct 23, 2011 12:31 pm

Re: Preseason Poll

Post by vinteuil »

Progcon wrote: In summary, the poll does a good job of precisely doing what a poll should do, which is to show the perception of teams in the quizbowl circuit as a whole. I think my confidence interval on final placement or team strength grows as we go down the rankings, but I think there is some value with knowing that, say, Yale, Penn, Berkeley, Chicago, Columbia, Ohio State, etc. are some of the favorite this year, even if that fact is somewhat trivial when looking at how good their players are.
It should be trivial that WUSTL is minimally top 15 if you know how good Charles Hang is! Anybody who left them or the three teams above them out of the top 25 (!!!!) is, as Naveed says, so ill-informed as to add a big wash of noise over the results.
Jacob R., ex-Chicago
User avatar
Ciorwrong
Tidus
Posts: 696
Joined: Fri Dec 20, 2013 8:24 pm

Re: Preseason Poll

Post by Ciorwrong »

vinteuil wrote:
Progcon wrote: In summary, the poll does a good job of precisely doing what a poll should do, which is to show the perception of teams in the quizbowl circuit as a whole. I think my confidence interval on final placement or team strength grows as we go down the rankings, but I think there is some value with knowing that, say, Yale, Penn, Berkeley, Chicago, Columbia, Ohio State, etc. are some of the favorite this year, even if that fact is somewhat trivial when looking at how good their players are.
It should be trivial that WUSTL is minimally top 15 if you know how good Charles Hang is! Anybody who left them or the three teams above them out of the top 25 (!!!!) is, as Naveed says, so ill-informed as to add a big wash of noise over the results.
Well I agree both that WUSTL is a top 15 team and that those that don't think so dilutes the results, I'm not sure what the direct implication of this is. Do we toss out the results of those people who supposedly don't have the requisite knowledge to do the poll, or do we just naively say that the poll is meaningless or invalid, etc.? More people should have voted if we want a way to correct for people who mistakenly think that WUSTL isn't a top 25 team. Part of the reason I made the poll anonymous was to increase participation, and I had the poll open for 3 weeks. I would of course liked to have gotten more responses, but I wanted, and I think is a reasonable idea, to get the poll out before people starting playing real tournaments.

There are two questions about the collegiate poll that must be discussed. First, is what is the value of the poll, and how seriously do we take it? Is it about projecting future performance, peak team "skill"/knowledge, gradating teams about a potential match up (eg. the Number 17 team would be unambiguously favored over the Number 18 team). Further, do we start putting the team's preseason poll ranking next to the team name ala college football to hype up, say, a top 5 match up between Yale and Penn? If we decide that the poll matters, then we need to get more people to vote--and vote soon after the poll goes up.

That leads into my second question. Do we need a minimum number of respondents--or some other restriction on pollsters before the poll can be published? I made a judgement call that 14 voters was enough, and maybe it wasn't, but I was getting less than one response a day even up the last day so I didn't see a whole lot of desire to either make a poll or discuss the rankings. Hell, the high school ranking threads get load of responses: both here and on Facebook, so I figured that these are the responses I have, and I might as well publish them promptly. I apologize if these rankings lead any team to feel slighted or subject to bias. This was obviously not my intent. I wanted to stick to the deadline. Maybe in the future, we can make a requirement before people vote that the poll won't be published until, say, 30 different people vote who all don't attend schools in the same region.

Another idea, and I think this one is a bit better, is to have a panel made of knowledgeable players out of the game make polls and then look at who they think the best teams are. A lot of the respondents were very biased towards their own team, which is fine and understandable, but I think making it feel like more the College Football Coaches Poll is a good idea. Alternatively, restricting the poll to people who have been in college for at least 4 years or have graduate could be an idea, but the majority of respondents fell into this camp anyways this year. You could also add a skill bar that must be reached of, say, averaging 40 ppg at a regular tournament. I think we can all agree, though, that there should be more than 14 respondents.

Again, I wish I had gotten more data and hopefully all my mistakes illustrate ways the collegiate polling process can be ameliorated or changed.
Harris Bunker
Grosse Pointe North High School '15
Michigan State University '19
UC San Diego Economics 2019 -

at least semi-retired
User avatar
Fado Alexandrino
Yuna
Posts: 834
Joined: Sat Jun 12, 2010 8:46 pm
Location: Farhaven, Ontario

Re: Preseason Poll

Post by Fado Alexandrino »

I'm surprised that Stanford and Northwestern both were left out on one ballot; upthread Will Alston posted the team changes so they couldn't even make a mistake like with Toronto, who by the way, is losing Jay for ACF events but will still be able to play NAQT.
Joe Su, OCT
Lisgar 2012, McGill 2015, McGill 2019, Queen's 2020
User avatar
armitage
Wakka
Posts: 196
Joined: Sun Nov 28, 2010 11:52 pm

Re: Preseason Poll

Post by armitage »

I don't think this ranking is useless. The top 10 this poll generated seems more or less correct to me, and the rest of the poll looks plausible enough, no less so than it's been any of the past few years.

Personally, I am getting farther away from the game every day and I honestly have no idea who plays for some of these teams and what they are good at (although I guess I was at least a replacement level voter since I ranked Wash U). I don't see why it's impossible that someone even more removed than I am might find it interesting that Yale, Penn, and Berkeley are favorites this year and teams like OSU and Cambridge are looking to play spoiler. I think even a flawed poll has a lot of value in that respect. Is there actually a negative outcome to having this?
Richard
Charbroil
Auron
Posts: 1146
Joined: Fri Jun 09, 2006 11:52 am
Location: St. Charles, MO

Re: Preseason Poll

Post by Charbroil »

Even though we're apparently the most prominent example of a team that was voted on by uninformed voters, I do think the overall poll result is fine. Our placement was--in my personal opinion--a little low, but certainly not outside the margin of error.

Richard perfectly expressed my views about how the poll still has value, even if individual voters might have made mistakes. As far as I can tell, the wisdom of crowds seems to have delivered a perfectly reasonably result.
1.82 wrote:I was planning to do a writeup of Top 25 teams, as has been done in past years...
I can't speak for anyone else, but I would find this really enjoyable to read and share with my teammates. We have a lot of new players who are very excited about quiz bowl this year, and I think this sort of thing would be a fun morale-boosting thing to present to them, especially since many of them are totally new to the game and have asked about how our team ranks relative to other schools.

Given that the top 25 teams listed in the poll results are still (roughly) the 25 best teams in the game, despite the poll's flaws, I don't see why you would let a few bad ballots keep you from using these teams as the basis of your writeup.
Charles Hang
Francis Howell Central '09
St. Charles Community College '14
Washington University in St. Louis '19, 2x (President, 2017-19)

Owner, Olympia Academic Competition Questions, LLC
Question Writer, National Academic Quiz Tournaments, LLC and National History Bee and Bowl
User avatar
Fado Alexandrino
Yuna
Posts: 834
Joined: Sat Jun 12, 2010 8:46 pm
Location: Farhaven, Ontario

Re: Preseason Poll

Post by Fado Alexandrino »

Charbroil wrote:
1.82 wrote:I was planning to do a writeup of Top 25 teams, as has been done in past years...
I can't speak for anyone else, but I would find this really enjoyable to read and share with my teammates. We have a lot of new players who are very excited about quiz bowl this year, and I think this sort of thing would be a fun morale-boosting thing to present to them, especially since many of them are totally new to the game and have asked about how our team ranks relative to other schools.
Haha same with McGill honestly, a lot of signer uppers at Clubs Day asked how good we were.

I rescind my criticism earlier somewhat, if people forgot teams by accident then that's unfortunate but it does show the team is somewhat forgettable. Shouldn't apply to any of WUSTL and above though.
Joe Su, OCT
Lisgar 2012, McGill 2015, McGill 2019, Queen's 2020
User avatar
ryanrosenberg
Auron
Posts: 1890
Joined: Thu May 05, 2011 5:48 pm
Location: Palo Alto, California

Re: Preseason Poll

Post by ryanrosenberg »

In retrospect, Johns Hopkins seems underranked.
Ryan Rosenberg
North Carolina '16
ACF
User avatar
Victor Prieto
Auron
Posts: 1192
Joined: Tue May 08, 2012 5:15 pm
Location: New York, NY

Re: Preseason Poll

Post by Victor Prieto »

I made a spreadsheet compiling all stats from Penn Bowl and ACF Regionals, excepting Connecticut and the UK mirrors. I rushed it and there are probably numerous errors, and I didn't make a very deep attempt to get all the rosters right (and gave up partway through). I set the spreadsheet to comment-only, I'm hoping to crowdsource the rest. If you can fill in stuff for me, I'd appreciate it.

I might fill in stats from other tournaments some other time.
Victor Prieto
Secretary, PACE
Tower Hill School '11 | Rice University '15 | Penn State University '21
Writer: NAQT (2019-present) | Writer, Editor: HSAPQ (2013-2016)
Member (and lots of other stuff): PACE (2015-present)
eliza.grames
Wakka
Posts: 242
Joined: Sat Sep 25, 2010 1:43 pm

Re: Preseason Poll

Post by eliza.grames »

Victor Prieto wrote:I made a spreadsheet compiling all stats from Penn Bowl and ACF Regionals, excepting Connecticut and the UK mirrors.
Auroni said he'll get the Northeast stats up tonight, so hopefully it's easy enough to add them in after the fact.
Eliza Grames
University of Minnesota '13
University of Connecticut '21
User avatar
Victor Prieto
Auron
Posts: 1192
Joined: Tue May 08, 2012 5:15 pm
Location: New York, NY

Re: Preseason Poll

Post by Victor Prieto »

Victor Prieto wrote:I made a spreadsheet
This has been updated with SCT stats.
Victor Prieto
Secretary, PACE
Tower Hill School '11 | Rice University '15 | Penn State University '21
Writer: NAQT (2019-present) | Writer, Editor: HSAPQ (2013-2016)
Member (and lots of other stuff): PACE (2015-present)
Locked