Fall 2018 Open Tournament?

Post Reply
User avatar
Mike Bentley
Auron
Posts: 5586
Joined: Fri Mar 31, 2006 11:03 pm
Location: Bellevue, WA
Contact:

Fall 2018 Open Tournament?

Post by Mike Bentley » Fri Aug 31, 2018 3:32 pm

As I plan some travel stuff for this fall, I want to make sure I'm not overlooking any already announced (or soon to be announced) open tournaments this season. Is anyone planning on writing one?
Mike Bentley
Treasurer, Partnership for Academic Competition Excellence
Adviser, Quizbowl Team at University of Washington
University of Maryland, Class of 2008

User avatar
vinteuil
Auron
Posts: 1195
Joined: Sun Oct 23, 2011 12:31 pm

Re: Fall 2018 Open Tournament?

Post by vinteuil » Fri Aug 31, 2018 3:37 pm

Jacob Reed
Yale '17, '19
East Chapel Hill '13
"...distant bayings from...the musicological mafia"―Denis Stevens

User avatar
ezubaric
Rikku
Posts: 362
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric » Tue Sep 04, 2018 8:25 pm

We'll be announcing soon an open tournament for December that is open to high school teams, college teams, grizzled veterans, and computers.
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/

User avatar
vinteuil
Auron
Posts: 1195
Joined: Sun Oct 23, 2011 12:31 pm

Re: Fall 2018 Open Tournament?

Post by vinteuil » Tue Sep 04, 2018 8:42 pm

ezubaric wrote:
Tue Sep 04, 2018 8:25 pm
We'll be announcing soon an open tournament for December that is open to high school teams, college teams, grizzled veterans, and computers.
...who is "we"?
Jacob Reed
Yale '17, '19
East Chapel Hill '13
"...distant bayings from...the musicological mafia"―Denis Stevens

User avatar
ezubaric
Rikku
Posts: 362
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric » Wed Sep 05, 2018 5:41 pm

It'll be hosted at UMD.
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/

User avatar
vinteuil
Auron
Posts: 1195
Joined: Sun Oct 23, 2011 12:31 pm

Re: Fall 2018 Open Tournament?

Post by vinteuil » Wed Sep 05, 2018 7:16 pm

Er, who's writing it?
Jacob Reed
Yale '17, '19
East Chapel Hill '13
"...distant bayings from...the musicological mafia"―Denis Stevens

User avatar
ezubaric
Rikku
Posts: 362
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric » Fri Sep 07, 2018 4:58 pm

It will be packet submission, but with computers helping to write the questions. (Similar to our experimental round at PACE in June.)
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/

User avatar
vinteuil
Auron
Posts: 1195
Joined: Sun Oct 23, 2011 12:31 pm

Re: Fall 2018 Open Tournament?

Post by vinteuil » Fri Sep 07, 2018 5:06 pm

ezubaric wrote:
Fri Sep 07, 2018 4:58 pm
It will be packet submission, but with computers helping to write the questions. (Similar to our experimental round at PACE in June.)
Now I'm curious why you weren't more forthright about what is clearly the animating premise of the set. Instead, you chose to advertize an experimental set that's practically guaranteed to be full of quirks and faults as equivalent to a standard open tournament.
Jacob Reed
Yale '17, '19
East Chapel Hill '13
"...distant bayings from...the musicological mafia"―Denis Stevens

User avatar
Victor Prieto
Tidus
Posts: 570
Joined: Tue May 08, 2012 5:15 pm
Location: State College, PA

Re: Fall 2018 Open Tournament?

Post by Victor Prieto » Fri Sep 07, 2018 5:50 pm

This isn't exactly fair to Jordan - he didn't misrepresent his thing as equivalent to a standard open tournament, he just said "an announcement is coming soon about an open tournament." You badgered him into revealing information before he wanted to, then condemned the effort as doomed to fail before he's even had a chance to officially announce it. Can't you at least wait until he's ready to announce before making judgements?
Victor Prieto
Tower Hill School, Class of 2011
Rice University, Class of 2015
Penn State University, Class of 2020

Member, Writer, Editor, PACE (2015-present)
Writer, Editor, HSAPQ (2013-2016)

User avatar
Cheynem
Sin
Posts: 6318
Joined: Tue May 11, 2004 11:19 am
Location: Grand Rapids, Michigan

Re: Fall 2018 Open Tournament?

Post by Cheynem » Fri Sep 07, 2018 9:45 pm

Yeah, by "advertise" if you mean one, slightly vague post (which to be fair to Jordan says "computers" right there!).
Mike Cheyne
Formerly U of Minnesota

"You killed HSAPQ"--Matt Bollinger

User avatar
vinteuil
Auron
Posts: 1195
Joined: Sun Oct 23, 2011 12:31 pm

Re: Fall 2018 Open Tournament?

Post by vinteuil » Fri Sep 07, 2018 11:31 pm

If I posted in this thread about an "open tournament" and it turned out to be a trash tournament or some vanity set, I think it would be pretty fair to call that misrepresentation, and I think people would reasonably question my motives for withholding such a core element of the set from the get-go.

(EDIT: I do apologize for being so quick to make assertions about the quality of Jordan's project, although I think it's reasonable to expect such information up front, just like it would be reasonable for players to know immediately that some open was being written with/by a bunch of middle schoolers or similar.)
Jacob Reed
Yale '17, '19
East Chapel Hill '13
"...distant bayings from...the musicological mafia"―Denis Stevens

User avatar
ezubaric
Rikku
Posts: 362
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric » Sat Sep 08, 2018 5:16 pm

Sorry for not responding earlier; I don't read the boards as closely as I used to!
Instead, you chose to advertize an experimental set that's practically guaranteed to be full of quirks and faults as equivalent to a standard open tournament.
Thanks for bringing this up; one of the reasons that we've not formally announced is that we want to make sure we do a good job of framing this to encourage participation.

I want to stress that we want to have high quality questions, and one of the prizes ($250) will be for writing the highest quality questions possible ($100 and $50 for second and third place packets). To the best of my knowledge, this is the first tournament to have monetary prizes (beyond free registration back in the day, which was a trend that sadly has disappeared along with packet sub events) for question writing.

The goal of having computers in the loop is to improve the questions from both a scientific perspective and a quiz bowl perspective. This is a quiz bowl forum, so let me focus on that first. Here's how computers can help you write better questions:
  • Avoid stock clues in the leadin
  • Automatically find similar questions (to find other interesting clues or avoid repetition)
  • Avoid hoses (if the computer thinks the answer might be X, so might a human ... perhaps you can rephrase)
  • Automate tasks like pronunciation guides and alternate answer lines (don't know if this will make it in for this iteration, but it's on our todo list!)
Again, we hope that the resulting questions are high quality from a human perspective. We hope that we'll attract good question writers, and that a reasonable reader will recognize them as good questions. We're not going for gimmicks and quirks in terms of the questions.

The reason that we're doing this is that we're hoping that these questions will also help computer science researchers write better systems that can answer questions automatically by avoiding stock clues and other "triggers" that make quiz bowl questions artificially easy for computers. We believe that this will result in more unique, creative, more engaging questions for a human audience.

Please stay tuned, we'll be officially announcing very soon (today if I can).
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/

User avatar
ezubaric
Rikku
Posts: 362
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric » Sat Sep 08, 2018 5:23 pm

vinteuil wrote:
Fri Sep 07, 2018 11:31 pm
trash tournament or some vanity set
We'll also be using a standard distribution, for what it's worth. The biggest difference will be changes to format (tossup only), eligibility (all human players eligible, computer teams welcome), and prizes for question writers.
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/

User avatar
ezubaric
Rikku
Posts: 362
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric » Sun Sep 09, 2018 7:21 am

You can view the video of our past event here:

https://www.youtube.com/watch?v=wf5GHwDb6Ig

And the official announcement is here:

http://hsquizbowl.org/forums/viewtopic. ... 31#p349431

I'm certainly interested in suggestions for how to best convey that we're interested in soliciting quality questions.
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/

Post Reply