Page 1 of 2

Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 2:37 pm
by roth
Hey all,

In my copious spare time, I hacked together the prototype of a Quiz Bowl robot for Google Wave named 'Quizzy.' Right now, Quizzy can fetch questions from the acfdb (I downloaded the entire archive of 12,000 questions, naively parsed it, and uploaded it to the Datastore for the Google Appengine site where Quizzy is hosted) and ask them to participants in a Wave. He automatically posts the answer, although if I get around to it later today, I'll add a command so that users can request an answer at their leisure.

My goal is to have Quizzy act like a moderator at a reputable tournament. Eventually, it will read questions one word at a time, probably at an ICT pace. Collaborators in the Wave will be able to 'buzz in' and Quizzy will recognize them, give them a chance to answer, and determine whether or not they are correct. In the future, I'd also like to add team/player functionality, and possibly build a Gadget to complement Quizzy which could act as a foundation for an entire Quiz Bowl match. Unfortunately, the Wave API hasn't quite progressed to allow these things - particularly the incremental reading of questions (my only option right now is a half-assed cron job which doesn't quite work, but the Wave guys have posted on the internet that the next API update will add better automation/scheduling functionality for Robots).

Anyways, if you want to test out Quizzy, you can do so very easily. Simply log onto Google Wave, and add 'quizzy-robot@appspot.com' as a contact. Then, during any Wave, add Quizzy as a collaborator. It'll pop up and give you a few commands to use; input those commands into any blip and have fun!

Also, you can check out the source code at http://code.google.com/p/quizzy/. If you're interesting in contributing to the project, let me know! I think Google Wave is an exciting new platform to which we can port Quiz Bowl, and I hope Quizzy can serve the community some useful purpose as it develops over the next few months.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 3:09 pm
by AlphaQuizBowler
Any chance you could invite me to Google Wave? This seems neat, and I'd like to try it out.
EDIT: email address: wdthorton@gmail.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 3:14 pm
by Mettius Fufetius
Echoing what William Horton said; I'd be willing to try this but would need someone to invite me, as my Wave invite application hasn't been returned yet.

(Edit: it's in my profile, but schNOSPAMeat@gmail.com )

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 3:15 pm
by BGSO
AlphaQuizBowler wrote:Any chance you could invite me to Google Wave? This seems neat, and I'd like to try it out.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 3:19 pm
by jonah
I'll have to jump onboard the "invite please" train (jonahgreenthal@gmail.com).

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 3:22 pm
by Haaaaaaaarry Whiiiiiiiiiite
If I could somehow figure out how to invite people, I'd do so.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 3:25 pm
by roth
Darn, I thought Wave invites had proliferated far and wide across the inter-tubes by now!

Unfortunately, I don't have any normal invites at the moment. I'll keep this post updated as I roll more features into Quizzy, and hopefully by the time the wider QB community is on Wave, it will be fully functional. Also, if/when I receive some invites, I'll let you all know. I've got Developer Sandbox preview invites, but I don't think it's appropriate if I give those out here.

By the way, for those of you who do indeed have Wave, feel free to add me as a contact - CounterStryker@googlewave.com. I'd love to test out Quizzy with other people present in the Wave so I can see what sort of collisions I get when multiple people request questions at once.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 3:34 pm
by MicroEStudent
roth wrote:Darn, I thought Wave invites had proliferated far and wide across the inter-tubes by now!

Unfortunately, I don't have any normal invites at the moment. I'll keep this post updated as I roll more features into Quizzy, and hopefully by the time the wider QB community is on Wave, it will be fully functional. Also, if/when I receive some invites, I'll let you all know. I've got Developer Sandbox preview invites, but I don't think it's appropriate if I give those out here.

By the way, for those of you who do indeed have Wave, feel free to add me as a contact - CounterStryker@googlewave.com. I'd love to test out Quizzy with other people present in the Wave so I can see what sort of collisions I get when multiple people request questions at once.
I've added you. The bot looks cool.

I'm jetzzfan@googlewave.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 3:51 pm
by Mike Bentley
How do you plan on solving problems like matching what the user typed to what the answer line of a question is actually looking for?

For instance, if you had an answer line like:
ANSWER: Huckleberry Finn [accept either underlined answer; accept "The Adventures of Huckleberry Finn" before the end of the first line; prompt on "Tom Sawyer" until mentioned]
How do you figure out what's acceptable when with a bot?
What do you do about someone who answers "Huck Fin"?

The TriviaBot on #scobowl handles these problems by creating specific formatting for the answer line, but even then it can only get so far. Spelling mistakes are counted as incorrect, and the prompting is less precise than a human. Mainly it relies on a "Gamemaster" or moderator to override answer lines if someone is right but the bot doesn't recognize it.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 3:56 pm
by Susan
Count me in as another person who'd be interested in trying this if I had a Google Wave account (myamphigory@gmail.com if you have invites to share!).

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 4:39 pm
by Nine-Tenths Ideas
And I as well, as I love the scobowl bot to death.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 4:52 pm
by roth
Bentley Like Beckham wrote:How do you plan on solving problems like matching what the user typed to what the answer line of a question is actually looking for?

For instance, if you had an answer line like:
ANSWER: Huckleberry Finn [accept either underlined answer; accept "The Adventures of Huckleberry Finn" before the end of the first line; prompt on "Tom Sawyer" until mentioned]
How do you figure out what's acceptable when with a bot?
What do you do about someone who answers "Huck Fin"?

The TriviaBot on #scobowl handles these problems by creating specific formatting for the answer line, but even then it can only get so far. Spelling mistakes are counted as incorrect, and the prompting is less precise than a human. Mainly it relies on a "Gamemaster" or moderator to override answer lines if someone is right but the bot doesn't recognize it.
That's the biggest problem I'm anticipating with this project.

At the moment, I don't have a nice solution in mind. it would've been nice if the acfdb stored information in another way, but as far as I can tell, there's just an answer field in each element of the database; there isn't even any underlining or anything. If the information on acceptable answers (even if just in the form of underlining the correct parts of hte answer) were available in the db, it would be very simple to figure out when answers are correct.

This will be a problem down the line, though. First, I need the Wave API to mature so that I can flesh out the rest of the bot's behavior. When the time comes to figure out how to deal with all the correct answers, I'm sure I'll think of something. One goal for the project is to simply develop a helper for people studying for quiz bowl, so if enough people are using hte robot in this fashion, I could add a feedback feature so that each time a question is asked and an answer is given, the person using the bot could submit acceptable answers back to the bot to store in its database. I don't want to crowd-source, but without some sort of meta-data in any of the qb databases, it's really the only way that 17,000 questions can be adequately modified!

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 5:08 pm
by Mike Bentley
Well, the TriviaBot has several sets (not as much as the databases probably) formatted in a more friendly manner. Alejandro can probably provide you with them.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 5:09 pm
by Deviant Insider
I think Mike is right. I don't trust this thing to judge the correctness of answers on a consistent basis.

If you wanted to have something resembling a real match, you probably would need a screen facing each team. After one team buzzes in and answers, the answer would show on their screen, and they would decide whether or not it was right, going against themselves on iffy situations (so that a protest could go in their favor after the other team had a chance to answer if the first answer actually was correct). If they marked themselves right, then the answer would show up on the other team's screen, and the other team would have a chance to protest. If they marked themselves wrong, then the other team would get a chance to finish the question. On bonuses, you could just have the other team judge the correctness of the controlling team, giving the controlling team a chance to protest.

Assuming that neither team consists of a bunch of jerks, this could all happen pretty quickly and easily. If a team does consist of a bunch of jerks, then they should stop playing quizbowl.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 5:38 pm
by roth
Shcool wrote:I think Mike is right. I don't trust this thing to judge the correctness of answers on a consistent basis.

If you wanted to have something resembling a real match, you probably would need a screen facing each team. After one team buzzes in and answers, the answer would show on their screen, and they would decide whether or not it was right, going against themselves on iffy situations (so that a protest could go in their favor after the other team had a chance to answer if the first answer actually was correct). If they marked themselves right, then the answer would show up on the other team's screen, and the other team would have a chance to protest. If they marked themselves wrong, then the other team would get a chance to finish the question. On bonuses, you could just have the other team judge the correctness of the controlling team, giving the controlling team a chance to protest.

Assuming that neither team consists of a bunch of jerks, this could all happen pretty quickly and easily. If a team does consist of a bunch of jerks, then they should stop playing quizbowl.
That's an interesting idea, and one that would be very workable. I'll jot that down...

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 6:15 pm
by rjaguar3
Shcool wrote:I think Mike is right. I don't trust this thing to judge the correctness of answers on a consistent basis.

If you wanted to have something resembling a real match, you probably would need a screen facing each team. After one team buzzes in and answers, the answer would show on their screen, and they would decide whether or not it was right, going against themselves on iffy situations (so that a protest could go in their favor after the other team had a chance to answer if the first answer actually was correct). If they marked themselves right, then the answer would show up on the other team's screen, and the other team would have a chance to protest. If they marked themselves wrong, then the other team would get a chance to finish the question. On bonuses, you could just have the other team judge the correctness of the controlling team, giving the controlling team a chance to protest.

Assuming that neither team consists of a bunch of jerks, this could all happen pretty quickly and easily. If a team does consist of a bunch of jerks, then they should stop playing quizbowl.
What if an answer needs to be prompted? Then the first team cannot supply more information, as they have already seen the correct answer.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 9:47 pm
by roth
I'll re-iterate that first and foremost, Quizzy is designed to serve questions - ACF questions right now because it was very easy to download a collection of them. In the future, when the Wave API matures a bit, I'll tackle some of these issues. I think it might be very interesting to build a Gadget to compliment Quizzy which could handle the automation of the actual Quiz Bowl match - prompting for answers, managing teams/scores, etc. For the short term, though, Quizzy will just be a question/answer provider. I have a midterm in my physical meteorology course tomorrow morning, but once it's done, I'll patch Quizzy to not show any answers until the user requests to see them, and then I might try to naively check user-input answers against the stored answer to the question.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 10:01 pm
by The King's Flight to the Scots
I'd like an invite, I guess. mlybollinger@gmail.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 10:46 pm
by Auroni
This is pretty intriguing, but I don't have Google Wave. auronigupta@gmail.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 10, 2009 11:54 pm
by Broad-tailed Grassbird
Solid for now. Post updates.
wave me nalinl AT googlewave DOT com

I think Michael Hausinger randomly found me on wave?

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 1:01 am
by Quantum Mushroom Billiard Hat
nalin wrote:Solid for now. Post updates.
wave me nalinl AT googlewave DOT com

I think Michael Hausinger randomly found me on wave?
Yeah, I'm hausingerm. I'll invite people once I have the ability to do so.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 7:51 am
by Nine-Tenths Ideas
By the way, I'm IBHirsch@ gmail.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 8:00 am
by millionwaves
My account just got activated, I'll send out invites to the first n people who posted when I'm able.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 9:09 am
by Susan
I just realized I posted begging for an account but didn't post my gmail address; it's myamphigory@gmail.com .

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 9:17 am
by Broad-tailed Grassbird
millionwaves wrote:My account just got activated, I'll send out invites to the first n people who posted when I'm able.
From what I've heard they come in 12s, but it's hard to get them. I know one guy who got 30 invites (after getting 12).

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 1:17 pm
by Auks Ran Ova
Sure, why not; strifeheart@gmail.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 1:36 pm
by Not That Kind of Christian!!

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 1:52 pm
by Kwang the Ninja
This sounds awesome.
acousticguitar309@gmail.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 2:23 pm
by Mechanical Beasts

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 3:06 pm
by naturalistic phallacy
Why the hell not. b.sabelotodo@gmail.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 3:09 pm
by tkpatel
tirthkpatel at gmail dot com.

Thanks

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 3:25 pm
by Sir Thopas
[my first name] at brown dot edu

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 3:56 pm
by ieppler
Sir Thopas wrote:[my last name] at brown dot edu

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 3:59 pm
by Self-incompatibility in plants
rstaraila at gmail dot com

Thanks.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 5:13 pm
by Down and out in Quintana Roo
Yes please, if you may.

andrewchrz AT gmail DOT com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 7:01 pm
by roth
So Google graced me with about a dozen invites this afternoon; I've already promised a handful of collaborators on a separate Wave project that I'd shoot invites their way, but once they're taken care of, I should have ~6 more to give out. Hopefully tomorrow I'll confirm that everyone is on that i've invited and send invites starting at the top of the thread.

By the way, Google is activating them REALLY fast now; I had to wait two weeks after being invited to get my account, and I only got it because I was accepted into the Developer Sandbox. However, I sent my brother one last night and he's already on; I wouldn't be surprised if Google opens the entire system in the next month or so.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 11, 2009 11:27 pm
by mhayes
I'd like to try it.

[email redacted by request]

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Fri Nov 13, 2009 3:51 pm
by The Friar
I'll beg for an invite. deep.friar@gmail.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Sun Nov 15, 2009 1:21 am
by Boeing X-20, Please!
Obligatory remark. MoWinkla@Gmail.com

EDIT: Got invited already!

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Sun Nov 15, 2009 1:41 am
by Kouign Amann
An excuse to try out Wave? How could I resist?

prof.whoopie@gmail.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Sun Nov 15, 2009 3:51 am
by Alejandro
I'd like to try it.

rapidflash06 a.t. gmail.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Sun Nov 15, 2009 6:41 pm
by roth
Just an FYI, all Python-based robots for Wave (including Quizzy) are currently broken. Google's most recent slew of API updates have messed up the functionality which allows Python robots to create new Blips, so while Quizzy is still working behind the scenes, questions aren't currently being correctly sent to the end Wavelet.

I'll let you all know once this functionality is restored.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Mon Nov 23, 2009 7:56 pm
by MicroEStudent
I just got allocated 8 invitations and am willing to give them to the people in the thread starting from the top, but if you already received an invite, let me know so I can go to the next person. If I don't hear anything, I'll start sending out the invitations Wednesday around 4 Eastern.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Mon Nov 23, 2009 8:02 pm
by jonah
MicroEStudent wrote:I just got allocated 8 invitations and am willing to give them to the people in the thread starting from the top, but if you already received an invite, let me know so I can go to the next person. If I don't hear anything, I'll start sending out the invitations Wednesday around 4 Eastern.
I don't need one.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Mon Nov 23, 2009 8:05 pm
by BGSO
jonah wrote:I don't need one.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Mon Nov 23, 2009 8:18 pm
by Cody
acvoight AT gmail.com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 24, 2009 10:30 pm
by master15625
I would like an invite to this as well.

ngurramaster7744 at gmail dot com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Tue Nov 24, 2009 11:59 pm
by Auroni
I just got a google wave invite and don't need one.

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 25, 2009 12:43 am
by Sima Guang Hater
I'd like in on this. InfiniteStryker0 [a} gmail dot com

Re: Quizzy, an Excuse for you to Try Out Google Wave

Posted: Wed Nov 25, 2009 10:26 am
by master15625
master15625 wrote:I would like an invite to this as well.

ngurramaster7744 at gmail dot com
I got an invite to this, so I don't need another one. Thanks