Wednesday, 30 March 2016

This is kind of like reruns. Maybe it's a "remastered" post?

First up, killing the Supreme Court.  Again.  But still with numbers and statistics, because that's the best way to do things.  Assume the Senate decides to stop being dumb.  Then, Merrick Garland gets a hearing and since he's basically fine, he gets a seat on the Supreme Court.  Since my least favorite justice is dead.
So here's the cumulative "how many justices are alive" plot.  Honestly, according to this, if the Senate doesn't stop acting like children, Obama might have two more people to appoint before the end of his term.  It's good that the Republicans aren't running serious options this year, since that sets up a good shift when they don't become president.
And the by name individual plot.  I've seen a lot of stuff talking about how Garland is "already old" so it "doesn't matter" if he gets confirmed or not.  This is stupid.  The cumulative plot clearly shows that the next president is very important for determining the Supreme Court's future.
In any case, he's younger than the median justice, and is likely to be on the court for another ~15 years.  Or, you know, the next four presidential terms.  Also, it's interesting to note the benefit of appointing women to the court.  Roberts was born in 1955, and Sotomayor in 1954.  That's the unit the script uses for sorting the key.  But, looking at the graph, Sotomayor is likely to be on the court ~3 years longer.  I should also enable the grid display next time I do this.

Sunday, 27 March 2016

Final final four

Today's also the last day I update the sports stuff for this year.  Here's the table for the rest of the tournament:

#BracketN_R1PP_R1Nwrong_R1P_R1S_R1N_R2PP_R2Nwrong_R1P_R2S_R2
Mine321626.995162450.998
Heart-of-the-cards3211022.656162838.320
Julie3211022.656162642.738
BHO321923.823162643.820
538321824.928162742.738
Rank3211319.129162639.424
#BracketN_R3PP_R3Nwrong_R3P_R3S_R3N_R4PP_R4Nwrong_R4P_R4
Mine84370.99890348378
Heart-of-the-cards84646.04448446
Julie84458.61048458
BHO84459.67448367
53884266.95548282
Rank84263.87548371
#BracketN_R3PP_R3Nwrong_R3P_R3N_R4PP_R4Nwrong_R4P_R4
Mine216278132178
Heart-of-the-cards216246132146
Julie216258132158
BHO2161+67+132167+
538216282132182
Rank216271132171

If the President gets his pick correct in the next round, then he'll win with an 83.  Otherwise, 538 wins based on only getting two wrong in round 4.  Everything else is locked in now, so there's nothing really to update anymore.

Friday, 25 March 2016

Round 3

Since it's the weekend, it's sports time.  First up, my picks for this round of things:
One that I was doomed to get wrong.

And the other doomed one.  But a new mistake!

Texas A&M:
29.687500       14.062500       3.125000                3       6       3       Texas A&M
28.125000       18.750000       21.875000               3       8       2       Oklahoma

First up, I think my analysis notes have been wrong on the previous posts.  The file I'm pulling these numbers from is in 2016/2015/2014/group/game/rank/name format, not 2014/2015/2016 format.  This changes the analysis for some of my previous mistakes, but I'm too lazy to go correct those.  In any case, using this new, correct information, it looks like I thought (from the 2016 ratings) that Texas A&M should be slightly better than Oklahoma.  Folding in previous years could have potentially altered that choice.

I was thinking a bit about adding some score-based information in as well.  The idea being that each team scores a given median number of points across all their games, and have a given median number of points scored against them.  By comparing how well a given score ranks in all their games, and against their opponent's, it should be possible to construct offense and defense ratings.  This might be useful to say, "Team X is generally better, but they only are a +1 in offense, and they're playing a +4 defense, so they might not win."  The other benefit would be to add two new metrics, which could then be used across the full multi-year dual-gender score set to determine which relative weights each should be assigned to a more complete prediction model.

I think the first step that I should do, though, is to dump all of that data into a database, instead of using horrible fixed-width formatted files to manage things.  That's largely a consequence of not really caring a lot about the project.


In any case, here's the comparison table for round three:

#BracketN_R1PP_R1Nwrong_R1P_R1S_R1N_R2PP_R2Nwrong_R1P_R2S_R2
Mine321626.995162450.998
Heart-of-the-cards3211022.656162838.320
Julie3211022.656162642.738
BHO321923.823162643.820
538321824.928162742.738
Rank3211319.129162639.424
#BracketN_R3PP_R3Nwrong_R3P_R3S_R3N_R4PP_R4Nwrong_R4P_R4S_R4
Mine84370.99890348
Heart-of-the-cards84646.04448
Julie84458.61048
BHO84459.67448
53884266.95548
Rank84263.87548

This now has the added columns of S_RX.   These are my simulated CDF values based on the Yahoo selection pick fractions given for each team.  This is another piece of kind-of garbage code that I threw together earlier in the week.  I think it's doing everything correctly, but I don't see any simulated results that get a total score above 83, and yahoo does list some in their leader list.  Maybe 1e6 simulations isn't sufficient to fully probe things?  Maybe I'm truncating or rounding something odd?  The main idea behind this calculation is to see how well a given set of picks should rank.

Plots for individual rounds and the total after three.  In general, the mean drops (because past mistakes have continuing consequences) and the variance increases (because there's the 2^N point scaling thing and because the number of individual games is falling as well).

Sunday, 20 March 2016

Round 2

today was the end of round two of the sports thing.  I also need to go back and update posts with the new label I've decided is probably useful, "sports".  So I updated everything before the final game was over, and then had to double check nothing went wrong:

Copying from 538.  Two of those I didn't care about anymore due to prior choices, one of them I kind of knew was going to be the case, one of them I wasn't expecting to take two overtimes to come to my result, one apparently fell apart in the last two seconds, and the final one had me frowning at it until it decided not to make me re-edit all my stuff.
 Results for this time:


Again, three of my four mistakes this time around were caused by my winning choice being eliminated in the previous round.  For the last one:

Xavier:
12.500000       42.187500       29.687500               2       7       7       Wisconsin
34.375000       12.500000       14.062500               2       8       2       Xavier

Why did I choose Xavier?  Did I get confused and use the 2014 rankings instead of the 2016 ones?  This looks like me being dumb.  Maybe I took the #2 ranking too seriously?  I should probably write down logic notes next time, so I can point to the error directly.

What does the scoring comparison look like?

#BracketN_R1PP_R1Nwrong_R1P_R1N_R2PP_R2Nwrong_R1P_R2
Mine321626162450
Heart-of-the-cards3211022162838
Julie3211022162642
BHO321923162643
538321824162742
Rank3211319162639

Again the "rank" method is garbage, and shouldn't be used.  Nate Silver had a tweet earlier about how this is apparently because it's based on RPI too much.  Looking at wikipedia, it looks like RPI is an incomplete version of my LAM method.  ¯\_(ツ)_/¯  This also shows the point where HotC totally falls apart, becoming the worst method.  Everyone else is pretty well clumped together.  I'm a bit surprised that 538 isn't doing better, given the "we included scores, and at-home values, and distances to the games, and the number of cats each player owns, and the SAT scores of each player."

This also makes me think I should have actually entered my selections into some pool.  Maybe I should hone the method a bit more, and see how it works over a few more years.  Or, alternatively, I could do the reasonably easy thing and apply the method to the historical data, and see if this consistently matches reality.  Maybe next weekend, since I think it's a long one.  This will also make me fix my master Makefile to put things into logical directories, and not just dump the outputs into a common directory.

Friday, 18 March 2016

Round one

Statistics results.

Ok, that West Virginia loss is going to hit the later rounds.

As is Purdue.  Not as bad as Michigan State, obviously.
Let's look at the comparison table:

#BracketN_R1PP_R1Nwrong_R1P_R1
Mine321626
Heart-of-the-cards3211022
Julie3211022
BHO321923
538321824
Rank3211319

The columns are the bracket identifier, the number of games in the round, the points per correct selection in the round, the number wrong, and the total points.  The brackets are mine above, the "Heart of the Cards" bracket taken by simply selecting teams based on the 2016 ranking I calculated, Julie's bracket, President Obama's, the 538 bracket taken by assuming constant composite rankings from their pre-tournament predictions, and a dummy bracket constructed by selecting teams based solely on their "sport rank" thing.  That's actually working out a lot better than I expected.  I was correct in shaking up the straight HotC numbers with a bit of historical data.  Looking at the mistakes:

Arizona:
26.562500       43.750000       40.625000               1       5       6       Arizona
25.000000       37.500000       53.125000               5       1       11      Wichita St

I didn't believe the numbers, given the #11 ranking.  From above, I should ignore the ranking in the future, because it's pretty crappy.  The problem is that my numbers suggest that Wichita State is the best team in the entire thing, which doesn't seem like it's right.

West Virginia:
28.125000       21.875000       1.562500                2       6       3       West Virginia
34.375000       39.062500       45.312500               2       6       14      SF Austin

Ditto.  My numbers predict that SF Austin is the second best team.  I guess if either of them come out winning, I can say that I predicted it, and then tossed it in the trash.

Baylor:
17.187500       23.437500       20.312500               3       3       5       Baylor
25.000000       18.750000       7.812500                3       3       12      Yale

No clue, but it sounds like everyone was surprised by this one.

Purdue:
29.687500       14.062500       -3.125000               4       3       5       Purdue
37.500000       -7.812500       -3.125000               4       3       12      Ark Little Rock

My numbers say they both suck, so I went with last year's numbers to break the tie.  I could have added in the 2014 values, but this was a #12 ranking, and I didn't believe those.

Dayton:
28.125000       26.562500       20.312500               4       7       7       Dayton
9.375000        7.812500        34.375000               4       7       10      Syracuse

This one I should have gotten right.  I folded the two previous years in, and that said that I should trust consistency over a sudden jump.  Maybe Syracuse has some new great player.

Michigan State:
35.937500       18.750000       28.125000               4       8       2       Michigan St
23.437500       3.125000        23.437500               4       8       15      MTSU

Again, this one seemed like it was a surprise to everyone.  There are only three values of my ranking between these two values, so that kind of suggests they're within ~5% of each other in terms of skill.  Oh well.

Tuesday, 15 March 2016

I didn't really do any of the improvements I discussed two years ago.

Basketball

Basically my solution this time was:

  1. Check with Julie that no team went undefeated this year.  That was my big problem last time.
  2. Run the 2016, 2015, and 2014 game solutions to determine the relative rankings for all of the teams in each of those years.
  3. Rank things based on the 2016 solution, letting 2015 solutions break ties.  Also use this information (and the 2014) for solutions to:
  4. Anytime a #12 sport-ranked team is ranked substantially above a 1-4 sport-ranked team, assume something is off with the model, because I have a lot of #12 ranked teams ranked really high for some reason.
So the result table is:


#2014.score     2015.score      2016.score    group   game  sport-rank  2016.score      Team.name
23.437500       28.125000       40.625000       1       1       1       40.625000       Kansas
-9.375000       -21.875000      1.562500        1       1       16      1.562500        Austin Peay
18.750000       -3.125000       17.187500       1       2       8       17.187500       Colorado
29.687500       7.812500        20.312500       1       2       9       20.312500       Connecticut
3.125000        32.812500       26.562500       1       3       5       26.562500       Maryland
9.375000        20.312500       29.687500       1       3       12      29.687500       S Dakota St
10.937500       4.687500        20.312500       1       4       4       20.312500       California
14.062500       14.062500       34.375000       1       4       13      34.375000       Hawaii
40.625000       43.750000       26.562500       1       5       6       26.562500       Arizona
NAN     NAN     NAN     1       5       11      NAN     VAN/WICH
1.562500        18.750000       28.125000       1       6       3       28.125000       Miami FL
14.062500       21.875000       9.375000        1       6       14      9.375000        Buffalo
12.500000       15.625000       17.187500       1       7       7       17.187500       Iowa
-20.312500      23.437500       15.625000       1       7       10      15.625000       Temple
37.500000       46.875000       37.500000       1       8       2       37.500000       Villanova
3.125000        -1.562500       17.187500       1       8       15      17.187500       UNC Asheville
21.875000       20.312500       34.375000       2       1       1       34.375000       North Carolina
NAN     NAN     NAN     2       1       16      NAN     FGCU/FDU
-15.625000      -12.500000      14.062500       2       2       8       14.062500       USC
18.750000       17.187500       20.312500       2       2       9       20.312500       Providence
3.125000        10.937500       28.125000       2       3       5       28.125000       Indiana
4.687500        18.750000       37.500000       2       3       12      37.500000       Chattanooga
20.312500       53.125000       26.562500       2       4       4       26.562500       Kentucky
18.750000       17.187500       31.250000       2       4       13      31.250000       Stony Brook
-3.125000       37.500000       15.625000       2       5       6       15.625000       Notre Dame
NAN     NAN     NAN     2       5       11      NAN     MICH/TULSA
1.562500        21.875000       28.125000       2       6       3       28.125000       West Virginia
45.312500       39.062500       34.375000       2       6       14      34.375000       SF Austin
29.687500       42.187500       12.500000       2       7       7       12.500000       Wisconsin
25.000000       6.250000        15.625000       2       7       10      15.625000       Pittsburgh
14.062500       12.500000       34.375000       2       8       2       34.375000       Xavier
12.500000       -6.250000       26.562500       2       8       15      26.562500       Weber St
21.875000       25.000000       34.375000       3       1       1       34.375000       Oregon
NAN     NAN     NAN     3       1       16      NAN     HC/SOUTH
23.437500       -7.812500       29.687500       3       2       8       29.687500       St Joseph's PA
32.812500       18.750000       18.750000       3       2       9       18.750000       Cincinnati
20.312500       23.437500       17.187500       3       3       5       17.187500       Baylor
7.812500        18.750000       25.000000       3       3       12      25.000000       Yale
28.125000       40.625000       20.312500       3       4       4       20.312500       Duke
-21.875000      6.250000        28.125000       3       4       13      28.125000       UNC Wilmington
20.312500       10.937500       12.500000       3       5       6       12.500000       Texas
1.562500        42.187500       15.625000       3       5       11      15.625000       Northern Iowa
3.125000        14.062500       29.687500       3       6       3       29.687500       Texas A&M
26.562500       23.437500       17.187500       3       6       14      17.187500       WI Green Bay
0.000000        4.687500        10.937500       3       7       7       10.937500       Oregon St
28.125000       26.562500       23.437500       3       7       10      23.437500       VA Commonwealth
21.875000       18.750000       28.125000       3       8       2       28.125000       Oklahoma
-9.375000       -7.812500       25.000000       3       8       15      25.000000       CS Bakersfield
34.375000       40.625000       29.687500       4       1       1       29.687500       Virginia
7.812500        -1.562500       17.187500       4       1       16      17.187500       Hampton
-6.250000       -9.375000       10.937500       4       2       8       10.937500       Texas Tech
-4.687500       18.750000       17.187500       4       2       9       17.187500       Butler
-3.125000       14.062500       29.687500       4       3       5       29.687500       Purdue
-3.125000       -7.812500       37.500000       4       3       12      37.500000       Ark Little Rock
29.687500       26.562500       15.625000       4       4       4       15.625000       Iowa St
17.187500       26.562500       18.750000       4       4       13      18.750000       Iona
0.000000        1.562500        26.562500       4       5       6       26.562500       Seton Hall
34.375000       46.875000       29.687500       4       5       11      29.687500       Gonzaga
14.062500       25.000000       28.125000       4       6       3       28.125000       Utah
4.687500        -3.125000       25.000000       4       6       14      25.000000       Fresno St
20.312500       26.562500       28.125000       4       7       7       28.125000       Dayton
34.375000       7.812500        9.375000        4       7       10      9.375000        Syracuse
28.125000       18.750000       35.937500       4       8       2       35.937500       Michigan St
23.437500       3.125000        23.437500       4       8       15      23.437500       MTSU
-1.562500       10.937500       9.375000        5       1       11      9.375000        Vanderbilt
53.125000       37.500000       25.000000       5       1       11      25.000000       Wichita St
14.062500       17.187500       10.937500       5       2       16      10.937500       FL Gulf Coast
-17.187500      -20.312500      6.250000        5       2       16      6.250000        F Dickinson
26.562500       0.000000        15.625000       5       3       11      15.625000       Michigan
14.062500       18.750000       14.062500       5       3       11      14.062500       Tulsa
9.375000        -3.125000       -7.812500       5       4       16      -7.812500       Holy Cross
9.375000        1.562500        15.625000       5       4       16      15.625000       Southern Univ

So, using this, I can answer the following questions I saw while doing the research of "figuring out what FLGU means".

  1. I saw a thing asking if Holy Cross was underrated.  My analysis says "no," and concludes with a "holy crap, no."
  2. Kansas is probably going to win it all.
  3. Julie was right, Michigan State should have been ranked higher than Virginia.
  4. I've already scored the two group 5 games that have played correctly.

Using the espn clicky thing to use these rules (I bent rule #4 to also apply to 13-ranked teams as well):

Group 1 and 2.

Group 3 and 4.

Final stuff.  I don't know how to call the score thing.  They're separated by ~4 points in the scores, or about 10%.  So maybe 10 points, since basketball is a "log10(score) ~ 2" kind of game?

For the remaining pre-game things, I have Michigan and Southern University winning those (in addition to the correctly called Wichita State and Florida Gulf Coast).