My model said that the probability of Ita beating SA in 128 boards without carry-over was ninety-one-point-something percent. In 96 boards with a small negative carry-over it is less than that. So SA's win is not sensational. In fact if all my predictions turned out to be accurate you could have criticized my model for having an inflated error term.
I'm not saying this to argue that my model is perfect. Of course it's not.
But I do think that simple models with well-understood mathematical properties are good places to start. The parameters estimated in my model have interpretations: the coefficient of country X is the number of IMPs country X wins against an average team in 16 boards. The residual SD is the median deviation from my prediction found in real 16-board matches.
Also my assumptions are bridge-vise meaningful, explicit and can be tested. It has been suggested here (Frances) that the quarter-final results may be over-dispersed relative to my predictions. It has been suggested that my linear response function may in fact be convex. These alternative hypotheses can be tested (I hope to find time to do that shortly. On the basis of the first ten rounds the response function was slightly convex but not significantly so. It might have become significant in the meantime, it might not). Suppose the critics of my model turn out to be right. Then we will have learned something interesting about the nature of such a bridge event.
Models are most successful at the moment when one discovers that they don't conform with reality. This is when they really help us learn something.
Who will stop Italy?
#81
Posted 2007-October-09, 03:07
The world would be such a happy place, if only everyone played Acol :) --- TramTicket
#82
Posted 2007-October-09, 04:34
cherdano, on Oct 9 2007, 12:35 AM, said:
jdonn, on Oct 8 2007, 04:09 PM, said:
Arend, when you say SA had more luck, isn't that just what Richard was already saying with "this suggested that the Italy v SA was an outlier"?
Your point 1. is well taken though.
Your point 1. is well taken though.
No, I think Richard was saying the exact opposite. He was saying that Helene's analysis wrongly assumed that the the win by SA vs Italy in the round robin was an outlier (probably implying that the quarter final result may have proven this wrong).
I have to say that in all the quarters I have been watching, the Italians were playing a bit better than the South Africans.
In data analysis, "outliers" are atypical observations that occur too frequently to be considered effects of the normal statistical fluctuations but too infrequent to support a modification of the model. They are typically either removed prior to the analysis, or (better) one uses so-called robust estimators that let the outliers stay in the data set but don't allow them to influence the fitted parameters more than a more typical deviation in the same direction would.
For example if everyone had adequate defense against everyone's methods except that the Italians were helpless agaist SA's overcall structure, it could be that the residuals were generally normal distributed except that SA-Ita was some ten standard deviations off, something that is very unlikely to occur even in a single match in a 231-match RR. (It could also be an outlier if one of the Italians missed the bus on his travel to the match against SA and was replaced by a kibber who couldn't tell the diference between Bridge and Go Fish, but then it should have no implications for the prediction of the QF outcome. However, a model cannot tell such different kinds of outliers appart because outliers are, per definition, not accounted for by the model. Besides, the available data might be the same in both cases).
Whether something weired was going on in Ita-SA in the RR I cannot tell because the result was not unusual. Even the QF was too short to be identifiable as an atypical match. Maybe expert kibbers observed something unusual, or maybe something can be learned from the per-board statistics, but from the result of the match alone there is no reason to suspect that is was an unusual match.
As for my model, it's just a standard linear model, I don't consider anything to be outliers, and from the residual histograms it doesn't look like I should. I believe it would be a very bad idea to do outlier removal in this case. I sometimes do use robust estimators but I doubt that they are called for in the analysis of bridge results, and in any case, with only 231 data points and 22 parameters, the standard errors are huge and it is imperative to use the most efficient estimators.
The world would be such a happy place, if only everyone played Acol :) --- TramTicket
#83
Posted 2007-October-09, 07:19
matmat, on Oct 8 2007, 04:15 PM, said:
I don't know about running monte-carlos to simulate outcomes, but it does strike me that this is more of a graph theory problem than anything (and, those who have their nose in math more than I do, can tell me how much I am wrong there).
Simulations could be useful if there was not direct way of estimating the parameters in the model. Then one can try with different parameter settings until the simulation results become similar to the observations.
Not to confuse with Markov Chain Monte Carlo, in which one simulates a Markov Chain that is known to converge towards the posterior distribution of the parameters.
The world would be such a happy place, if only everyone played Acol :) --- TramTicket
#84
Posted 2007-October-09, 12:34
Latest news: the additivity assumption holds (at least on average):

The plot shows crossvalidation expected match results (positive, i.e. stronger team vs weaker team) on the x-axis, and crossvalidation residuals on the y axis).
If the true response function was non-linear (e.g convex), there would have been a trend. In particular, the expected results for extreme-difference matches such as Italy-T&T would have been biased. The p-value for the zero hypothesis that the Pearson correlation is zero, is 0.86.
The data used are per-round IMP scores from the round robin. The crossvalidation type was leave-one-round-out.
This is not to say that bridge results are always additive. Add a team of Gozillas from the local coffee-house and maybe Italy will not, on average, beat them by 33 IMPs more than T&T will beat them. But for the purpose of Bermuda Bowl it seems that additivity is a reasonable assumption.

The plot shows crossvalidation expected match results (positive, i.e. stronger team vs weaker team) on the x-axis, and crossvalidation residuals on the y axis).
If the true response function was non-linear (e.g convex), there would have been a trend. In particular, the expected results for extreme-difference matches such as Italy-T&T would have been biased. The p-value for the zero hypothesis that the Pearson correlation is zero, is 0.86.
The data used are per-round IMP scores from the round robin. The crossvalidation type was leave-one-round-out.
This is not to say that bridge results are always additive. Add a team of Gozillas from the local coffee-house and maybe Italy will not, on average, beat them by 33 IMPs more than T&T will beat them. But for the purpose of Bermuda Bowl it seems that additivity is a reasonable assumption.
The world would be such a happy place, if only everyone played Acol :) --- TramTicket

Help
