2016/1/20(三)哥倫比亞大學統計系羅小華教授專題演講

講者:羅小華(Shaw-hwa Lo)教授
哥倫比亞大學統計系教授(Department of Statistics, Columbia University)

時間地點:
2016年1月20日(三)10:20-10:40 歡迎茶會(交大綜合一館428)
10:40-11:30 專題演講(交大綜合一館427)

主題:How to make good predictions: A Theoretical Framework

摘要:

Thus far, genome-wide association studies(GWAS) have been disappointing in the inability of investigators to use the results of identified ,statistically significant variants in complex diseases to make predictions useful for personalized medicine. Why are significant variables not leading to good prediction of outcomes? We point out that this problem is prevalent in simple as well as complex data, in the sciences as well as the social sciences. We offer statistical insights on why higher significance cannot automatically imply stronger predictivity. We also demonstrate that highly predictive variables do not necessarily appear as highly significant, thus evading the researcher using significance-based methods. We point out that what makes vari- ables good for prediction versus significance depends on different properties of the under lying distributions. If prediction is the goal, we must lay aside significance as the only selection standard. We suggest that progress in prediction requires efforts toward anew research agenda of searching for a novel criterion to retrieve highly predictive variables rather than highly significant variables. We offer an alternative approach that was not designed for significance, the partition retention method, which was very effective predicting on a long-studied breast cancer dataset, by reducing predicting error rate from 30% to 8%.(If time permit)

The new alternative allows us to approaching prediction from a theoretical framework grounded in maximizing correct prediction rates. We lay out an objective function for correct prediction rates for which we need to maximize, then consider and ultimately reject an estimator based on the sample analog of the solution to the maximization problem. We demonstrate that the Partition Retention method’s I-score is a measure that asymptotically approaches this alternative solution. These show that the I-score can capture highly predictive variable sets and serves as a lower bound for the out sample correct prediction rate. Future research in the avenue of alternative solutions as sample-based measures of predictivity is much desired.

主辦單位:大數據研究中心

協辦單位:統計學研究所