Ola Spjuth presenting at COPA 2019
10 Sep, 2019
Ola Spjuth presented two accepted papers at the 8th Symposium on Conformal and Probabilistic Prediction with Applications in Varna, Bulgaria on 9-11 sept 2019. The two papers below are now published in Proceedings of Machine Learning Research (PMLR) volume 105.
Paper 1: Split Knowledge Transfer in Learning Under Privileged Information Framework
Gauraha, N., Söderdahl, F. and Spjuth, O..
Split Knowledge Transfer in Learning Under Privileged Information Framework.
Proceedings of Machine Learning Research (PMLR). 105, 43-52. (2019).
URL: https://proceedings.mlr.press/v105/gauraha19a.html
ABSTRACT
Learning Under Privileged Information (LUPI) enables the inclusion of additional (privileged) information when training machine learning models, data that is not available when making predictions. The methodology has been successfully applied to a diverse set of problems from various fields. SVM+ was the first realization of the LUPI paradigm which showed fast convergence but did not scale well. To address the scalability issue, knowledge transfer approaches were proposed to estimate privileged information from standard features in order to construct improved decision rules. Most available knowledge transfer methods use regression techniques and the same data for approximating the privileged features as for learning the transfer function. Inspired by the cross-validation approach, we propose to partition the training data into K folds and use each fold for learning a transfer function and the remaining folds for approximations of privileged features—we refer to this as split knowledge transfer. We evaluate the method using four different experimental setups comprising one synthetic and three real datasets. The results indicate that our approach leads to improved accuracy as compared to LUPI with standard knowledge transfer.
Paper 2: Combining Prediction Intervals on Multi-Source Non-Disclosed Regression Datasets
Spjuth O., Brännström R.C., Carlsson L. and Gauraha, N.
Combining Prediction Intervals on Multi-Source Non-Disclosed Regression Datasets.
Proceedings of Machine Learning Research (PMLR). 105, 53-65. (2019).
URL: https://proceedings.mlr.press/v105/spjuth19a.html
ABSTRACT
Conformal Prediction is a framework that produces prediction intervals based on the output from a machine learning algorithm. In this paper we explore the case when training data is made up of multiple parts available in different sources that cannot be pooled. We here consider the regression case and propose a method where a conformal predictor is trained on each data source independently, and where the prediction intervals are then combined into a single interval. We call the approach Non-Disclosed Conformal Prediction (NDCP), and we evaluate it on a regression dataset from the UCI machine learning repository using support vector regression as the underlying machine learning algorithm, with varying number of data sources and sizes. The results show that the proposed method produces conservatively valid prediction intervals, and while we cannot retain the same efficiency as when all data is used, efficiency is improved through the proposed approach as compared to predicting using a single arbitrarily chosen source.