The most basic setup uses a training set and a test set. Both the scorer and the calibrator are fitted on the training set. The log likelihood ratio cost (Cllr) may be used as a metric of performance.