Evaluation

realkd.evaluation.ensemble_length_vs_perf(model, metric)

Convenience method for evaluating ensemble size / performance trade-off

Parameters
  • model – ensemble model that allows to build prefixes by slicing

  • metric – evaluation metric function that accepts as single argument a model

Returns

pandas Series of ensemble performance for all sequences (including the empty and full prefix)