METRIC_NAMES
breakdown.METRIC_NAMES
Mapping of internal evaluation metric names to human-readable display names.
add_agg_columns
breakdown.add_agg_columns
Adds aggregation columns to a list of DataFrames based on a property map.
add_agg_columns(dfs, agg_columns, prop_map)
| Parameter | Type | Default | Description |
|---|---|---|---|
dfs |
- | (undocumented) | |
agg_columns |
- | (undocumented) | |
prop_map |
- | (undocumented) |
aggregate_df
breakdown.aggregate_df
Aggregate each DataFrame using the specified method and return (agg_df, signature) pairs.
aggregate_df(dfs, signatures, agg_column, eval_columns, agg_method='mean', weight_col='num_variates')
| Parameter | Type | Default | Description |
|---|---|---|---|
dfs |
- | (undocumented) | |
signatures |
- | (undocumented) | |
agg_column |
- | (undocumented) | |
eval_columns |
- | (undocumented) | |
agg_method |
'mean' |
(undocumented) | |
weight_col |
'num_variates' |
(undocumented) |
get_breakdown_table
breakdown.get_breakdown_table
Generate pivot tables for evaluation metrics by model and aggregation column.
get_breakdown_table(dfs, signatures, agg_column, eval_columns, agg_method='mean', weight_col='num_variates')
| Parameter | Type | Default | Description |
|---|---|---|---|
dfs |
- | (undocumented) | |
signatures |
- | (undocumented) | |
agg_column |
- | (undocumented) | |
eval_columns |
- | (undocumented) | |
agg_method |
'mean' |
(undocumented) | |
weight_col |
'num_variates' |
(undocumented) |
expand_complex_column
breakdown.expand_complex_column
Expands nested list columns (like 'variates_types' or 'domain') into multiple rows, assigning counts where applicable.
expand_complex_column(dfs, agg_column='')
| Parameter | Type | Default | Description |
|---|---|---|---|
dfs |
- | (undocumented) | |
agg_column |
'' |
(undocumented) |