Skip to content

Commit eec08a5

Browse files
committed
minor updates
1 parent e86cd6f commit eec08a5

3 files changed

Lines changed: 9 additions & 25 deletions

File tree

CHANGELOG.md

Lines changed: 9 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -9,25 +9,23 @@
99
- get_roc_metrics
1010
- evaluate_multiple_llm_runs_with_roc
1111
- Added bibcat/tests/llm/test_roc.py for ROC unit tests (single-run + multi-run ROC).
12-
1312
- CLI additions and path cleanup
14-
- bibcat/main.py now includes:
15-
- llm cm-metrics
16-
- llm roc-metrics
17-
- Added internal output path helper functions to remove repeated path construction.
13+
- bibcat/main.py now includes:
14+
- llm cm-metrics
15+
- llm roc-metrics
16+
- bibcat/tests/test_cli.py includes CLI help coverage for ROC metrics command.
17+
- Added internal output path helper functions to remove repeated path construction.
1818
- bibcat/etc/bibcat_config.yaml adds:
1919
- llms.roc_metrics_file
2020

21-
- bibcat/tests/conftest.py now has shared fixtures for single-run and multi-run eval datasets.
22-
- bibcat/tests/llm/test_metrics.py updated for current single-run + multi-run confusion-matrix coverage.
23-
- bibcat/tests/test_cli.py includes CLI help coverage for ROC metrics command.
24-
2521

2622
### Changed
2723
- [PR #98](https://github.com/spacetelescope/bibcat/pull/98)
28-
- New ROC module split out from metrics.py to roc.py to separate concerns and clarify responsibilities.
2924
- bibcat/llm/metrics.py heavily refactored toward confusion-matrix + run-aggregation responsibilities.
30-
- Compatibility kept for extract_eval_data() output used by plotting and tests.
25+
- Compatibility kept for extract_eval_data() output used by plotting and tests.
26+
- bibcat/tests/conftest.py now has shared fixtures for single-run and multi-run eval datasets.
27+
- bibcat/tests/llm/test_metrics.py updated for current single-run + multi-run confusion-matrix coverage.
28+
- New ROC module split out from metrics.py to roc.py to separate concerns and clarify responsibilities.
3129
- bibcat/llm/plots.py now imports ROC helpers from bibcat.llm.roc.
3230
- ROC plotting path simplified to binary-only behavior (no multiclass branch).
3331
- docs/llm.md updated to match new commands and architecture:

bibcat/llm/roc.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,3 @@
1-
from __future__ import annotations
2-
31
from statistics import mean, pstdev
42
from typing import Any
53

bibcat/main.py

Lines changed: 0 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -711,15 +711,3 @@ def process(filename, batch_file, model, test, retrieve_batch, check, eval_batch
711711

712712
if __name__ == "__main__":
713713
cli()
714-
715-
if __name__ == "__main__":
716-
cli()
717-
718-
if __name__ == "__main__":
719-
cli()
720-
721-
if __name__ == "__main__":
722-
cli()
723-
724-
if __name__ == "__main__":
725-
cli()

0 commit comments

Comments
 (0)