Evaluation Runner API¶
Complete evaluation runner for NAICS embeddings.
Contains: - NAICSEvaluationRunner: Comprehensive evaluation runner that uses all metric classes
NAICSEvaluationRunner
¶
__init__(model)
¶
Complete evaluation runner for NAICS embeddings.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
model
|
NAICSContrastiveModel
|
Trained NAICSContrastiveModel instance |
required |
Device is automatically detected via get_device().
evaluate(embeddings, tree_distances=None, ground_truth_relevance=None, k_values=[5, 10, 20])
¶
Run comprehensive evaluation.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
embeddings
|
Tensor
|
Learned embeddings (N, D) |
required |
tree_distances
|
Optional[Tensor]
|
Ground truth tree distances (N, N), optional |
None
|
ground_truth_relevance
|
Optional[Tensor]
|
Binary relevance matrix (N, N), optional |
None
|
k_values
|
List[int]
|
k values for precision@k and recall@k |
[5, 10, 20]
|
Returns:
| Type | Description |
|---|---|
Dict[str, Any]
|
Dictionary of all evaluation metrics |