Metrics API

Metrics evaluate the quality of unlearning across multiple dimensions: forgetting quality, model utility, privacy, and efficiency.

Metric Suite

Forgetting Metrics

Utility Metrics

Privacy Metrics

Efficiency Metrics

Benchmarks

Metric Registry

from erasus.core.registry import metric_registry

# List all registered metrics
print(metric_registry.list())

# Run a suite of metrics
from erasus.metrics.metric_suite import MetricSuite
suite = MetricSuite(["accuracy", "mia", "kl_divergence"])
results = suite.run(model, forget_loader, retain_loader)