✨ What You’ll Do
Adding more metrics makes Pruna’s evaluations more insightful, so we’re excited to welcome Multi Scale SSIM from torchmetrics source into our metric lineup! 🎉
Multi Scale SSIM is a generalization of the SSIM score, which computes the SSIM score at different resolution scales to get a more accurate representation
🛠️ Dependency
We are already actively using metrics from torchmetrics so you should be good to go!
📐 Metric Class
We already have a wrapper class for integrating metrics from torchmetrics at pruna/evaluation/metrics/metric_torch.py. You can easily integrate MultiScale SSIM there!
Quick Overview
- File & Class
- Add MultiScale SSIM to the TorchMetrics Enum
- Configuration
- Choose a sensible
call_type
- Decide if you need to implement an update function
- Testing & Docs
- Write unit tests under
tests/evaluation/metrics/test_torch_metrics.py
And that's all!
✅ Acceptance Criteria
- Correct Output:
compute(...) returns a sensible result
- Tests & Docs: All existing and new unit tests pass, and the documentation is updated
And don’t forget to give us a ⭐️!
❓ Questions?
Feel free to jump into our Discord channel if you hit any roadblocks. Can’t wait to see your contribution of this metric! 🚀
Share on X

✨ What You’ll Do
Adding more metrics makes Pruna’s evaluations more insightful, so we’re excited to welcome Multi Scale SSIM from
torchmetricssource into our metric lineup! 🎉Multi Scale SSIM is a generalization of the SSIM score, which computes the SSIM score at different resolution scales to get a more accurate representation
🛠️ Dependency
We are already actively using metrics from torchmetrics so you should be good to go!
📐 Metric Class
We already have a wrapper class for integrating metrics from torchmetrics at
pruna/evaluation/metrics/metric_torch.py. You can easily integrate MultiScale SSIM there!Quick Overview
call_typetests/evaluation/metrics/test_torch_metrics.pyAnd that's all!
✅ Acceptance Criteria
compute(...)returns a sensible resultAnd don’t forget to give us a ⭐️!
❓ Questions?
Feel free to jump into our Discord channel if you hit any roadblocks. Can’t wait to see your contribution of this metric! 🚀
Share on X