Remove runtime.py and directly use torch dist utils + remove unused functions#667
Conversation
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
c78d64b to
2bbd4b7
Compare
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
2bbd4b7 to
2b5527b
Compare
e324eb7 to
092ceb1
Compare
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
092ceb1 to
563e696
Compare
|
|
||
|
|
||
| @torch.no_grad() | ||
| def validate_pipeline( |
There was a problem hiding this comment.
this is used by local distillation: v1/puzzle_tools/bypassed_training/stitched_pipelined.py
There was a problem hiding this comment.
We can add it when we move local distillation. By that time, we might have also removed sewing kit and instead use Nemo Automdel PP if that works
modelopt/torch/_compress/tools/validate_puzzle_with_multi_replacements.py
Outdated
Show resolved
Hide resolved
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## feature/compress #667 +/- ##
====================================================
+ Coverage 74.37% 74.47% +0.10%
====================================================
Files 182 183 +1
Lines 18219 18416 +197
====================================================
+ Hits 13550 13715 +165
- Misses 4669 4701 +32 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
examples/compress/configs/llama-3_1-8B_pruneffn_memory/validate_model_defaults.yaml
Outdated
Show resolved
Hide resolved
tests/gpu/torch/_compress/resources/configs/validate_model_defaults.yaml
Show resolved
Hide resolved
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
What does this PR do?
runtime.pyand directly usemodelopt.torch.utils.distributedfunctionsTesting