List of schedulers support in setup_common_training_handlers

[vfdev-5]

🚀 Feature

Feature request to support the case like :

common.setup_common_training_handlers(
        trainer=trainer,
        ...
        lr_scheduler=[lr_scheduler1, lr_scheduler2],
    )

cc @DhDeepLIT

[KickItLikeShika]

Will work on this, may take some time thinking about how to test this properly

[vfdev-5]

@KickItLikeShika we haven't yet triaged it as required enhancement.
Tricky part may be also on which events to attach schedulers. Even for a single lr_scheduler it may be not expected to have it on iterations vs epochs

[KickItLikeShika]

@vfdev-5 yeah I see, once we sort something out, I'm interested in working on this, will look for something else for now, thanks!

[vfdev-5]

I think either us or @DhDeepLIT can suggest an API for that and once we are agreed on it we can move forward.