torchtnt.utils.timer.FullSyncPeriodicTimer

class torchtnt.utils.timer.FullSyncPeriodicTimer(interval: timedelta, cpu_pg: ProcessGroup)

Measures time (resets if given interval elapses) on rank 0 and propagates result to other ranks. Propagation is done asynchronously from previous step in order to avoid blocking of a training process.

__init__(interval: timedelta, cpu_pg: ProcessGroup) → None

Methods

__init__(interval, cpu_pg)
check()