^jfdZddlmZddlmZddlmZddlm Z ddl m Z ddl m Z dd lmZmZmZdd lmZmZdd lmZdd lmZdd lmZdefdZdeddfdZdedefdZeddfdededzdedzdefdZedededfdededzdeddeedfdedefde e!efdzdefdZ"y)a Factory functions for creating checkpointer instances with sensible defaults. This module provides high-level factory functions that simplify the creation of checkpointer instances by automatically handling component initialization and configuration with reasonable defaults. )Callable)AnyN)create_barrier_from_config)CheckpointProcess)CheckpointReader)CheckpointWriterCheckpointWriterConfig WriterHook)AsyncCheckpointerSyncCheckpointer)CheckpointerConfig) DefaultStager)RankInforeturnctjr1ttjtjStddS)z Get default rank information from the current distributed environment. Returns: RankInfo: Rank information from the default process group if initialized, otherwise single-rank fallback. )global_world_size global_rankrr)distis_initializedrget_world_sizeget_rank}/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/torch/distributed/checkpoint/_experimental/builder.py_get_default_rank_inforsA "113   !;;r_cy)z3Default subprocess initialization function (no-op).Nr)rs rdefault_subprocess_init_fnr*sr rank_infoc,tt|S)z2Default checkpoint writer initialization function.)configr )r r r s rdefault_writer_init_fnr$.s %' rr" commit_hookc| t}t|}t|j}t |j |||}t ||S)a Factory function to create a SyncCheckpointer instance with sensible defaults. This function creates a synchronous checkpointer with default components, automatically detecting rank information from the default process group if available, and using the provided component configurations. Args: config: CheckpointerConfig containing component-specific configurations (writer_config, staging_config, process_config). Defaults to CheckpointerConfig(). rank_info: RankInfo for distributed training. Defaults to auto-detection from the default PyTorch distributed process group if initialized, otherwise falls back to single-rank (world_size=1, rank=0). commit_hook: Optional hook for custom actions before and after checkpoint commits. Returns: SyncCheckpointer: A configured synchronous checkpointer instance. Examples: # Simplest usage - auto-detect rank, default config checkpointer = make_sync_checkpointer() # Explicit rank configuration checkpointer = make_sync_checkpointer( rank_info=RankInfo(global_world_size=4, global_rank=0) ) # Disable barrier from .barriers import BarrierConfig config = CheckpointerConfig(barrier_config=BarrierConfig(barrier_type=None)) checkpointer = make_sync_checkpointer(config=config) r#)r"r barrierr%)writerreader)rrrbarrier_configr writer_configr )r"r r%r)r'r(s rmake_sync_checkpointerr,6scJ*, F))>)>?G ## F  rrsubprocess_init_fn).Nsubprocess_init_args.checkpoint_writer_init_fncheckpoint_writer_init_argsc| t}t|}t|j}|xsi}t ||j ||||}t |||S)aw Factory function to create an AsyncCheckpointer instance with sensible defaults. This function creates an asynchronous checkpointer using the provided configuration, automatically detecting rank information if not provided. Args: config: CheckpointerConfig containing component-specific configurations. rank_info: RankInfo for distributed training. Defaults to auto-detection. subprocess_init_fn: Function to initialize the subprocess. Defaults to no-op. subprocess_init_args: Arguments to pass to subprocess_init_fn. checkpoint_writer_init_fn: Function to create CheckpointWriter instance. checkpoint_writer_init_args: Arguments to pass to checkpoint_writer_init_fn. Returns: AsyncCheckpointer: A configured asynchronous checkpointer instance. Examples: # Create with default config checkpointer = make_async_checkpointer() # Create with custom init functions checkpointer = make_async_checkpointer( subprocess_init_fn=my_subprocess_init_fn, checkpoint_writer_init_fn=my_writer_init_fn ) r#)r")r r"r-r.r/r0)checkpoint_stagercheckpoint_processr))rrrstaging_configrprocess_configr ) r"r r-r.r/r0r)r2r3s rmake_async_checkpointerr6qs~F*, F&$$#>"C*$$-1";$?  +- r)#__doc__collections.abcrtypingrtorch.distributed distributedrbarriersrr3rcheckpoint_readerrcheckpoint_writerr r r checkpointerr r r"rstagingrtypesrrrr$r,tupledictstrr6rrrrEs+% 01/SS=&"<<$>3>4>h3C"4!5!%%)8 8$8d"8 8x"4!5!%.H,.AW9= = =$=!+= S/ = (-=(=> = "&c3h$!6 ==r