:j XdZddlZddlZddlZddlmZddlmZmZm Z m Z ddl Z ddl Z ddl Z ddlmZddlmZddlmZddlmZmZej.eZ dd e eefd ed e ed efd Zdeded efdZdeeefded dfdZded efdZ ddede eefded efdZ!ded efdZ"y)z)Utilities related to data saving/loading.N)Path)IOAnyOptionalUnion) url_to_fs)AbstractFileSystem)module_available)_MAP_LOCATION_TYPE_PATH path_or_url map_location weights_onlyreturnct|ttfstj|||St|j drH|d}t jd|dtjjt|||St|}|j|d5}tj|||cdddS#1swYyxYw)aLoads a checkpoint. Args: path_or_url: Path or URL of the checkpoint. map_location: a function, ``torch.device``, string or a dict specifying how to remap storage locations. weights_only: If ``True``, restricts loading to ``state_dicts`` of plain ``torch.Tensor`` and other primitive types. If loading a checkpoint from a trusted source that contains an ``nn.Module``, use ``weights_only=False``. If loading checkpoint from an untrusted source, we recommend using ``weights_only=True``. For more information, please refer to the `PyTorch Developer Notes on Serialization Semantics `_. )rrhttpNFz:Defaulting to `weights_only=False` for remote checkpoint: z\. If loading a checkpoint from an untrustted source, we recommend using `weights_only=True`.rb) isinstancestrrtorchload startswithlogdebughubload_state_dict_from_urlget_filesystemopen)r rrfsfs x/home/mcse/projects/srt_converter/srt-converter-venv/lib/python3.12/site-packages/lightning_fabric/utilities/cloud_io.py_loadr""s" kC; /zz %%   ;""6*   L IIL[MZno  yy11  %%2   $B d # qzz %%    s .CCpathkwargsc 6tt|fi|\}}|S)N)rr)r#r$r_s r!rrPs c$i *6 *EB I checkpointfilepathctj}tjd|t j || t jjt|\}}|j5d}tdrddl m }t||}t|r#|s!|j!||j#n:|j%|d5}|j'|j#ddddddy#1swYxYw#1swYyxYw#t($r]}t|j*t,r9t/|j*ddt0j2k(r t5d |Yd}~yYd}~yd}~wwxYw) aSaves a checkpoint atomically, avoiding the creation of incomplete checkpoints. Args: checkpoint: The object to save. Built to be used with the ``dump_checkpoint`` method, but can deal with anything which ``torch.save`` accepts. filepath: The path to which the checkpoint will be saved. This points to the file that the checkpoint will be stored in. zSaving checkpoint: FadlfsrAzureBlobFileSystemwbNerrnoz]Upgrade fsspec to enable cross-device local checkpoints: pip install "fsspec[http]>=2025.5.0")ioBytesIOrrrsavefsspeccorerr transactionr r+r-r_is_object_storagepipegetvaluerwritePermissionError __context__OSErrorgetattrr/EXDEV RuntimeError) r(r) bytesbufferrurlpathis_azurer-r es r! _atomic_saverDUsD**,KII#H:./ JJz;'kk++CM: G ^^ 4H(5%b*=>!"%h!5!5!78WWWd+4qGGK00234 4 444 4 4  ammW -'!--RV2W[`[f[f2fo 3g -sP7D$;A D D ;DD$ D DD!D$!D$$ F -AFF rctdrddlm}t||rytdrddlm}t||rytdrddlm}t||ryy ) Nr+rr,Tgcsfs) GCSFileSystems3fs) S3FileSystemF)r r+r-rrFrGrHrI)rr-rGrIs r!r6r6}sN - b- . ' b- (% b, ' r'strictct|r%|r|j|S|j| S|j|S)aCheck if a path is directory-like. This function determines if a given path is considered directory-like, taking into account the behavior specific to object storage platforms. For other filesystems, it behaves similarly to the standard `fs.isdir` method. Args: fs: The filesystem to check the path against. path: The path or URL to be checked. strict: A flag specific to Object Storage platforms. If set to ``False``, any non-existing path is considered as a valid directory-like path. In such cases, the directory (and any non-existing parent directories) will be created on the fly. Defaults to False. )r6isdirisfile)rr#rJs r!_is_dirrNs>&" 88D> !99T?"" 88D>r'cXtjjt|dk(S)Nfile)r3utils get_protocolr)r#s r!_is_local_file_protocolrSs << $ $SY /6 99r')NN)F)#__doc__r/r0loggingpathlibrtypingrrrrr3 fsspec.utilsr fsspec.corerfsspec.implementations.localr lightning_utilities.core.importsr lightning_fabric.utilities.typesr r getLogger__name__rboolr"rdictrrDr6rNrSr'r!rbs0 ++  !;=Fg! (,#'+ r5y!+ $+ 4.+  + \#2D %T#s(^%u%%P-$,"%T *:DUY<:%:D:r'