^jdZddlmZddlmZddlmZddlmZm Z ddl m Z m Z dd l mZmZdd lmZmZee ed Zee ed Zej*eZGd d ZGddZddZddZddZy)z0Auto exporter factory for HuggingFace exporters.) annotations)logging) HfExporter)ExportConfigMixin ExportFormat) DynamoConfigDynamoExporter)ExecutorchConfigExecutorchExporter) OnnxConfig OnnxExporter) executorchdynamoonnxc"eZdZdZeddZy)AutoExportConfigz The Auto-HF export config class that takes care of automatically dispatching to the correct export config given an export config stored in a dictionary. c |jd}| tdt|tr |j}n|}|t vr,td|dt t jt |}|j|S)N export_formatzHexport_config_dict must contain key 'export_format' set to exporter namezUnknown exporter type, got z - supported exporters are: ) get ValueError isinstancer valueAUTO_EXPORT_CONFIG_MAPPINGlistkeys from_dict)clsexport_config_dictrname target_clss f/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/transformers/exporters/auto.pyrzAutoExportConfig.from_dict0s*..?  gh h m\ 2 &&D D 1 1-dV3OPTUoUtUtUvPwOxy 05 ##$677N)r dict)__name__ __module__ __qualname____doc__ classmethodrr$r#rr*s 88r$rcFeZdZdZeddZeddZeddZy) AutoHfExporterz The Auto-HF expoerter class that takes care of automatically instantiating to the correct `HfExporter` given the `ExportConfig`. c t|tr|jn|}|j|st d|dt t d|d}t|tr |jn|}t |di|S)NzUnsupported export config: z. Registered exporters: .rr+) rrto_dictsupports_export_formatrsortedAUTO_EXPORTER_MAPPINGr r)r export_configkwargsr rr!s r# from_configzAutoHfExporter.from_configLs9C=Rc8d]224jw))*<=-.@-CD))/0E)F(GqJ  +?; &0 &M}""S`$T*4V44r$c td)uC Load an exporter instance from a pretrained model/checkpoint that ships an export config. **Not implemented yet** — placeholder for a first-class "export recipe" workflow. The idea: model owners publish an ``export_config.json`` (or an ``export_config`` field in ``config.json``) alongside their weights on the Hub. That file captures the settings the owner has already validated for their architecture — the target format (``dynamo`` / ``onnx`` / ``executorch``), exact dynamic-shape specs (e.g. ``text_ids`` dynamic to 4096, image tiles fixed at 448, ``batch=1`` for edge deployment), ``strict`` flag, ONNX opset, prefill vs. decode layout, ExecuTorch backend choice, and any other knob that today lives as tribal knowledge in a README or a private notebook. Consumers then get the owner-validated export in one call:: exporter = AutoHfExporter.from_pretrained("org/model-name") program = exporter.export(model, inputs) Composes with the [`register_export_input_preparer`] registry: the owner supplies the shape spec via ``export_config.json``, transformers supplies the data-dependent precomputations (``cu_seqlens``, vision position ids, window indices, …) for that architecture. Together they cover the two hard parts of exporting new models — knowing the right shape contract and preparing the right inputs — so downstream users don't re-derive either from scratch (and don't break in production when they get it wrong). zAutoHfExporter.from_pretrained is not implemented yet. Load/export configs explicitly and call AutoHfExporter.from_config(...) instead.)NotImplementedError)rpretrained_model_name_or_pathr5s r#from_pretrainedzAutoHfExporter.from_pretrainedZs6" _  r$c |jd}|'tjdttdyt |t r |jn|}|tv}|tv}|sE|sCtjd|dtttttzdy|stjd|d|d y|stjd|d |d yy ) aReturn True if the provided dict describes an ``export_format`` that has both a registered config class and a registered exporter class. Warns with an actionable message when the format is missing entirely, unknown, or only half-registered.ruBNo 'export_format' key in export config — supported values are: z . Skipping.FzUnknown export format u — supported values are: zExport format z[ has a registered exporter but no config class. Register one via ``@register_export_config(z)``. Skipping.zV has a registered config class but no exporter. Register one via ``@register_exporter(T) rloggerwarningr2r3rr rrset)r export_fmtr! has_config has_exporters r#r1z%AutoHfExporter.supports_export_formatzs (++O<   NNT/01> #-j,#GzZ77 44 , NN(6Q#34s;U7VVWXXce  NN )>>BX^U  NN )99=P r$N)r4zExportConfigMixin | dictreturnr)rBzHfExporter | None)r r%rBbool) r&r'r(r)r*r6r: staticmethodr1r+r$r#r-r-FsC  5 5  >""r$r-cfd}|S)Nctvrtjddt|ts t d|t<|S)Nz Exporter '0' is already registered and will be overwritten.zExporter must extend HfExporter)r3r<r= issubclassr TypeErrorrr!s r#register_exporter_fnz/register_exporter..register_exporter_fnsH ( ( NNZv-]^ _#z*=> >&)d# r$r+)r!rKs` r#register_exporterrLs r$cfd}|S)Nctvrtjddt|ts t d|t<|S)NzExport config 'rGz+Export config must extend ExportConfigMixin)rr<r=rHrrIrJs r#register_export_config_fnz9register_export_config..register_export_config_fnsI - - NN_TF2bc d#01IJ J+."4( r$r+)r!rOs` r#register_export_configrPs %$r$c,tj|S)N)r-r6)r4s r#get_hf_exporterrRs  % %m 44r$N)r!str)rBr)r) __future__rutilsrbaserconfigsrr exporter_dynamor r exporter_executorchr r exporter_onnxrrr3r get_loggerr&r<rr-rLrPrRr+r$r#r\s7"49E3% #    H %888WWt   %5r$