^jd\ddlmZddlmZmZddlZddlmZerddlm Z m Z GddZ y) ) annotations)Any TYPE_CHECKINGN)DimEntry)DimTensorcZeZdZUdZded<ded<d dZd dZddZdd Z dd Z y )EnableAllLayersa` RAII-style context manager for enabling functorch vmap layers. It manages the creation and cleanup of functorch dynamic layers. This is probably one of the more algorithmically important parts of first class dims. Intuitively, FCD can be thought of as another way of using vmap, where you don't actually have to vmap at the top level, instead the vmaps are implicitly determined by inspecting the bound dimensions on the FCD tensors involved in a compute (this is similar to our concept of non-lexical modes that we spent a long time talking about years ago). But under the hood you still need to actually enable the vmap mode. So once FCD has determined all of the dims we are batching over, it needs to enable all those layers so functorch can actually apply the batching rules. Therefore enable all layers! int levels_startz list[Dim] levels_to_dimc2ddlm}d|_g|_|D]a}|j r|j }t ||stdt||jj|c|jjdy)z Initialize and push dynamic layers for all first-class dimensions. Args: levels: List of dimension entries to create layers for r)rrzExpected Dim, got c|jSN)_level)ds k/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/functorch/dim/_enable_all_layers.pyz*EnableAllLayers.__init__..7s ahh)keyN) rr r is_positionaldim isinstanceAssertionErrortypeappendsort)selflevelsrlrs r__init__zEnableAllLayers.__init__"s  -A??$EEG!!S)(+=d1gY)GHH""))!,  - $67rct|jD]H\}}|j}tjj j |d}|dk(sB||_J|S)N differentr) enumeratersizetorch_C _functorch_vmap_increment_nestingr )r ir batch_sizelevels r __enter__zEnableAllLayers.__enter__9s[ 2 23 *FAsJHH''?? KXEAv$)!  *  rc|jt|jzdz }tt|jD]F}tj j j}|||z k7s4td||z d|y)z)Clean up dynamic layers in reverse order.rzExpected layer z, got N) r lenrranger(r)r*_vmap_decrement_nestingr)r exc_typeexc_valexc_tb to_remover,poppeds r__exit__zEnableAllLayers.__exit__Bs%%D,>,>(??!C s4--./ VAXX((@@BFQ&$y1}oVF8%TUU Vrcg}t|j dD]}|jt||}tj j j|r:tj j j|}| td||jk\r%||jt|jzkstd|dt|j||jz }tj j j|}| td|j||tj j j|}tj j j|r:ddlm} | } || _|| _|| _|| _| S)a Create a Tensor from a batched tensor by unwrapping functorch layers. Args: batchedtensor: Batched tensor from functorch operation has_device: Whether tensor has device info Returns: Tensor with appropriate levels rzExpected level to be non-NonezLevel z out of rangezExpected bdim to be non-Noner)r )r2rrrr(r)r*is_batchedtensormaybe_get_levelrr r1rmaybe_get_bdiminsert get_unwrappedrr _tensor _batchtensor _has_device_levels) r batchedtensor has_devicer!r,tensorr.rbdimr results r from_batchedzEnableAllLayers.from_batchedJs"$ ))++Q/ 'A MM(1+ & 'hh!!226:HH''77?E}$%DEE***D--D4F4F0GGG$veWM%BCC4--ed6G6G.GHIC88&&55f=D|$%CDD MM$ $XX((66v>Fhh!!226: +' rctjjj|sy|}t t t jD]||ytfd|Dstjjj|jztjjj|}~y)a Update the levels of a batched tensor in place. This requires the _maybe_unsafe_set_level binding that we'll add to functorch. Args: batchtensor: Batched tensor to update levels: New levels to set Nc3TK|]}|tjk(!ywr)rr).0r"r,r s r z8EnableAllLayers.inplace_update_layers..s&HA1!3!3A!677Hs%() r(r)r*r;reversedr2r1rany_maybe_unsafe_set_levelr r?)r batchtensorr!implr,s` @rinplace_update_layersz%EnableAllLayers.inplace_update_layersusxx""33K@ %D$6$6 789 ?A|HHH##;;D$BSBSVWBWXxx**88> ?rN)r!list[DimEntry])returnr )r4rr5rr6rrUNone)rD torch.TensorrEboolrUr )rQrWr!rTrUrV) __name__ __module__ __qualname____doc____annotations__r#r/r9rIrSrrr r sH 8.V)V?'?1?? ?rr ) __future__rtypingrrr( _dim_entryrrrr r r^rrrbs%"% A?A?r