^jFddlZddlZddlZddlmZddlmZmZddlm Z ddl Z ddl m Z m Z ddlmZddgZd ej"fd ZeZed eGd dZed GddZy)N) defaultdict) dataclassfield)Any)GraphNode) compatibilitySubgraphMatcher InternalMatchreturnc|tjt}tjj ddj }|j|tj}tjd}|j||j||j|d|_ |S)NPYTORCH_MATCHER_LOGLEVELWARNINGz%(filename)s > %(message)sF) logging getLogger__name__osenvirongetuppersetLevel StreamHandler Formatter setFormatter addHandler propagate)loggerlevelconsole formatters n/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/torch/fx/passes/utils/matcher_utils.py _init_loggerr"s   x (F JJNN5y A G G IE OOE##%G!!">?I # U gF MF)is_backward_compatibleceZdZUeeed<eeZeeefed<eeZ eeed<eeZ eeed<eeZ ee efed<d dZ y) r anchors)default_factory nodes_mapplaceholder_nodesreturning_nodes name_node_mapct|j|jj|jj|j jS)N)r&r(r)r*)r r&r(copyr)r*)selfs r!__copy__zInternalMatch.__copy__5sJLLnn))+"4499; 00557   r#N)r r )r __module__ __qualname__listr__annotations__rdictr(r)r*r+strr/r#r!r r #so$Z"'"=ItD$J=%*$$?tDz?#("=OT$Z=&+4%@M4T ?@ r#c eZdZ ddedededededdf dZd ed edefd Zdd ed ed edefd Z de eefdefdZ de e de e fdZd ed ede defdZ dd ed ede d edef dZdded ede e fdZy)r pattern match_outputmatch_placeholderremove_overlapping_matchesignore_literalsr Nc||_||_||_||_||_t |j dk(r td|j D]F}|jdk7s|jr$t |jdk(s=td|j Dcgc]}|jdk(s|c}|_ ttt|j }|j |_g|_|r |g|_y|j Dcgc]}t |jdk(s|c}|_ycc}wcc}w)a Args: pattern: the targeted matching pattern, represented in fx.Graph. match_output: If True, output node in the pattern graph will be treated as a part of the targeted pattern. If False, output node is ignored during match. match_placeholder: If True, placeholder node in the pattern graph will be treated as a part of the targeted pattern. If False, placeholder nodes will be used a wildcard. remove_overlapping_matches: If True, in the case of overlapping matches, only the first match will be returned. ignore_literals: If True, will not check if literals are equal and will instead treat them as wildcards. rz;SubgraphMatcher cannot be initialized with an empty patternoutputzDSubgraphMatcher cannot be initialized with an pattern with dead code placeholderN)r8r9r:r;r<lennodes ValueErrorop is_impureusersAssertionErrorpattern_placeholder_nodesnextiterreversedall_input_nodespattern_returning_nodespattern_anchors) r.r8r9r:r;r<noden output_nodes r!__init__zSubgraphMatcher.__init__@s5* (!2*D'. w}}  "M MM Dww("4>>+;tzz?a'(^ }}*  (=A* &4 789 3>3N3N$+- $/=D '66$#agg,!:K$D * $s*E?E#EEpngnc&t|jtstd|jdt|jtstd|jd|jj td|jj tdt jjj|jj |j}t jjj|jj |j}t|t|uryt|t jrt|t jStd|d) Nz pn.target z must be a string.z gn.target z'pn.graph.owning_module must not be Nonez'gn.graph.owning_module must not be NoneFzUnsupported type z when matching attributes) isinstancetargetr5rGgraph owning_moduletorchfx graph_module _get_attrtypeTensor RuntimeError)r.rSrTpn_valuegn_values r!_match_attributesz!SubgraphMatcher._match_attributeszs&"))S) :bii[8J!KL L"))S) :bii[8J!KL L 88 ! ! ) !JK K 88 ! ! ) !JK K88((222883I3I299U88((222883I3I299U >h / h -h 5 5!28*get_attrF)r:rDnamercrW)r.rSrTrds r!_nodes_are_equalz SubgraphMatcher._nodes_are_equals%%"%%=*@ "''9 55BEE>uu %():*$--b"5599 ) )r#r(c|jDcic]\}}|jdk7s||}}}|jD],\}}||jvr|jD] }||vsy.ycc}}w)Nr?FT)itemsrDrMrF)r.r(rSrTlookupusers r! _is_containedzSubgraphMatcher._is_containeds "+!2$ r2bee}6LBF$ $ lln !FBT111 !v%  ! !$ s A4A4matchescNg}t}|D]}d}|jjD]\}}|jdvs||vsd}n|rA|j ||jjD]%\}}|jdvs|j |'|S)NF>r>r?T)setr(rjrDappendadd)r.rnnon_overlapping_matches nodes_matchedmatch found_overlaprSrTs r!_remove_overlapping_matchesz+SubgraphMatcher._remove_overlapping_matchess8:#&5  .E!M////1 B55 99bM>Q$(M  !'..u5#oo335.FBuu$==%))"-. .'&r#ruct|trt|tr tdt|trPt|ts@|jdk(r0||jvr|j||k(S||j|<yyt|tst|tryt |t |uxr||k(S)Nzpn and gn cannot both be Noder?TF)rVrrGrDr(r^)r.rSrTrus r!_match_literalszSubgraphMatcher._match_literalss b$ Jr4$8 !@A A b$  2t(<uu %( ??2."44&(#B%*R*>8tBx'4B"H 4r#c* tjd||t|trt|tst d|d||j vrj ||k(S|j j vryj|||sytj}|j |<|jdk(ryd}dttttdfzd ttttdfzd tf fd d}d}t|jt|jk7sGt|j j#t|j j#k7r|jd k(rt|j$t&j(j*r|j$j,j. d ttdfdt0t2tfd ttf fd } | |j|j }| |j|j }nt|jt|jk(rt|j j#t|j j#k(rt|j}t|j}|j5t|j j |j5t|j j nd}|xr|duxr|duxr  ||}|stj|yy)Nz matching %s to %szpn and gn must be Node, pn: z, gn: Fr?Targs1.args2r c|t|t|k7ryt||D]\}}t|tr$t|trj ||}nWt|t t fr t|t t fr ||}n!j||xs j}|ryy)NFT) rAziprVr _match_nodesr2tupleryr<)r{r|a1a2matched _match_argsrur.s r!rz1SubgraphMatcher._match_nodes.._match_argss5zSZ'eU+ !Bb$'Jr4,@"//B>GT5M2z"tUm7T)"b1G,,RU;St?S?S  !r# call_function orig_args orig_kwargsc g}tD]|\}}|j|vr|j||j3|js#|t |kr|j||b|j|j ~|S)N) enumeratergrq kwarg_onlyrA default_value)rrall_argsischema args_schemas r!get_all_argumentsz7SubgraphMatcher._match_nodes..get_all_arguments#s!*;!7>IAv{{k1  FKK(@A#..1s9~3E  ! 5 (<(<= > r#)rinforVrrGr(valuesrhr-rDr2rrboolrAargskwargskeysrWrZ_ops OpOverload_schema argumentsr4r5extend) r.rSrTrurd saved_match match_foundpn_argsgn_argsrrrs ` ` @@r!rzSubgraphMatcher._match_nodess  )2r22t$B)= #?t6"!NO O  ??2&", , '') )$$R_=ii&   55M !  9uS#X. 7;Cy5c?7R   ,%)$(BGG BGG , ()T"))..2B-CC(299ejj&;&;<))++55K  c? 9=c3h c (;G';G \S\ )d299>>3C.D IINN I / 277mG277mG NN4 0 0 23 4 NN4 0 0 23 4K  .t# .t# .GW- IIk*Er#rXcddlm}tt}jD];}|j D]*}j ||s||j|,=t|jtjdgdtdtddffd tj }r d|t}Dcgc] }j|js|"c}t} || k7rtjd || z g} D]V}|jjD cgc]\} } | j d vr| } } } || sF| j|Xt| tk7r+tjd tt| z j"rEt| }j%| t} || k7rtjd || z tjdScc}wcc} } w)a Returns: The matched subgraphs. The returned subgraph would be fully self-contained, meaning the nodes (except placeholder and nodes returned by output) can only be consumed by nodes within the matched subgraph. Subgraph pattern matcher is implemented with the backtracking style in the following steps: 1. We first identify all the anchor nodes in the pattern graph. The anchor nodes are the "sinks" (nodes with no user other than the output node) of the pattern graph. One pattern graph could have multiple anchors if it has multiple return values. 2. In the target graph, we identify the potential candidate nodes that can be matched with each anchor. These anchor-candidate pairs are the starting points for pairwise per-node matching. 3. For each anchor-candidate pair, we simultaneously traverse backwards (DFS) in both pattern and target graphs. For every pattern nodes along traversal path, we compare it against the target nodes. In case any comparison failed, the match for this anchor-candidate pair fails. A match is found when DFS completes traversing the graph. See `self._match_nodes` for more details. 4. In the case of multiple anchors, every anchor will need to find a match using step 3. In addition, the matches found between anchors need to have a common intersection node in order for the match to be valid. This is implemented with backtracking. See `backtracking` for more details. Notice: graph traversal must be done in the reverse order because a tensor can have multiple consumers, but can only have a single producer. Only with reverse order can we jointly traverse the pattern and target graph in a deterministic path. Warning: In theory, this backtracking algorithm have an **exponential** time complexity. However, in practice, it's unlikely to blow up. r)validate_partitionz"Initial match_candidates_list: %s anchor_indexrur NcJ|t k(r jDcgc]}|j|c}|_ jDcgc]}|j|c}|_ j |tjd|y |\}}tj|}|D]h}tjd|| j||| }|r |dz|ntjd||tj|}jycc}wcc}w)NzFound a match: %s zTrying to match anchor %s to %sr@z Failed to match anchor %s to %s ) rArHr(r)rMr*rqrrr-r) rrurSpattern_anchorcandidate_nodesrrOr backtrackingmatch_candidates_listrnrdr.s r!rz+SubgraphMatcher.match..backtracking}ss#899262P2P+,.EOOB'+'372N2N),.EOOB')%u% 159.CL.Q +NO))E*K' / =~tT"//"D%  !159KK;^T  +. /+)s D D )r&zr>r?zfFiltered out %s matches because matched subgraph would form a cycle if fusedzAFiltered out %s matches because matched subgraphs are overlappingzMatches returned: %s)!torch.fx.passes.utils.fuser_utilsrrr2rNrBrhrqrjrrintr rArmr(rDr;rw)r.rXrdrmatch_candidatesrrOrubeforeafter valid_matchesrSrTmatched_compute_nodesrrrns` ` @@@r!ruzSubgraphMatcher.matchKs5H I4?t3D"22 BN  B((O$^4;;DA B B!%%5%;%;%= > 9;PQ') /s /= /T / /Bd&:&:; E "W&-UU1C1CEOO1T5UG  U? KKN  .0  ,E$oo335%B55 99% !% ""78$$U+ , } W - KKHG s=11   * *'F66}EGLE WUN  *G4KV%s H7?H7H<)FFTF))rr0r1rrrRrrcr5rhr4rmr2r rwrryrrur6r#r!r r >sF #"'+/ % 888 8 %) 8  8 8tDdt24TCQU tD$J'7D*'M*' m '(5#535}55*PRii i)6iILi iV~5~3~]@S~r#)r-rr collectionsr dataclassesrrtypingrrZtorch.fxrrtorch.fx._compatibilityr __all__Loggerr"rr r r6r#r!rs  #( 1 o . gnn  e,    - 2e,JJ-Jr#