o ,hQ@sdZddlZddlZddlZddlZddlZddlmZddl m Z m Z ddl m Z ddlmZmZmZddlmZmZdd lmZmZdd lmZmZdd lmZdd lmZmZm Z m!Z!m"Z"m#Z#d dl$m%Z%m&Z&d dl'm(Z(e r~ddl)m*Z*ddl+m,Z,ddZ-ddZ.d0ddZ/ddZ0Gddde&Z1Gddde&Z2Gddde1Z3Gd d!d!e1Z4Gd"d#d#e1Z5Gd$d%d%e5Z6Gd&d'd'e5Z7Gd(d)d)e&Z8Gd*d+d+e8Z9Gd,d-d-e8Z:Gd.d/d/e8Z;dS)1a Dictionary-related variable tracking classes for PyTorch Dynamo. This module implements variable tracking for different types of dictionary-like objects: - Regular Python dictionaries (dict) - Ordered dictionaries (collections.OrderedDict) - Default dictionaries (collections.defaultdict) - Dictionary views (keys and values) - Sets and frozensets (implemented internally using dictionaries) These classes are responsible for tracking dictionary operations during graph compilation, maintaining proper guards for dictionary mutations and key existence checks. They handle dictionary creation, modification, key/value access, and view operations while ensuring correct behavior in the compiled code through appropriate guard installation. The implementation uses a special _HashableTracker wrapper to handle dictionary keys while preserving proper aliasing semantics. Sets are implemented as dictionaries with None values for efficiency and code reuse. NHashable)Optional TYPE_CHECKING)is_fake)graph_break_hints polyfills variables)create_call_functioncreate_instruction)raise_observed_exceptionunimplemented_v2) GuardBuilder install_guard)is_from_local_source)cmp_name_to_op_mapping dict_items dict_keys dict_valuesistypespecialize_symnode)ValueMutationNewVariableTrackerConstantVariable) PyCodegenInstructionTranslatorcCs tt|td|dgddS)Nzwrong number of arguments for z() callargs)r TypeErrorr)txnamer%X/var/www/html/scripts/venv/lib/python3.10/site-packages/torch/_dynamo/variables/dicts.pyraise_args_mismatch<s  r'cCst|jddS)N__instancecheck__F)type__dict__get)objr%r%r&was_instancecheck_overrideDsr-cCs>|durddlm}|}tt|tdt|gddS)Nrrzunhashable type: r )torch._dynamo.symbolic_convertr current_txr r"rr))argr#rr%r%r&raise_unhashableHs   r1cCst|tjr|s|rdSt|tjr!|jj dduSt|tj r1t dd|j DSt|tj rRt|jsRt|jdtjurRt|jtrRt|jtSt|tjtjtjtjtjtjtjtjjtjtjtj tj!tj"tj#tj$fS)NT example_valuecss|]}t|VqdSN) is_hashable.0er%r%r& dszis_hashable..__hash__)% isinstancer LazyVariableTracker is_realizedr4TensorVariableas_proxynodemetar+ TupleVariableallitemsUserDefinedObjectVariabler-valueinspectgetattr_staticintr9 py_HashableBuiltinVariableSymNodeVariabler EnumVariableUserDefinedClassVariableUserFunctionVariableSkipFunctionVariablemisc NumpyVariableNNModuleVariableUnspecializedNNModuleVariableMethodWrapperVariableTorchInGraphFunctionVariableTypingVariableFunctoolsPartialVariableWeakRefVariable)xr%r%r&r4RsL      r4cs2eZdZdhejZGdddZefdeeefddffdd Zd d Zd d Z d dZ ddZ ddZ de fddZddZddZddZddZd=dd Zd!d"d#efd$d%Zd!d"d#efd&d'Zd#efd(d)Zd#efd*d+Zd,d-Zd.d/Z 0 1 2 3  4d>fd5d6 Zd7d8Zd9d:Zfd;d<ZZS)?ConstDictVariableuser_clsc@sLeZdZdZdddZeddZdd Zed d Z d dde fd dZ dS)z"ConstDictVariable._HashableTrackeraB Auxiliary opaque internal class that wraps a VariableTracker and makes it hashable This should not be seen or touched by anything outside of ConstDictVariable and its children Note that it's also fine to put VTs into dictionaries and sets, but doing so does not take into account aliasing returnNcCs"t|}t|s t|||_dSr3)rr4r1vt)selfr]r%r%r&__init__s z+ConstDictVariable._HashableTracker.__init__cs t|jtjr|js|jr|jSt|jtjr(|jj j d}|St|jtj rAt j tfdd|jjD}|St|jtjrL|jjSt|jtjrW|jjSt|jtjrc|jSt|jtjrtt j |jjjSt|jtjr|jjS|j}|S)Nr2c3s|]}|jVqdSr3)underlying_valuer5rr%r&r8zFConstDictVariable._HashableTracker.underlying_value..)r:r]r r;r<r4original_valuer=r>r?r@rArZ_HashableTrackertuplerCrRrErSrN get_functionrX referent_vtr`rDas_python_constant)r^rYr%rr&r`s6    z3ConstDictVariable._HashableTracker.underlying_valuecC t|jSr3)hashr`r^r%r%r&r9s z+ConstDictVariable._HashableTracker.__hash__csht|t|kr dSt|tr(tjt|t|ko'tfddt||DSt|r0||uS||kS)NFc3s |] \}}||VqdSr3)_eq_impl)r6uvrr%r&r8s z>ConstDictVariable._HashableTracker._eq_impl..) r)r:rdrZrclenrBzipr)abr%rr&rks z+ConstDictVariable._HashableTracker._eq_implothercCsNtj}t||st|sJt|t||r ||j|jS||j|Sr3)rZrcr:r is_literalr)rkr`)r^rrrr%r%r&__eq__s z)ConstDictVariable._HashableTracker.__eq__r\N) __name__ __module__ __qualname____doc__r_propertyr`r9 staticmethodrkboolrtr%r%r%r&rcs   rcrCr\Nc sd|vr |dd|vr|dtjd i|tjtfdd|Ds-Jfddfdd|D|_t|j |_ | |_ ||_ dS) Noriginal_itemsshould_reconstruct_allc3s,|]\}}t|tfot|tVqdSr3)r:rr6rYrmrr%r&r8s  z-ConstDictVariable.__init__..cst|r|S|Sr3)r:)keyrr%r& make_hashablesz1ConstDictVariable.__init__..make_hashablecsi|] \}}||qSr%r%r)rr%r& sz.ConstDictVariable.__init__..r%) popsuperr_rZrcrBrCrsourcer~copyr}r[)r^rCr[kwargs __class__)rrr&r_s      zConstDictVariable.__init__cCdd|jDS)NcS i|] \}}|j|qSr%r]r>r6krmr%r%r&r z.ConstDictVariable.as_proxy..rCrjr%r%r&r>szConstDictVariable.as_proxycCs"dddd|jDdS)N{, css,|]\}}|jd|VqdS)z: Nr] debug_reprrr%r%r&r8s z/ConstDictVariable.debug_repr..})joinrCrjr%r%r&rs zConstDictVariable.debug_reprcCr)NcSrr%r]rgrr%r%r&rz8ConstDictVariable.as_python_constant..rrjr%r%r&rgsz$ConstDictVariable.as_python_constantcCs|dd|jDS)NcSsi|] \}}|j|qSr%rrr%r%r&r sz=ConstDictVariable.keys_as_python_constant..)install_dict_keys_match_guardrCrjr%r%r&keys_as_python_constant z)ConstDictVariable.keys_as_python_constantcC|jSr3)r[rjr%r%r& python_typezConstDictVariable.python_typecCsBt|tsJtj}t|o |||jvo t|j||tj Sr3)r:rrZrcr4rCr DeletedVariable)r^r]rr%r%r& __contains__s zConstDictVariable.__contains__cCstdd|jDS)NcSsg|] }t|tjs|qSr%)r:r rr6rYr%r%r& s  z)ConstDictVariable.len..)rnrCvaluesrjr%r%r&rns zConstDictVariable.lencs&jrdStfddjDS)NTc3s*|]\}}j|j|VqdSr3) is_new_itemr}r+r])r6rrErjr%r&r8&s  z2ConstDictVariable.has_new_items..)r~anyrCrjr%rjr& has_new_items#s  zConstDictVariable.has_new_itemscCs<|r|r|rt|t|kSt|t|kSr3)r<idrealize)r^rErrr%r%r&r+szConstDictVariable.is_new_itemcCshd}|jD]!\}}|j|j}|||s|jr(||j|||d7}q|td|ddS)Nrr BUILD_MAPr0)rCr}r+r]rr~ append_outputr )r^codegennum_argsrrEitemr%r%r&reconstruct_kvs_into_new_dict1s z/ConstDictVariable.reconstruct_kvs_into_new_dictrrcsJ|jtjurfdd|tdddS|dS)NctdgS)N OrderedDict extend_outputcreate_load_python_module collectionscreate_load_attrr%rr%r&A z/ConstDictVariable.reconstruct..rF)r[rr add_push_nullrrr r^rr%rr& reconstruct=s   zConstDictVariable.reconstructr#rr0cCs(t|}||jvrtt||j|Sr3)rZrcrCr KeyError)r^r#r0rr%r%r&'getitem_const_raise_exception_if_absentMs    z9ConstDictVariable.getitem_const_raise_exception_if_absentcCsLt|}||jvr!d|jd}tdd|j|dgtjd|j|S)NzDictionary key z not found during tracingzkey not found in dictzKey z>Check if the key exists in the dictionary before accessing it.gb_typecontext explanationhints)rZrcrCrErr USER_ERROR)r^r#r0rmsgr%r%r& getitem_constUs    zConstDictVariable.getitem_constcCs"t|}||jvr dS|j|Sr3)rZrcrC)r^r0rr%r%r&maybe_getitem_constds   z%ConstDictVariable.maybe_getitem_constcCsX||vsJt|}t|j|}t|j|}t|tj r*| dSdSr3) rZrcrdrCkeysindexr}r:r r;r)r^r0rroriginal_key_vtr%r%r&realize_key_vtjs    z ConstDictVariable.realize_key_vtcCs|jr t|tjdSdSr3)rr make_guardrDICT_KEYS_MATCHrjr%r%r&rssz/ConstDictVariable.install_dict_keys_match_guardcCsddlm}|js dS|jj|rdS|d|v}|djdurddlm}mtj|ot|d}|dkr9ttj|g|Ri|}|j j ||j |j dS|dkrMt|dksEJ|||dS|dkrj|sU|rWJ||jrf|j j|jt|S|dkr||jr}|j j|j|s|rJt|S|dkr||jr|j j|j|s|rJt|S|d kr||s|rJ|j|j tdd S|d kr|s|rJ|t|j S|d kr |r |st|d||st|d ksJ|j j ||d|j |d<dS|dkr5|r5|r5|d|_|j j ||j |ddS|dvrgt|dvrg|d|vrg|||t|dkrc|dkr_t t!|dS|dS|dkr|r|rd|_|j j ||j "|dS|dkrd|_|j j ||j #dS|dkr|r|t|dk}t|dk} |s| r|j j ||rt$|dtr|d|d} n |%|t|d} |j | j | rfdd| D}|j |dSt&'||||S|dvr%|d|vr%|(||dS|dkrKt|dkrK|s:t|d||||d|v} | S|dkr|r|r||raJt|d ksjJ|)|d} | durx| St|dkrd} n|d} |j j || |j |d<| S|dkr||st|dksJ|j j ||d}|j |}|j "|||j |<dS|dkrt|dksJt$|dtst*d|d+j,d||j|j tdd }|d|j |dj |St&'||||S)Nr)rJrrr_ __getitem__rCrrr)rC mutation_typer__len__ __setitem__r __delitem__T)rr+)rrrclearupdatecs i|] \}}||qSr%)createrrrr%r&r rz1ConstDictVariable.call_method..)r+ __getattr__r setdefault move_to_end__or__z/unsupported operand type(s) for |: 'dict' and '')-rrJrrZrcr4r dict call_dictrrmutationrCrrrnrrrguard_on_key_orderaddDictItemsVariableDictKeysVariableDictValuesVariableclonerr is_mutabler1r~rrr rrrr:call_custom_dictr call_methodrrr"rrv)r^r#r$r!rrJ arg_hashable temp_dict_vthas_arg has_kwargsdict_vtrrErYrval new_dict_vtrrr&rs          &                             zConstDictVariable.call_methodcCs|dd|jDS)NcSg|]}|jqSr%r]rr%r%r&rMz9ConstDictVariable.unpack_var_sequence..)rrCrr^r#r%r%r&unpack_var_sequenceKrz%ConstDictVariable.unpack_var_sequencecCs\|jtur||jjvrtdStdSd|jd}tdd|j|dgtjddS) NTFz hasattr on z is not supportedzunsupported hasattr operationzClass z+Consider using a regular dictionary insteadr)r[rr*rrrr SUPPORTABLE)r^r#r$rr%r%r&call_obj_hasattrOs      z"ConstDictVariable.call_obj_hasattrc s|tjdi|SNr%)rrr)r^rrr%r&rbszConstDictVariable.clonerrr!rrrr\r)rvrwrxr_nonvar_fieldsrcrr_r>rrgrrr|rrnrrrrrrrrrrrrrr __classcell__r%r%rr&rZsXP "      '.rZcsbeZdZdeddffdd ZddZdd Zdd d Zdedde e dfddfddZ Z S)MappingProxyVariabledv_dictr\Nc s*tjdi|t|tsJ||_dSr)rr_r:rZrr^rrrr%r&r_is zMappingProxyVariable.__init__cCstjSr3)typesMappingProxyTyperjr%r%r&rnrz MappingProxyVariable.python_typecCs |j|Sr3)rrrr%r%r&rqs z(MappingProxyVariable.unpack_var_sequencerrcsd|jrd|jd}tdd|j|dgtjdfdd|jtd d dS) Nz*Preexisting MappingProxyVariable (source: zS) cannot be reconstructed because the connection to the original dict will be lost.z%mapping proxy cannot be reconstructedSource: zCUse a mapping proxy constructed in the same `torch.compile` region.rcr)Nr )rrr rr%rr%r&rrz2MappingProxyVariable.reconstruct..rF)rrrrrrrr )r^rrr%rr&rts"    z MappingProxyVariable.reconstructr!rrcCsF|jr|jjrd}tdd|jd|ddgd|j||||S)NaA dict has been modified while we have an existing mappingproxy object. A mapping proxy object, as the name suggest, proxies a mapping object (usually a dict). If the original dict object mutates, it is reflected in the proxy object as well. For an existing proxy object, we do not know the original dict it points to. Therefore, for correctness we graph break when there is dict mutation and we are trying to access a proxy object.z-mapping proxy affected by dictionary mutationr z, Dict mutation detectedzNAvoid modifying dictionaries that might be referenced by mapping proxy objectszROr avoid using the mapping proxy objects after modifying its underlying dictionaryr)rrrhas_existing_dict_mutationrrr)r^r#r$r!rrr%r%r&rs   z MappingProxyVariable.call_methodr) rvrwrxrZr_rrrlistrstrrrr%r%rr&rgs  rc@seZdZddZddZdS)NNModuleHooksDictVariablecCdSr3r%rjr%r%r&rz7NNModuleHooksDictVariable.install_dict_keys_match_guardcCrr3r%r^r#r!r%r%r&rrz5NNModuleHooksDictVariable.install_dict_contains_guardN)rvrwrxrrr%r%r%r&rs rcsfeZdZddfdd ZfddZfddZed d Z   dfdd ZddZ Z S)DefaultDictVariableNr\c s.tj||fi||tjusJ||_dSr3)rr_r defaultdictdefault_factory)r^rCr[rrrr%r&r_s zDefaultDictVariable.__init__cs$|jtttfvr |js dStS)NF)rrrdrrCris_python_constantrjrr%r&rs z&DefaultDictVariable.is_python_constantcsd|jdtdS)Nz defaultdict(r))rrrrjrr%r&rszDefaultDictVariable.debug_reprcCs,t|tjr|jttttfvSt|tjj Sr3) r:r rJfnrrdrset functionsBaseUserFunctionVariablerr%r%r&is_supported_args z$DefaultDictVariable.is_supported_argr!rrrrcs|dkr=t|dks J|d|vr|||dS|jdur&t|d|j|gi}t|d|d|f||St||||S)Nrrrr)rnrrr call_functionrr)r^r#r$r!r default_varrr%r&rs  zDefaultDictVariable.call_methodcs:fdd|j|tdddS)Ncr)Nrrr%rr%r&rrz1DefaultDictVariable.reconstruct..rF)rrrrr rr%rr&rs    zDefaultDictVariable.reconstructr3rur) rvrwrxr_rrr{rrrrr%r%rr&rs   rcseZdZdZdeeddffdd ZddZed d Z e d d Z d dZ ddZ ddZd%ddZdeedeeefddffdd Zdddefdd Zd!d"Zd#d$ZZS)& SetVariablez.We model a sets as dictionary with None valuesrCr\Nc s(t|t}tj|fi|dSr3)rfromkeysr _default_valuerr_r^rCrrr%r&r_szSetVariable.__init__cC,|jsdSdddd|jDdS)Nzset()r,cs|]}|jVqdSr3rr6rr%r%r&r8raz)SetVariable.debug_repr..rrCrrrjr%r%r&r"zSetVariable.debug_reprcCst|jSr3)rrCrrjr%r%r& set_items szSetVariable.set_itemscCs tdSr3)rrr%r%r%r&r"s zSetVariable._default_valuecCdd|jDS)NcSh|]}|jqSr%rr'r%r%r& z'SetVariable.as_proxy..r*rjr%r%r&r>zSetVariable.as_proxycCtSr3)rrjr%r%r&rrzSetVariable.python_typecCr+)NcSr,r%rr'r%r%r&r-r.z1SetVariable.as_python_constant..r/rjr%r%r&rgr0zSetVariable.as_python_constantrrcCs2|dd|jD|tdt|jddS)NcSrr%rrr%r%r&rrz+SetVariable.reconstruct.. BUILD_SETr)foreachr*rr rnrr%r%r&rszSetVariable.reconstructr!rrc s|dkr*ttj|g||R}|jj||j|j |jt dS|dkrI|r2Jt |dkr=t ||d}|dtf}n|dkr|rQJ|rUJz|jj}Wn ty}}ztt|ttt j |jdWYd}~nd}~wwt|||f||S|dkr|rJt |dksJttj|||dgiS|d kr|rJttj||g|iS|d kr|rJttj||g|iS|d kr|rJttj ||g|iS|d kr|rJttj!||g|iS|d kr|r Jttj"||g|iS|dkr>t |dkr+t |||r0Jttj#||g|iS|dkrbt |dkrOt |||rTJttj$||g|iS|dkr|%r|rqJttj&||g|iS|dkr|rJt |dksJ|d|vrtt||dt|d||S|dkr|rJt |dksJ|d|vrt|d||St j ddS|dvrt'j(t'j)d}|d*} t+| tstt|| gi} t|,|||| giSt||||S)Nr_rrrrrr isdisjoint intersectionintersection_updateunion differencedifference_updatesymmetric_differencesymmetric_difference_updaterremovediscard)rE)issubset issuperset)-r rJrcall_setrrrrCrrrrrnr'r r"r*rr]rr rmapr!rrrNr set_isdisjointrset_intersectionset_intersection_update set_unionset_differenceset_difference_updateset_symmetric_differenceset_symmetric_difference_updater set_updateoperatorlegerrr+) r^r#r$r!r temp_set_vtresultr7oprrrr%r&r s                           zSetVariable.call_methodr#rr0cCstd)NzIllegal to getitem on a set) RuntimeError)r^r#r0r%r%r&rszSetVariable.getitem_constcCrr3r%rjr%r%r&rz)SetVariable.install_dict_keys_match_guardcCrr3r%rr%r%r&rrRz'SetVariable.install_dict_contains_guardr)rvrwrxryrrr_rrzr*r{r"r>rrgrrrrrrrrr%r%rr&r s4    lr cs~eZdZdeeddffdd ZddZedd Zd d Z d d Z dddZ deede e efddffdd ZZS)FrozensetVariablerCr\Nc tj|fi|dSr3rr_r#rr%r&r_zFrozensetVariable.__init__cCr$)Nz frozenset()rr%csr&r3rr'r%r%r&r8raz/FrozensetVariable.debug_repr..rr(rjr%r%r&rr)zFrozensetVariable.debug_reprcCs |jSr3)rCrrjr%r%r&r* zFrozensetVariable.set_itemscCr1r3) frozensetrjr%r%r&rrzFrozensetVariable.python_typecCr+)NcSr,r%rr'r%r%r&r-r.z7FrozensetVariable.as_python_constant..r/rjr%r%r&rgr0z$FrozensetVariable.as_python_constantrrcs<dd|jDfddtdddS)NcSrr%rrr%r%r&rrz1FrozensetVariable.reconstruct..csdgS)NrX)rcreate_load_globalr%rr%r&rsz/FrozensetVariable.reconstruct..rF)r3r*rrr rr%rr&rs  zFrozensetVariable.reconstructr!rrcs<|dvr td|d|dkrtdSt||||S)Nrrrr<r=rIllegal call_method z on a frozensetr_)rQrrrrr^r#r$r!rrr%r&rs  zFrozensetVariable.call_methodr)rvrwrxrrr_rrzr*rrgrrrrrr%r%rr&rSs&    rScsteZdZdeeddffdd ZddZedd Zd d Z d d Z deede e efddffdd Z ZS)DictKeySetVariablerCr\Nc rTr3rUr#rr%r&r_rVzDictKeySetVariable.__init__cCr$)Nz dict_keys([])z dict_keys([r%csr&r3rr'r%r%r&r8raz0DictKeySetVariable.debug_repr..z])r(rjr%r%r&rszDictKeySetVariable.debug_reprcCrr3rrjr%r%r&r*szDictKeySetVariable.set_itemscCr1r3rrjr%r%r&rrzDictKeySetVariable.python_typecCstdd|jDdS)NcSr,r%rr'r%r%r&r-r.z8DictKeySetVariable.as_python_constant..)rr!r*rrjr%r%r&rgs z%DictKeySetVariable.as_python_constantr!rrcs*|dvr td|dt||||S)NrZr[z on a dict_keys)rQrrr\rr%r&rszDictKeySetVariable.call_method)rvrwrxrrr_rrzr*rrgrrrrr%r%rr&r]s$  r]cseZdZUdZdZeeed<deddffdd Z e dd Z e d d Z d d Z dddZdeddeedfddffdd ZZS)DictViewVariablezu Models _PyDictViewObject This is an "abstract" class. Subclasses will override kv and the items method Nkvrr\c s8tjdi||jdvsJt|tsJ||_dS)N)rrrCr%)rr_r`r:rZrr rr%r&r_s zDictViewVariable.__init__cCst|jj|jSr3)getattrrrCr`rjr%r%r& view_items szDictViewVariable.view_itemscCstr3)NotImplementedErrorrjr%r%r& view_items_vt szDictViewVariable.view_items_vtcCrr3)rdrr%r%r&rrz$DictViewVariable.unpack_var_sequencerrcCs$||j||j|ddS)Nr)r load_methodr`rrr%r%r&rs  zDictViewVariable.reconstructr!rrcs,|dkr |j||||St||||S)Nr)rrrr\rr%r&rszDictViewVariable.call_methodr)rvrwrxryr`rr__annotations__rZr_rzrbrdrrrrrrr%r%rr&r_s"     r_csZeZdZdZeddZeddZddZded d e e d fd d ffd d Z Z S)rrcCrhr3)rrbrjr%r%r&r**rWzDictKeysVariable.set_itemscCr+)NcSrr%rrr%r%r&r1rz2DictKeysVariable.view_items_vt..rbrjr%r%r&rd.zDictKeysVariable.view_items_vtcCr1r3r^rjr%r%r&r3rzDictKeysVariable.python_typer!rrr\csl|dkr |j||||S|tvr-t|dttfsttStt||j |dj St ||||S)Nrr) rrrr:r rrrNotImplementedr*rr\rr%r&r6s zDictKeysVariable.call_method) rvrwrxr`rzr*rdrrrrrrr%r%rr&r's   rc@$eZdZdZeddZddZdS)rrcCrhr3)rrbrjr%r%r&rdLrWz DictValuesVariable.view_items_vtcCr1r3)rrjr%r%r&rPrzDictValuesVariable.python_typeNrvrwrxr`rzrdrr%r%r%r&rHs   rc@rj)rrCcCr+)NcSs g|] \}}t|j|gqSr%)r rAr]rr%r%r&rZrz3DictItemsVariable.view_items_vt..rgrjr%r%r&rdWrhzDictItemsVariable.view_items_vtcCr1r3)rrjr%r%r&r\rzDictItemsVariable.python_typeNrkr%r%r%r&rTs   rr3)sN         1gF C 8*-!