o ,h@s|dZddlmZddlmZmZmZddlZddlm Z ddlm Z gd Z ee e edfZd efd d Zd efd dZd efddZd efddZd efddZd efddZd efddZd efddZd0ded dfddZGdddZGd d!d!ZeZead0ded efd"d#ZGd$d%d%eZd&ed efd'd&Z d efd(d)Z!ded dfd*d+Z"d e fd,d-Z#d efd.d/Z$dS)1zj This package implements abstractions found in ``torch.cuda`` to facilitate writing device-agnostic code. )AbstractContextManager)AnyOptionalUnionNdevice)amp) is_availableis_initialized synchronizecurrent_devicecurrent_streamstream set_device device_countStream StreamContextEventreturncC tjjS)z/Returns a bool indicating if CPU supports AVX2.)torch_C_cpu_is_avx2_supportedrrM/var/www/html/scripts/venv/lib/python3.10/site-packages/torch/cpu/__init__.pyr! rcCr)z1Returns a bool indicating if CPU supports AVX512.)rrr_is_avx512_supportedrrrrr&rrcCr)z6Returns a bool indicating if CPU supports AVX512_BF16.)rrr_is_avx512_bf16_supportedrrrrr +rr cCr)z/Returns a bool indicating if CPU supports VNNI.)rrr_is_avx512_vnni_supportedrrrr_is_vnni_supported0s r"cCr)z3Returns a bool indicating if CPU supports AMX_TILE.)rrr_is_amx_tile_supportedrrrrr#6rr#cCr)z3Returns a bool indicating if CPU supports AMX FP16.)rrr_is_amx_fp16_supportedrrrrr$;rr$cCr)zInitializes AMX instructions.)rrr _init_amxrrrrr%@rr%cCdS)zReturns a bool indicating if CPU is currently available. N.B. This function only exists to facilitate device-agnostic code Trrrrrr Esr rcCr&)zWaits for all kernels in all streams on the CPU device to complete. Args: device (torch.device or int, optional): ignored, there's only one CPU device. N.B. This function only exists to facilitate device-agnostic code. Nrrrrrr Nr c@sBeZdZdZddeddfddZddd Zdd d Zdd d ZdS)rzH N.B. This class only exists to facilitate device-agnostic code priorityrNcCdSNr)selfr)rrr__init__]zStream.__init__cCr*r+rr,rrrr wait_stream`r.zStream.wait_streamcCr*r+rr,rrr record_eventcr.zStream.record_eventcCr*r+r)r,eventrrr wait_eventfr.zStream.wait_event)r(rN) __name__ __module__ __qualname____doc__intr-r0r2r4rrrrrXs   rc@s<eZdZdefddZd d ddZd ddZd d d d ZdS) rrcCr&)NTrr1rrrquerykr.z Event.queryNcCr*r+rr/rrrrecordnr.z Event.recordcCr*r+rr1rrrr qr.zEvent.synchronizecCr*r+rr/rrrwaittr.z Event.waitr+r5)r6r7r8boolr;r<r r=rrrrrjs   rcCstS)zReturns the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): Ignored. N.B. This function only exists to facilitate device-agnostic code )_current_streamrrrrr|s rc@sHeZdZUdZeeed<ddZddZde de d e d d fd d Z d S)rzvContext-manager that selects a given stream. N.B. This class only exists to facilitate device-agnostic code cur_streamcCs||_t|_dSr+)r_default_cpu_stream prev_streamr/rrrr-s zStreamContext.__init__cCs |j}|dur dSt|_|adSr+)rr?rB)r,r@rrr __enter__s zStreamContext.__enter__typevalue tracebackrNcCs|j}|dur dS|jadSr+)rrBr?)r,rDrErFr@rrr__exit__s zStreamContext.__exit__) r6r7r8r9rr__annotations__r-rCrrGrrrrrs   rrcCst|S)zWrapper around the Context-manager StreamContext that selects a given stream. N.B. This function only exists to facilitate device-agnostic code )r)rrrrrscCr&)zReturns number of CPU devices (not cores). Always 1. N.B. This function only exists to facilitate device-agnostic code r rrrrrrrcCr&)zzSets the current device, in CPU we do nothing. N.B. This function only exists to facilitate device-agnostic code Nrrrrrrr'rcCr&)zyReturns current device for cpu. Always 'cpu'. N.B. This function only exists to facilitate device-agnostic code cpurrrrrrrIrcCr&)zReturns True if the CPU is initialized. Always True. N.B. This function only exists to facilitate device-agnostic code Trrrrrr rIr r+)%r9 contextlibrtypingrrrrr_devicer __all__strr: _device_tr>rrr r"r#r$r%r r rrrAr?rrrrrrr rrrrs8