NgddlmZmZddlZdZdZdZdZdeej ej e fde dej fd Z d ej d ej de dej fd Zdeej ej e fde deej ej ffd ZdS))TupleUnionNixsignedreturncH|r tjn tj}|rtnt}|rt nt }t|tjstj |}tj tj ||| |S)aCast to 4bit via rounding and clipping (without packing). Args: x: element to be converted signed: boolean, whether to convert to signed int4. Returns: An ndarray with a single int4 element (sign-extended to int8/uint8) ) npint8uint8INT4_MIN UINT4_MININT4_MAX UINT4_MAX isinstancendarrayasarrayrintclipastype)rrdtypeclip_low clip_highs H/var/www/html/ai-engine/env/lib/python3.11/site-packages/onnx/subbyte.pyfloat32_to_4bit_unpackedrs +BGG28E!0xxyH"1 I a $ $ JqMM 7271h 22 3 3 : :5 A AAval_lowval_highcXt||}t||}|dz|dzzS)afCast two elements to 4bit (via rounding and clipping) and pack to a single byte Args: val_low: element to be packed in the 4 LSB val_high: element to be packed in the 4 MSB signed: boolean, whether to convert to signed int4. Returns: An ndarray with a single int8/uint8 element, containing both int4 elements r)r)rrri8_highi8_lows rfloat32x2_to_4bitx2r$$s5'x88G %gv 6 6F a<&4- ''rc>d} t|tjstj|}|dz}|dz }|r ||n|}|r ||n|}|r tjn tj}||||fS)NcBtj|dz dk||dzS)Nr)r where)rs rz&unpack_single_4bitx2..9s bhQ1}aTBBrrr!)rr rrr r r)rr unpack_signedx_lowx_highrs runpack_single_4bitx2r.6sCBM a $ $ JqMM HE !VF$* 5MM% E&, 8]]6 " " "&F +BGG28E LL  u!5!5 66r)typingrrnumpyr rrrrrrfloatboolrr$r.rrr4s      B RZ5 ()B37BZBBBB*( X(!#(37(Z(((($7 RZ5 ()7377 2:rz !"777777r