g\4dZddlZddlZddlmZddlmZmZmZm Z m Z ddl Z ddl m cmZddl m Z ddlmZddlmZmZmZdd lmZdd lmZmZmZmZdd lmZmZm Z m!Z!m"Z"m#Z#d d l$m%Z%m&Z&m'Z'e!j(e)Z*dZ+dZ,dZ-dZ.d[dZ/de j0de j0fdZ1eGddeZ2eGddeZ3eGddeZ4Gdde j5Z6Gdde j5Z7Gd d!e j5Z8Gd"d#e j5Z9Gd$d%e j5Z:Gd&d'e j5Z;Gd(d)e j5Z<Gd*d+e j5Z=Gd,d-e j5Z>Gd.d/e j5Z?Gd0d1e j5Z@Gd2d3e j5ZAd4ZBd5ZCd6ZDd7ZEGd8d9e j5ZFGd:d;e j5ZGGd<d=e j5ZHGd>d?e j5ZId@eHiZJGdAdBe j5ZKGdCdDe j5ZLGdEdFe j5ZMGdGdHe j5ZNGdIdJe j5ZOGdKdLe j5ZPGdMdNeZQGdOdPeQZRGdQdReQZSeeBGdSdTeQZTedUeBGdVdWeQZUedXeBGdYdZeQZVdS)\zPyTorch CLAP model.N) dataclass)AnyListOptionalTupleUnion)nn)ACT2FN))BaseModelOutputWithPastAndCrossAttentionsBaseModelOutputWithPooling,BaseModelOutputWithPoolingAndCrossAttentions)PreTrainedModel)apply_chunking_to_forward find_pruneable_heads_and_indicesmeshgridprune_linear_layer) ModelOutputadd_start_docstrings%add_start_docstrings_to_model_forwardloggingreplace_return_docstrings torch_int)ClapAudioConfig ClapConfigClapTextConfigzlaion/clap-htsat-fusedc|j\}}}|dddddddfdd|d}||||z|}|S)ae Interpolate data in time domain. This is used to compensate the resolution reduction in downsampling of a CNN. Args: hidden_states (`torch.FloatTensor` of shape (batch_size, time_length, classes_num)): Input hidden states ratio (`int`): The ratio of the length of the output to the length of the input. Nr)shaperepeatreshape) hidden_statesratio batch_size time_length classes_num upsampleds b/var/www/html/ai-engine/env/lib/python3.11/site-packages/transformers/models/clap/modeling_clap.py interpolater)3sg.;-@*ZkaaaD!!!m,33Aq%CCI!!*kE.A;OOI c|j\}}}}||||z|||z||}|ddddddd|||}|S)aR Returns the resized hidden states. The output shape should be `(batch_size * num_windows, window_size, window_size, num_channels)` Args: hidden_states (`torch.FloatTensor` of shape `(batch_size, height, width, num_channels)`): Input hidden states window_size (`int`): Window size rrr rviewpermute contiguous)r" window_sizer$heightwidth num_channelswindowss r(window_partitionr9Ds/<.A+J|!&&Fk);8Lk[gM##Aq!Q155@@BBGGKYdfrssG Nr*c|jd}|d||z||z|||}|ddddddd|||}|S)a Merges windows to produce higher resolution features. Args: windows (`torch.FloatTensor` of shape `(num_windows * batch_size, window_size, window_size, num_channels)`): Input windows window_size (`int`): Window size height (`int`): Height of the resized audio width (`int`): Width of the resized audio r/rrr r,r-r.r0)r8r4r5r6r7s r(window_reverser;Ysx=$Lll2v4e{6JKYdfrssGooaAq!Q//::<<AA"feUabbG Nr*c||}tj|d||z|z}||zS)a Replace non-padding symbols with their position numbers. Position numbers begin at padding_idx+1. Padding symbols are ignored. This is modified from fairseq's `utils.make_positions`. Args: x: torch.Tensor x: Returns: torch.Tensor rdim)neinttorchcumsumtype_aslong) input_ids padding_idxpast_key_values_lengthmaskincremental_indicess r("create_position_ids_from_input_idsrJmsg << $ $ ( ( * *D <!444<