g< d dl Z d dlZd dlmZ d dlmZ ddlmZ ddl m
Z
m Z d Z ddZ
d Z G d
d Z G d d
e Z G d de ZdS ) N)Optional )TrainerCallback)IntervalStrategy
has_lengthc z t | } | dz | dz dz | dz }}}|dk r | d|dd|dn|dd|dS )z$Format `t` (in seconds) to (h):mm:ssi < r :02d)int)thmss W/var/www/html/ai-engine/env/lib/python3.11/site-packages/transformers/utils/notebook.py format_timer sm AA4i!r'R R!qA%&!VVa ! !! ! ! !! ! ! ! !A1C1C1CA1C1C1CC , c & d| d| d| d| d| d S )Nz
)valuetotalprefixlabelwidths r html_progress_barr ! s[
', =B
r c d}|dz
}| d D ] }|d| dz
} |dz
}| dd D ]B}|d z
}|D ]3}t |t r|d
nt | }|d | d z
}4|d
z
}C|dz
}|S )z*Put the texts in `items` in an HTML table.z%
z*
r z
| z |
z
Nz
z.6fz
| z |
z
z
)
isinstancefloatstr)items html_codeilineelts r text_to_html_tabler' , s n>n5n5n !## A% 9;;L ,t >D t'''-1->%$JZBZ-[**-1*
""
+/(z !JJLLL+7+/+EV[I[+\( OOE " " " #DO )DN*28RVW8W8W !
#C(9D\>>DJ>>>DJJ
%
-Y\YYDJYYTEV9W9WYYDJJ e Zd ZdZd fd Zd Zd Zd
dZd Z xZ S ) r- a
An object tracking the updates of an ongoing training with progress bars and a nice table reporting metrics.
Args:
num_steps (`int`): The number of steps during training. column_names (`List[str]`, *optional*):
The list of column names for the metrics table (will be inferred from the first call to
[`~utils.notebook.NotebookTrainingTracker.write_line`] if not set).
Nc p t | |d n|g| _ d | _ d S rX )superr4 inner_table child_bar)r3 num_steps column_names __class__s r r4 z NotebookTrainingTracker.__init__ s9
####/#744l^ r c t | j | j | j | j | j | _ | j "| xj t | j z
c_ | j | xj | j j z
c_ | j
4t j t j
| j d | _
d S | j
t j
| j d S rR )r r r r r r r# ra r' rb r2 rT rO rU rG rV s r rO z NotebookTrainingTracker.display s *4:tz4;PTPZ\`\fgg ' NN 01A B B BNN > % NNdn 6 6NN ; ,ty '@'@TRRRDKKK K ty 8 8 9 9 9 9 9r c | j It t g| _ dS | j d } D ]}||vr| | || j d< t | j dk r| j d }| j d d }|d | k r(| j fd|D dS |D ]6}| vr || | |< 7fd|D | j d< dS | j fd|D dS )z
Write the values in the inner table.
Args:
values (`Dict[str, float]`): The values to display.
Nr r c , g | ]}|v r| nd S )zNo Logr .0cvaluess r
z6NotebookTrainingTracker.write_line.. s* ,e,e,eXY!v++VAYY8,e,e,er c g | ]
}| S r r )rk rl
new_valuess r rn z6NotebookTrainingTracker.write_line.. s +K+K+KaJqM+K+K+Kr c g | ]
}| S r r rj s r rn z6NotebookTrainingTracker.write_line.. s (D(D(Dq(D(D(Dr )ra listkeysrm appendrN index)r3 rm columnskey last_values first_columnrl rp s ` @r
write_linez"NotebookTrainingTracker.write_line s # $V[[]] 3 3T&--//5J5J KD &q)G {{}}
(
(g%%NN3'''")D Q 4#$$q(( " .r 2 # / 21 5 q>VL%999$++,e,e,e,e]d,e,e,efffff "(J $ J J JOO$5$555,7
a8H8H,IJqM+K+K+K+K7+K+K+KD$R((( ''(D(D(D(DG(D(D(DEEEEEr r c @ t ||| | | _ | j S )a
Add a child progress bar displayed under the table of metrics. The child progress bar is returned (so it can be
easily updated).
Args:
total (`int`): The number of iterations for the child progress bar.
prefix (`str`, *optional*): A prefix to write on the left of the progress bar.
width (`int`, *optional*, defaults to 300): The width (in pixels) of the progress bar.
)r r, r )r) rb )r3 r r r s r add_childz!NotebookTrainingTracker.add_child s% -U6$V[\\\~ r c < d| _ | dS )z0
Closes the child progress bar.
N)rb rO rV s r remove_childz$NotebookTrainingTracker.remove_child s r rX )Nr )
rY rZ r[ r\ r4 rO rz r| r~
__classcell__)re s @r r- r- s
: : : F F F> r r- c H e Zd ZdZd Zd Zd Zd dZd Zd dZ d d Z
d
Z dS ) NotebookProgressCallbackz
A [`TrainerCallback`] that displays the progress of training or evaluation, optimized for Jupyter Notebooks or
Google colab.
c 0 d | _ d | _ d| _ d S )NF)training_trackerprediction_bar_force_next_updaterV s r r4 z!NotebookProgressCallback.__init__# s $ ""' r c |j t j k rdnd| _ d| _ d| _ | j gdgz }|j t j k r| d t |j | | _
d S )NEpochStepr
Training LossValidation Loss)
eval_strategyr EPOCHry
training_losslast_logNOrt r- max_stepsr )r3 argsstatecontrolkwargsrd s r on_train_beginz'NotebookProgressCallback.on_train_begin( s '+'9=M=S'S'SGGY_
)*o->> !1!4 4 4 1 2 2 2 7 V V r c t |j |j k rt |j n|j d}| j |j dz d| d|j | j d| _ d S )NrL r Epoch rK r1 r5 F)r epochr rG global_stepnum_train_epochsr )r3 r r r r r s r on_step_endz$NotebookProgressCallback.on_step_end1 s $' $4$4 $C$CEK EKI]I] $$ !=U==U%;== 0 %
#( r Nc f t | sd S | j q| j -| j t | | _ n!t t | | _ | j d d S | j | j j dz d S )Nr )r r r r| rN r) rG r )r3 r r r eval_dataloaderr s r on_prediction_stepz+NotebookProgressCallback.on_prediction_step: s /** F &$0&*&;&E&Ec/FZFZ&[&[##&9#o:N:N&O&O# & &q ) ) ) ) ) & &t':'@1'D E E E E Er c T | j | j d | _ d S rX )r rC r3 r r r r s r
on_predictz#NotebookProgressCallback.on_predictF s. * % % ' ' ' "r c |j t j k r4d|v r2d|d i}|j |d< | j | d S d S d S )Nlossr r )r r r r r rz )r3 r r r logsr rm s r on_logz NotebookProgressCallback.on_logK s_ !1!4 4 44 %tF|4F " .F6N ! , ,V 4 4 4 4 4 5 4 r c | j ddd}t |j D ]}d|v r
|d |d< n| j dk rt |j |d< n
|j |d< d}|D ]-} | d rt j d d
| }.|
d d }
|
d d }
|
| d
d }
|
| dd }
|
| dd }
|
| dd }
| D ]N\ } } | d } d
d | dd D }
|
dk rd}
| ||
< O| j | | j d | _ d| _ d S d S )NzNo log)r r r r r r eval_lossz\_loss$r/
total_flosr _runtime_samples_per_second_steps_per_second_jit_compilation_time_rI c 6 g | ]}| S r )
capitalize)rk parts r rn z8NotebookProgressCallback.on_evaluate..k s" J J Jt !2!2 J J Jr r Lossr T)r reversed log_historyry r r r endswithresubpopr" splitjoinrz r~ r r )r3 r r r metricsr rm logmetric_key_prefixkr vsplitsnames r on_evaluatez$NotebookProgressCallback.on_evaluateS s ,'/HMMF 122
S==.1&kF?+E ! G++"%ek"2"2w!&!2v &
B
B::g&& B(*z2q(A(A% L$//A GT**A 0 : : :DAAA 0 E E EtLLA 0 C C CTJJA 0 G G GNNA
!
!1 xx J Jvabbz J J JKK6>>,D t ! , ,V 4 4 4 ! . . 0 0 0"&D &*D # # #A - ,r c | j |j dt |j d|j d d | _ d S )Nr rK Tr )r rG r r r r r s r on_train_endz%NotebookProgressCallback.on_train_endv s[ $$ HS - -HH0FHH %
!% r rX ) rY rZ r[ r\ r4 r r r r r r r r r r r r s
( ( (
W W W( ( (
F
F
F
F# # #
5 5 5 5!+ !+ !+ !+F% % % % %r r )r )r r7 typingr IPython.displayrO rT trainer_callbackr
trainer_utilsr r r r r' r) r- r r r r r s?
. . . . . . 8 8 8 8 8 8 8 8D D D "O. O. O. O. O. O. O. O.dK K K K K 1 K K K\_% _% _% _% _% _% _% _% _% _%r