§ ÇPƒinãóV—ddlmZmZddlmZmZmZmZmZm Z ddl m Z m Z m Z mZgd¢ZdS)é)ÚPPOStatsÚ Trajectory)Úestimate_advantagesÚget_reward_penalty_maskÚget_rewards_ppoÚ masked_meanÚ masked_varÚwhiten)Úget_batch_log_probsÚlogits_to_logprobsÚ%truncate_sequence_at_first_stop_tokenÚtruncate_sequence_for_logprobs) r r rrrrr rr rr rN)Ú_typesrrÚrewardsrrrrr r Úsequence_processingr r r rÚ__all__©óúk/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/torchtune/rlhf/__init__.pyúrsÀðð)Ð(Ð(Ð(Ð(Ð(Ð(Ð(ððððððððððððððððððððððððððððð ð ð €€€r