.`iTJdZddlmZddlmZddlmZGddeZdS) zCInference-only HF format GLM-4 model compatible with THUDM weights.) VllmConfig)LlamaForCausalLM)PPMissingLayerc.eZdZdddedeffdZxZS)GlmForCausalLM)prefix vllm_configr c(|jj}d|jd<t|||jjD]J}t|ts3d|j j _ d|j j _ d|j j _KdS)Ng?partial_rotary_factor)r r FT) model_config hf_configrope_parameterssuper__init__modellayers isinstancer self_attn rotary_emb is_neox_styleo_projbias skip_bias_add)selfr r rlayer __class__s r/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/model_executor/models/glm.pyrzGlmForCausalLM.__init__ s,6 =@ !"9: [@@@ Z& < r+syJI""""""======!!!!!! < < < < <% < < < <