Change to kwargs (NVIDIA#5475) (NVIDIA#5477)

Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Co-authored-by: Sandeep Subramanian <[email protected]> Signed-off-by: Hainan Xu <[email protected]>
hainan-xv · Nov 29, 2022 · d832b45 · d832b45
1 parent 0f0dae1
commit d832b45
Showing 1 changed file with 7 additions and 7 deletions.
diff --git a/nemo/collections/nlp/modules/common/megatron/transformer.py b/nemo/collections/nlp/modules/common/megatron/transformer.py
@@ -2332,13 +2332,13 @@ def custom_forward(*inputs):
                     for index in range(start, end):
                         layer = self._get_layer(index)
                         hidden_states = layer(
-                            hidden_states,
-                            attention_mask,
-                            encoder_output,
-                            enc_dec_attn_mask,
-                            rotary_pos_emb,
-                            self_attention_relative_position_bias,
-                            cross_attention_relative_position_bias,
+                            hidden_states=hidden_states,
+                            attention_mask=attention_mask,
+                            encoder_output=encoder_output,
+                            enc_dec_attn_mask=enc_dec_attn_mask,
+                            rotary_pos_emb=rotary_pos_emb,
+                            self_attention_relative_position_bias=self_attention_relative_position_bias,
+                            cross_attention_relative_position_bias=cross_attention_relative_position_bias,
                         )
                         if isinstance(hidden_states, tuple):
                             pass