Skip to content

Commit

Permalink
Correct comments in parallel_state.py (vllm-project#1818)
Browse files Browse the repository at this point in the history
  • Loading branch information
explainerauthors authored Nov 28, 2023
1 parent eeda608 commit 3256298
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions vllm/model_executor/parallel_utils/parallel_state.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Adapted from
# https://github.com/NVIDIA/Megatron-LM/blob/main/megatron/core/parallel_state.py
# Copyright (c) 2022, NVIDIA CORPORATION. All rights reserved.
"""Model and data parallel groups."""
"""Tensor and pipeline parallel groups."""

import torch

Expand Down Expand Up @@ -84,7 +84,7 @@ def initialize_model_parallel(


def model_parallel_is_initialized():
"""Check if model and data parallel groups are initialized."""
"""Check if tensor and pipeline parallel groups are initialized."""
return (_TENSOR_MODEL_PARALLEL_GROUP is not None
and _PIPELINE_MODEL_PARALLEL_GROUP is not None)

Expand Down

0 comments on commit 3256298

Please sign in to comment.