Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug][Module Name] job state always in final state:RUNNING_EXECUTION when execution engine is tez #5551

Closed
SbloodyS opened this issue May 27, 2021 · 2 comments · Fixed by #6289
Labels
Waiting for reply Waiting for reply

Comments

@SbloodyS
Copy link
Member

SbloodyS commented May 27, 2021

yarn application -status application_1621995850095_6901
21/05/27 07:06:04 INFO client.RMProxy: Connecting to ResourceManager at ip-192-168-24-254.us-west-2.compute.internal/192.168.24.254:8032
21/05/27 07:06:04 INFO client.AHSProxy: Connecting to Application History server at ip-192-168-24-254.us-west-2.compute.internal/192.168.24.254:10200
21/05/27 07:06:04 INFO conf.Configuration: resource-types.xml not found
21/05/27 07:06:04 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
21/05/27 07:06:04 INFO resource.ResourceUtils: Adding resource type - name = memory-mb, units = Mi, type = COUNTABLE
21/05/27 07:06:04 INFO resource.ResourceUtils: Adding resource type - name = vcores, units = , type = COUNTABLE
Application Report : 
        Application-Id : application_1621995850095_6901
        Application-Name : HIVE-f07905b9-25b6-4e3f-93a4-652ed349b9bd
        Application-Type : TEZ
        User : hadoop
        Queue : default
        Application Priority : 0
        Start-Time : 1622098349177
        Finish-Time : 1622098762224
        Progress : 100%
        State : FINISHED
        Final-State : ENDED

job final state is not SUCCEEDED but ENDED.Cause shell command always running.

worker.log
[INFO] 2021-05-27 07:05:41.030  - [taskAppId=TASK-10-264-3804]:[127] - FINALIZE_SESSION
[INFO] 2021-05-27 07:05:41.809  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:42.811  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:43.812  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:44.814  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:45.816  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:46.818  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:47.820  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:48.821  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:49.823  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:50.825  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
[INFO] 2021-05-27 07:05:51.826  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION

Which version of Dolphin Scheduler:
-[1.3.6]

@github-actions
Copy link

Hi:

  • Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
  • In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
  • If you haven't received a reply for a long time, you can subscribe to the developer's email,Mail subscription steps reference https://dolphinscheduler.apache.org/zh-cn/community/development/subscribe.html ,Then write the issue URL in the email content and send question to [email protected].

@github-actions github-actions bot added the Waiting for reply Waiting for reply label May 27, 2021
@SbloodyS
Copy link
Member Author

SbloodyS commented Jun 5, 2021

It seems Constants.ENDED is not in org.apache.dolphinscheduler.common.utils.HadoopUtils#getApplicationStatus.resulting in continuous running state.

        switch (result) {
            case Constants.ACCEPTED:
                return ExecutionStatus.SUBMITTED_SUCCESS;
            case Constants.SUCCEEDED:
                return ExecutionStatus.SUCCESS;
            case Constants.NEW:
            case Constants.NEW_SAVING:
            case Constants.SUBMITTED:
            case Constants.FAILED:
                return ExecutionStatus.FAILURE;
            case Constants.KILLED:
                return ExecutionStatus.KILL;

            case Constants.RUNNING:
            default:
                return ExecutionStatus.RUNNING_EXECUTION;
        }

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Waiting for reply Waiting for reply
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant