yarn client 提交任务

文章目录

• • 目的
  • 概念和流程
  • • • • yarn运行机制
        • 1. 起yarn client
        • 2. 起app master
        • 3. Reference

目的

提交一个自定义的任务到Yarn上

概念和流程

yarn运行机制

1. 起yarn client

// 1.创建yarn client
YarnClientApplication app = yarnClient.createApplication();
// 2.配置
app.getApplicationSubmissionContext().setApplicationName( "truman.ApplicationMaster");
app.getApplicationSubmissionContext().setResource(Resource.newInstance(100, 1));
app.getApplicationSubmissionContext().setPriority(Priority.newInstance(0));
app.getApplicationSubmissionContext().setQueue("default");
app.getApplicationSubmissionContext().setAMContainerSpec(amContainer);
// 3.提交应用到rm
ApplicationId appId = yarnClient.submitApplication(app.getApplicationSubmissionContext());

2. 起app master

3. Reference

https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html
https://blog.csdn.net/hahachenchen789/article/details/80586505

本文来自互联网用户投稿，文章观点仅代表作者本人，不代表本站立场，不承担相关法律责任。如若转载，请注明出处。 如若内容造成侵权/违法违规/事实不符，请点击【内容举报】进行投诉反馈！