Developers

==

Configure the development environment.

Clone the project first.

git clone https://github.com/olegz/yarn-tutorial.git

Once cloned, navigate to the project's root cd yarn-tutorial and follow these instructions. You should be up and running in less then a min.

This project uses Gradle as its build and dependency management (see http://www.gradle.org/). Gradle is self-provisioning build framework which means you don't have to have Gradle installed to follow the rest of the procedure.

BUILD for development:

Depending on the IDE you are using execute the following gradle script.

Eclipse:

./gradlew clean eclipse

IntelliJ IDEA

./gradlew clean idea

The above will generate all necessary IDE-specific artifacts to successfully import the project. Import the project into your IDE. For example in Eclipse follow this procedure:

File -> Import -> General -> Existing Project Into Workspace -> browse to the root of the project and click Finish

NOTE: You don't have to import projects as Gradle and/or Maven project. The ./gradlew clean eclipse/idea command will take care of generating all the necessary IDE-native files so you can import it as Eclipse/Gradle project and not deal with wrong plugin versions of one or another.

This project consists of several modules (3 at the time of writing). It is recommended to import all of them, but not always necessary depending on your goals.

==

API

The initial YARN API used in these demos is in the yaya module. Please refer to its javadocs for more information on its usage. more information will be coming here as well.

Samples and Demos

One of the main goals of this project is to introduce rapid development with YARN, so it attempts to ensure that all the moving pieces are in place to get up and running in less then 5 min. One of the most essential elements it has is the Mini Yarn Cluster located in yarn-test-cluster module. It is modeled after Hadoop's test cluster with few minor modifications. See its javadoc for more details. You can start it by simply executing StartMiniCluster.java. Once started you can run one of the demos right away.

The rest of the demos are in yaya-demo module.

Sample Java application

SampleYarnJavaCommandApplication. The logs will be in <project-home>/target/LOCAL_YARN_CLUSTER folder. See the javadocs and also go through Introduction section of this wiki to get more information on how to customize.

Sample UNIX command application

SampleYarnUnixCommandApplication

To run the same example remotely all you need is to drop appropriate yarn-site.xml and core-site.xml in the src/main/resources directory of the yaya-demo module.

More information is coming

Please send question and updates via pull requests and/or raising issues on this project.

Cheers!