Run shell script using Oozie job

In this I will show how to automate shell scripts using Oozie framework.

First create job.properties file.

1 2 3 4 5 6

nameNode=hdfs://localhost:8020 jobTracker=localhost:8050 queueName=default oozie.wf.application.path=/<Hdfs Path>/sampleworkflow.xml oozie.use.system.libpath=true oozie.libpath=<shared lib path on Hdfs>

Create sampleworkflow.xml and place it in Hdfs.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23

<workflow-app name="shell-wf" xmlns="uri:oozie:workflow:0.4"> <start to="shell-node"/> <action name="shell-node"> <shell xmlns="uri:oozie:shell-action:0.2"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <configuration> <property> <name>mapred.job.queue.name</name> <value>${queueName}</value> </property> </configuration> <exec>sample.sh</exec> <file>/<Hdfs Path of the shell script>/sample.sh</file> </shell> <ok to="end"/> <error to="fail"/> </action> <kill name="fail"> <message>Shell action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app>

Running the job:

1	oozie job -oozie http://localhost:11000/oozie -config job.properties -run