Talend Spark : Local execution output

[statistics] connecting to socket on port 3452
[statistics] connected
[WARN ]: org.apache.spark.SparkConf – In Spark 1.0 and later spark.local.dir will be overridden by the value set by the cluster manager (via SPARK_LOCAL_DIRS in mesos/standalone and LOCAL_DIRS in YARN).
[ERROR]: org.apache.spark.SparkContext – Jar not found at ../lib/org.talend.dataquality.parser.jar
[ERROR]: org.apache.spark.SparkContext – Jar not found at ../lib/talend_file_enhanced_20070724.jar
[ERROR]: org.apache.spark.SparkContext – Jar not found at ../lib/dom4j-1.6.1.jar
[ERROR]: org.apache.spark.SparkContext – Jar not found at ../lib/log4j-1.2.16.jar
[ERROR]: org.apache.spark.SparkContext – Jar not found at ../lib/antlr-runtime-3.5.2.jar
[ERROR]: org.apache.spark.SparkContext – Jar not found at ../lib/camel-core-2.15.3.jar
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
[WARN ]: org.apache.hadoop.util.NativeCodeLoader – Unable to load native-hadoop library for your platform… using builtin-java classes where applicable

 

 

ignore all the errors  , the job will be successful

1 Hour Virtual Assistance Services by a Talend Expert

 

 

Leave a Reply