Talend Spark : Output of successful Spark job

[statistics] connecting to socket on port 3937
[statistics] connected
[WARN ]: org.apache.spark.SparkConf – In Spark 1.0 and later spark.local.dir will be overridden by the value set by the cluster manager (via SPARK_LOCAL_DIRS in mesos/standalone and LOCAL_DIRS in YARN).
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
[WARN ]: org.apache.hadoop.util.NativeCodeLoader – Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!

[Stage 0:> (0 + 0) / 2]
[Stage 0:> (0 + 1) / 2]
[Stage 0:=============================> (1 + 1) / 2]

[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!

[Stage 1:> (0 + 0) / 2]
[Stage 1:> (0 + 1) / 2]
[Stage 1:=============================> (1 + 1) / 2]

Leave a Reply