Talend Spark job output ( aggregation, union , join and filter job )

Talend Spark job output ( aggregation, union , join and filter job )

[statistics] connecting to socket on port 3405
[statistics] connected
[WARN ]: org.apache.spark.SparkConf – In Spark 1.0 and later spark.local.dir will be overridden by the value set by the cluster manager (via SPARK_LOCAL_DIRS in mesos/standalone and LOCAL_DIRS in YARN).
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
[WARN ]: org.apache.hadoop.util.NativeCodeLoader – Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!

[Stage 0:> (0 + 0) / 4] [Stage 0:> (0 + 1) / 4] [Stage 0:> (0 + 2) / 4] [Stage 0:==============> (1 + 1) / 4] [Stage 0:=============================> (2 + 1) / 4] [Stage 0:============================================> (3 + 0) / 4] [Stage 0:============================================> (3 + 1) / 4] [ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
[statistics] disconnected

 

 

Leave a Reply