Talend Spark error and how to fix it

Talend Spark error and how to fix it

If you have got this kind of error below :

[WARN ]: org.apache.spark.SparkConf – In Spark 1.0 and later spark.local.dir will be overridden by the value set by the cluster manager (via SPARK_LOCAL_DIRS in mesos/standalone and LOCAL_DIRS in YARN).
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
[WARN ]: org.apache.hadoop.util.NativeCodeLoader – Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
org.talend.bigdata.dataflow.SpecException: Invalid input accessor: data2.null
      at org.talend.bigdata.dataflow.hmap.HMapSpec$JoinDef.deserialize(HMapSpec.java:1206)
      at org.talend.bigdata.dataflow.hmap.HMapSpec$JoinDef.access$1800(HMapSpec.java:1122)
      at org.talend.bigdata.dataflow.hmap.HMapSpec.joinKey(HMapSpec.java:563)
      at org.talend.bigdata.dataflow.hmap.HMapSpecBuilder.joinKey(HMapSpecBuilder.java:171)

 

1 Hour Virtual Assistance Services by a Talend Expert

 

Leave a Reply