Talend Spark Error : Could not find uri with key

Talend Spark Error :  Could not find uri with key

[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache – Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!

Description

Steps:
1.Create a spark job with trowgenerator,tlogrow, thdfsconfiguration
2.on the Run ->Spark configuration set as yarn client for CDH54 with kerberos then run it

Expected Result:
Should run successfully without error

Actual Result:
Error on the result, but job can also run successfully

[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache - Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!

[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache - Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
[ERROR]: org.apache.hadoop.hdfs.KeyProviderCache - Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!

 

 

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.