Talend Spark RDD : Cannot change storage level of an RDD after it was

(Talend Spark RDD : Cannot change storage level of an RDD after it was )

java.lang.UnsupportedOperationException: Cannot change storage level of an RDD after it was already assigned a level

 Spark uses RDD ( Resilient distributed dataset ) , So in Spark jobs
This will throw an error, the component tReplicate_2 is trying to get the RDD from the tUnite_1 component which is throwing the error : 
 
 Exception in thread “main” java.lang.Error: Unresolved compilation problem: 
rdd_conntUnite_1_2 cannot be resolved to a variable
 
The reason is because the tReplicate has his own parameters of Storage and it tried to change the RDD level of Storage 
 

further down , this error will be displayed :

java.lang.UnsupportedOperationException: Cannot change storage level of an RDD after it was already assigned a level

SOLUTION : 
 
 
 

 

 

Leave a Reply