Run Spark job with Talend v6

Talend v6 supports the native integration of Spark , this means you don’t need to code in order to  process your data.

With Talend Spark jobs you do , for example :

Read files from HDFS , Convert them to Avro, Convert them to Parquet file

Perform a join between tables , Select aggregate .. etc

For DW projects you can build the fact tables using Spark

 

 

Leave a Reply