Monthly Archives: March 2016

Talend Parquet /HDFS schema incompatibilities

Talend Parquet /HDFS schema incompatibilities Symtoms : Your query has the following error(s): Bad status for request 236: TGetOperationStatusResp(status=TStatus (errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), operationState=5, errorMessage=None, sqlState=None, errorCode=None) How to resolve Talend Parquet /HDFS schema incompatibilities    

Cloudera 5.5 Lots of ERROR ErrorMonitor: AssociationError on spark startup

Symptoms : Caused by: akka.remote.transport.Transport$InvalidAssociationException: The remote system terminated the association because it is shutting down. [Stage 0:=======> (24 + 26) / 50][Stage 3:> (0 + 24) / 24]15/09/17 09:48:35 ERROR ErrorMonitor: AssociationError [akka.tcp://sparkDriver@10.131.xx.xxx:58325] <- [akka.tcp://driverPropsFetcher@10.131.xx.xxx:59441]: Error [Shut down address: akka.tcp://driverPropsFetcher@10.131.xx.xxx:59441] [ akka.remote.ShutDownAssociation: Shut down address: akka.tcp://driverPropsFetcher@10.131.xx.xxx:59441 Caused by: akka.remote.transport.Transport$InvalidAssociationException: The remote system terminated the […]

Talend : java.lang.NullPointerException when creating Parquet files

Talend : java.lang.NullPointerException when creating Parquet files Symptoms : java.lang.NullPointerException when creating Parquet files. NullPointerExceptions in Parquet components with¬†Spark when reading the files directly or writing into s Parquet file from text or csv file.   CDH 5.4 CDH 5.5 Talend 6.1 Solution : ¬†