Job Parallelization in Talend (Multi Threading in Talend)

What is Parallelization?

To understand parallelization better, lets consider a simple game. We are given 10 coins and we have a simple task to perform with them: we need to toss each coin once. A pretty straightforward task; you would randomly pick one coin from your stack, toss is once and keep it aside from the rest to indicate it’s completion. Assuming it takes you one second to toss one coin, you would finish your entire task in 10 seconds. But now imagine you have a friend of yours willing to help you complete this task. What you would do is allocate 5 coins to him and 5 to yourself. Each of you would follow the same procedure together and this time you finish the task in 5 seconds. Now imagine you had 10 of your friends help at your disposal. You would finish the task in just a second! This simple task shows the power of parallelization.

In computing world, an operation is said to be parallelized when a complex process is split into many sub parts or child parts that execute simultaneously. This greatly improves the performance of your processing task, especially if you have more than one processor at your disposal.

Parallelization in Talend

Parallelization in Talend can be obtained when one job can call several jobs and execute them at the same time.

The tParallelize Component



Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.