OutOfMemoryError: Java heap space error occurs when I perform data processing that uses a loop operation

Question

When I run a script that uses a loop operation to process data, the following error occurs.
What is the cause of this and is there a solution?

OutOfMemoryError: Java heap space

Answer

Due to the size of a script or the amount of data to be processed, heap memory of the Integrate Service may run out of memory when the script is executed, resulting in the execution error.

Please try the following workarounds:

1. Incorporate a transaction operation into the process flow that uses a loop operation
   When you implement scripts that use loop operations, incorporating transaction operations into the scripts in such a way that it encloses the Loop operation may be able to improve the performance when you execute the projects.
   
   Please refer to the following page as well for how to implement the scripts.
   Improving the performance of Loop operations
   https://www.hulft.com/help/en-us/HULFTSquare/Content/Data_Integration/Detailed/performance_improvement.htm
   
   
2. Scaling up the Integrate Service
   Consider scaling up the Integrate Service that runs the script.

Related FAQs

How is the operation of the service affected when an OutOfMemoryError occurs?
https://support.square.hulft.com/hc/articles/9465225443732

Performance when placing file connector's writing operations during looping operations is slow.
https://support.square.hulft.com/hc/articles/9465105302164

Script execution fails after increasing the number of data to be processed.
https://support.square.hulft.com/hc/articles/9462841983124