Question
In Replace by CSV Table logic, is file read executed each time it goes through the process, or is file read cached and used thereafter?
Answer
Replace by CSV Table logic reads from the file the number of times Mapper is executed.
Therefore, if Mapper is executed multiple times, such as in Loop by Number of Data operation, the file is accessed for that number of times, but if it is repeated within Mapper, such as in Iterate specified node logic, the file is accessed only once.
Thus, for example, when handling 1000 input data, if Mapper is executed 1000 times to process data one by one by Loop by Number of Data operation, the file is also accessed for that number of times, which may affect performance.
Comments
0 comments
Article is closed for comments.