Tag: JavaScript
-
Reading large XML file using Pentaho and Apache Hop
Refer to my pervious article – Processing GLIEF data in JSON format . I wanted refresh my knowledge of Pentaho Data Integration tool and see if I could process huge XML file without running into Java OOM (Java Out of Memory) problem. Pentaho offers Input step called – XML Input Stream (StAX – Streaming API…
-
Copy data from local MySQL database to Google Cloud MySQL
The main job performs two tasks: insert latest records into the target database update the target database with delta records PDI crashes if it tries to load more than few millions records at a single run. The approach is taken to overcome this limitation by processing data in smaller data chunks. How it works get…