Fantastic walkthrough of that moment when theory clicks into practice. The incremental batch sizing approach (1% to 100%) is such a sleept-on pattern when loading into graph DBs, it saves so much pain compared to going all-in on the first try. One thing worth noting is that MERGE can get slow withlarge batches if the indexes aren't tuned upfront, might be worth a future post on when to use CREATE vs MERGE.
Fantastic walkthrough of that moment when theory clicks into practice. The incremental batch sizing approach (1% to 100%) is such a sleept-on pattern when loading into graph DBs, it saves so much pain compared to going all-in on the first try. One thing worth noting is that MERGE can get slow withlarge batches if the indexes aren't tuned upfront, might be worth a future post on when to use CREATE vs MERGE.
Yeah, that sampling is one of my personal secrets. Such a simple and useful technique for testing and validation.
Thank you for the tip. Yup. The plan is to push forward until pain. Then optimize past that, then smooth sailing til next wall.
We all learn a lot from both creativity and pain.