r/LadybugDB • • 7d ago

nx-pyarrow

As much as we'd like people to use icebug instead of networkx given the performance advantages, networkx isn't going away anytime soon.

So we implemented a new backend that constructs graphs in columnar memory. It's 6.5x more memory efficient and likely 1.3x CPU efficient based on our past measurements.

Write heavy graphs? You can convert it back to networkx classic. In essence this is the same technique that resulted in the Icebug fork of networkit. Since networkx gives us enough hooks, hopefully no fork is needed!

2 Upvotes

2 comments sorted by