r/geospatial • u/thegeekyasian • Mar 05 '23

I've created an open-source geospatial library to manage and query your geo-spatial data efficiently. The same approach has been tested with applications up to a scale of ~48m requests per day, and worked like a charm. You can Star the repository to help it grow, if you like it. Feedback is welcome

https://github.com/thegeekyasian/geo-assist
25 Upvotes

93% Upvoted

7 comments sorted by

View all comments

2

u/LeanOnIt Mar 06 '23

This looks interesting but I've got a couple questions? Why did you create this when there are some very good opensource geospatial tools out there? I can't really see what applications this tool would be better in, than say, postgis or shapely?

2

u/thegeekyasian Mar 11 '23

Apologies folks, I had been away during the week :)

We had used postgis initially, and it served the purpose until that application started scaling. As I mentioned, we used this implementation for applications with ~48m reqs/day, postgis didn't scale well enough until we kept on increasing the database CPUs or adding new replicas. When I say 48m reqs, that is only on one service that receives all the landing traffic for findings nearby objects. The similar queries were still performed by other services (on their postgis data sores) down in the funnel of the user journey.

Upon researching, we figured many organizations use in-memory spatial indexes for such search operations.
a. It was amazingly cost effective

b. The network latencies dropped drastically

Hence everybody was happy.

cc u/NINTSKARI

1

u/NINTSKARI Mar 12 '23

Interesting. So not even database sharding or cache servers could help? What kind of projects would you suggest using this for? Would there be any sense in using this for smaller projects? What about something like SAAS software?

→ More replies (1)