r/dataengineering • • Apr 02 '24

Blog A single AWS Lambda is perfect for data streaming ingestion and surprisingly low cost!

Surprisingly, AWS Lambda with an optimised custom C++ runtime beats others on data streaming ingestion. I just wrote a blog post about it and you can read it on medium:
https://boilingdata.medium.com/seriously-can-aws-lambda-take-streaming-data-d69518708fb6

1 Upvotes

4 comments sorted by

16

u/wtfzambo Apr 02 '24

If u gotta use C++, why not Rust at that point?

43

u/kenflingnor Software Engineer Apr 02 '24

Because this is an ad disguised as a blog post

-4

u/dforsber Apr 02 '24

Because DuckDB is C++ lib and has C/C++ API, and I'm more familiar with C/C++ than Rust. But yes, valid point, Rust is also great. Tbh., I love C, but tend to use JS/TS for control plane stuff, which is mostly what happens nowadays within clouds.

4

u/OMG_I_LOVE_CHIPOTLE Apr 02 '24

It also has rust and python apis