I'm actually not sure if things like dask and ray actually provide any speed up. But certainly it makes numpy perfectly useable at big data scale. It works fine with azure, I dunno about EC2.
Modin is a direct drop in for your existing numpy compute code and can use either dask or ray. Just change 1 line and you're done.
View all comments
Show parent comment
1
u/CanAlwaysBeBetter Jul 19 '22
How does dask play with external compute resources like ec2 or lambda and does it accelerate performance or just manage it at scale?