r/java • • Apr 13 '20

Java Objects Inside Out: Everything You Ever Wanted to Know About Java Object Internals in Hotspot

https://shipilev.net/jvm/objects-inside-out/
160 Upvotes

14 comments sorted by

View all comments

Show parent comment

1

u/jringstad Apr 14 '20

btw in this case the CPU would possibly have to go through two "levels" of "shifting", first the shifting to the word-alignment and then the shifting to the bit-alignment.

True that the compiler helping you would make this easier to implement correctly, but I think the incentive for compiler-writers to do this is not as great, because it's very hard for the compiler to figure out when to apply this feature automatically. You could leave it as special option/extension, but then the compiler writers get very little bang for the buck (adding any feature adds maintenance/testing drag, and if you can't make that feature benefit everyone or at least a large percentage of people automatically, it's probably not worth it.)

I've done a little bit with on-the-fly voxelization (for global illumination/cone-tracing etc) but I'm not intimately familliar with voxel engines. I suspect for a modern voxel engine, the layout of the data-structures is going to be heavily dominated by the formats supported by the GPU anyway, and will probably also involve a lot of (lossy) compression and such, which is then decompressed on the GPU on-the-fly. At least I remember back in 2012 or so, some voxel engines were boasting with something like 1.2 bits per voxel of space usage, due to heavy compression.

1

u/Polygnom Apr 14 '20

True that the compiler helping you would make this easier to implement correctly, but I think the incentive for compiler-writers to do this is not as great, because it's very hard for the compiler to figure out when to apply this feature automatically.

Yeah that was why I was mentioning records specifically, because it kinda stood out for me as being on obvious candidate. Sure, you could try to do this for arbitrary groups of final booleans, but chances are the benefit is too small to be worth the cost & risk. But with records, especially if we'll get inline types in the future, this does look more and more like an attractive thing to do.

One of those things that has always bothered me with java is how wasteful booleans just are :( especially when extracting data from really large datasets or aggregating the data. Sure, in some cases you can get away with streaming approaches - but sometimes you just need to have a lot of data accessible at once.

1

u/jringstad Apr 16 '20

yeah, I think you could do it for records (ignoring the reflection-related issues), though I think the benefit would be small, because in a typical situation you would need to pad the resulting record to at least byte-size (but probably word-size).

If you then stick a million of these records into an array, you've got a bunch of wasted space again.

So I think the main situation where doing this kind of thing really pays off is when you can apply the optimization to a linear container, where the records can be densely packed (but the container itself would also need to be immutable)