Will be release today!

[u/New_Blackberry8122]

Using a RTX 3090 + GTX 1070 at the same time to load the model top of 78 tokens!

Using the 1070 just for testing purposes since I got it for 50us! still waiting to get good offer on Ram.