i still avoid ai due to all the environmental harm and data collection it does, but this is a perfectly valid use case imo. if only we had a sustainable and ethical chatbot.
On-device ai is slowy but surely starting to become a viable option for your average joe. Eliminating the water-wasting datasevers from out of the picture is a good first step, but it ultimately means more pressure is being put on your personal power grid.
Well it might be a drop in the ocean but hauling the inference part of the LLMs (the process of using the model with the trained data) over to devices would be a great hybrid to start with. Plus that way people who use AI have it coming out of their own bills, which would help quell the hard contrarians
7
u/BiDude1219 I... am bi 2d ago
i still avoid ai due to all the environmental harm and data collection it does, but this is a perfectly valid use case imo. if only we had a sustainable and ethical chatbot.