Is AI actually sustainable? Our apprentice Amirreza suggested the topic – a fair question at a time when AI models consume ever more electricity.
The problem: AI needs a lot of energy
Training large language models such as GPT-4 consumes amounts of electricity that get compared to the annual consumption of entire cities. In operation, too, the data centres of the large cloud providers are considerable sources of CO&sub2;.
On-premise as the greener alternative
Smaller models optimised for their purpose consume considerably less energy than the large all-rounders. KOSMO relies on efficient open-source models – adapted to your specific requirements.
~70 %less data transfer vs. cloud chatbots
100 %green IT hosting possible
KOSMO and sustainability
Splitbot works with green IT hosting partners that use renewable energy exclusively. Anyone running KOSMO there can use an almost climate-neutral AI solution.
