source: ML guy i know so this could be entirely unsubstantiated but apparently the main environmental burden of LLM infrastructure comes from training new models not serving inference from already deployed models.
1 point
source: ML guy i know so this could be entirely unsubstantiated but apparently the main environmental burden of LLM infrastructure comes from training new models not serving inference from already deployed models.
On the road to fully automated luxury gay space communism.
Spreading Linux propaganda since 2020
Rules:
1.7K
Monthly active users
1.8K
Posts
22K
Comments