Artificial Intelligence
Artificial Intelligence
Out of context: Reply #1773
- Started
- Last post
- 2,577 Responses
- ********0
- $30k for 11 toks/sec seems a bit excessive, but running locally a full LLM is damn cool********
- nice, but yeah vs $1 per 1M tokens in the cloud $30k = 30B tokens = 86 years chooching totkens 24/7 before you break even on that rig :Dkingsteven
- Economics just don't make sense rn, this is like doing Uber with the latest Lamborghini********
- $30k for 11 toks/sec seems a bit excessive, but running locally a full LLM is damn cool