A server grade CPU with a lot of RAM and memory bandwidth would work reasonable well, and cost “only” ~$10k rather than 100k+…
- 0 Posts
- 3 Comments
Joined 2 years ago
Cake day: August 2nd, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
To be fair, most people can’t actually self-host Deepseek, but there already are other providers offering API access to it.
There are already other providers like Deepinfra offering DeepSeek. So while the the average person (like me) couldn’t run it themselves, they do have alternative options.