Update on on-premise LLM service news
In a previous news article we announced the availability of a local LLM with no connection to big tech. We haven’t really advertised it further, but we can say it has proven popular. Part of the reason to launch was to discover bottlenecks, well, we’ve discovered bottlenecks. Currently there are ~200 registrations and ~10 people online concurrently. Heavy users may have noticed that the service can be slow at times. Plans In order to make more efficient use of our server, we will: ...