CPC finally reaches AI! - LLM Chat for SymbOS by Prevtenet

[Prodatron]

Prevtenet is close to completing another exceptional application for SymbOS by using his powerful SCC development kit (SymbOS C Compiler):
"LLM Chat" makes ChatGPT a reality on the CPC. It allows you to chat using a local or web-based "Large Language Model," the name for the AI category that has brought us a new revolution over the past 2.5 years.

You cannot view this attachment.


You cannot view this attachment.

LLM Chat works on any SymbOS platform with network hardware, including the CPC with the M4Board, RSF3, or Net4CPC hardware. It supports the OpenAI standard interface and is therefore compatible with virtually all LLMs.

A short video by EdoZ:


You cannot view this attachment.

Web-based LLMs require a proxy that converts HTTPS to HTTP, as this would otherwise be too time-consuming for a Z80.

LLMs on the local network are also supported, which can be installed on your own PC using "LM Studio," for example.

LLMChat is currently in beta phase, but already works very well.

As soon as it is released, I will post the download link here!

[Gryzor]

Hahaha that's awesome!

[Brocky]

thats cool AF!

[genesis8]

I wonder if it can be used with the local running LLM GAIA  by AMD (GAIA).

It works on every computers (one installer for a generic installation or if you use an AMD 300 series, it will install a specific instation using its AI chip).

[robcfg]

Ask it to compare the CPC and the C64 and see what happens... 

[norecess464]

Time to connect it to Skynet .....