ToZ-Wide AI Answering System

[Monophtalmos]

Hello everyone,

As the title suggests, I want to create an AI system for the forums that uses RAG. But currently I don't have time to work on it.

The AI will function similarly to ChatGPT and answer questions people ask. Its responses will be generated from all the threads written on the forum (and of course other texts from the sites as well). When the AI chooses a response, it will prioritize sermons, replies from Clergy and Guardians, and then move on to moderators. Since it will also indicate which thread or text it is referencing, there won't be any "made-up information" issues.

This AI should be designed with privacy in mind, so it must not save user messages, avoid using tracking cookies, and mask IP addresses or any other identifying information.

As I said, I currently don't have the time to actively work on the AI, so I'm sharing the idea here in case anyone wants to work on it.

If there are people willing to take on the project, I'd be happy to help them with the technical side whenever I have free time.

 

[AFODO]

Yes I wanted to do this as well, currently learning how to. The best would be to self host it but we also need a good computer for that.
I think this is a very good base model: https://huggingface.co/soob3123/Veritas-12B as it already have a ton of ancient philosophical knowledge baked in.
with 4bit quantization, in theory a mac studio with 32-64 gb unified ram could run 5-10 instances of this parallel, plus we can have a wait list.
Maybe a 8B parameter model would be enough as well if we give it a very sophisticated knowledge base, but it must not be retarded as well. It's a matter of trying and testing.

 

[AFODO]

if we give it a very sophisticated knowledge base

and a good agentic rag. These as well increase ram consumption but they are necessary.

 

[High Priestess Lydia]

The AI will function similarly to ChatGPT and answer questions people ask. Its responses will be generated from all the threads written on the forum (and of course other texts from the sites as well). When the AI chooses a response, it will prioritize sermons, replies from Clergy and Guardians, and then move on to moderators. Since it will also indicate which thread or text it is referencing, there won't be any "made-up information" issues.

I had this idea as well and wrote it to our High Priest and the SGs a few years ago when I first learned what ChatGPT was.

After 15 years of being here I just cannot answer many of the same basic topics over and over again, I find myself giving answers that are too short and lacking, whereas newer members will give a better reply (regarding cleaning aura, etc). So I realized that to have answers generated from all previous replies would be very convenient and ensure new members get their question thoroughly answered.

 

[AFODO]

I had this idea as well and wrote it to our High Priest and the SGs a few years ago when I first learned what ChatGPT was.

After 15 years of being here I just cannot answer many of the same basic topics over and over again, I find myself giving answers that are too short and lacking, whereas newer members will give a better reply (regarding cleaning aura, etc). So I realized that to have answers generated from all previous replies would be very convenient and ensure new members get their question thoroughly answered.

Then it's God's willing, we will do it High Priestess!

 

[BlueWizard]

I am all for it. I have strong interest in working on building custom AI's for websites, businesses etc and this is a good way for me to learn how's and do's.

 

[Monophtalmos]

After 15 years of being here I just cannot answer many of the same basic topics over and over again, I find myself giving answers that are too short and lacking, whereas newer members will give a better reply (regarding cleaning aura, etc). So I realized that to have answers generated from all previous replies would be very convenient and ensure new members get their question thoroughly answered.

Your support and my brothers/sisters’ eagerness to join this project makes me happy, High Priestess.

Covering all forum replies would indeed be the better option. However, the training process for the AI will be somewhat demanding.

Since there are many outdated or incorrect replies, we’ll need a clear and reliable framework of accurate information. The AI should also be able to evaluate the accuracy of what it generates before giving an answer.

_

If you deem it appropriate we can create a group conversation on the forum with those who want to take part in the project and discuss the details there.

 

[StraitShot47]

This sounds great.

The only problem I can see, can it be flooded with wrong requests?

 

[AFODO]

This sounds great.

The only problem I can see, can it be flooded with wrong requests?

For first version we can basically ban those who misuse it, but I think it's feasible to have an agent that decides if the prompt is worthy enough to send it to the llm.