Page 2 of 2

Re: Even most AI hate us!

Posted: Tue Sep 22, 2026 5:48 pm
by NeverLoseKibou
Theendoftheline wrote: Tue Sep 22, 2026 2:45 pm
Scorchingwilde wrote: Tue Sep 22, 2026 2:34 pm
Jim Burton wrote: Tue Sep 22, 2026 10:51 am

Can we hook one of them up to our website?
If you have a server to run it through and sufficient local computing power (a good enough GPU and RAM), I believe it can be done.
I've never had good luck with locally ran ai personally. I feel like commercial ai pulls from the web at times which makes it have nearly unlimited resources to pull from where as locally ran ai often times hallucinates or comes up with random jargon. I mean my systems not crazy or anything but I do have a semi decent amount of ram and a fully modern gaming GPU, but responses of locally installed AI has just been lackluster.
Well locally run AI can reach out to the web as well if you give it permission. When I run AIs locally I will often give them permission to use the web, and use skills I've built to direct them to map resources online as well as local resources. I would advise running a VPN because you don't have direct control of it's online investigations. Don't get me wrong, they don't seek illegal content any more than commercial AIs do but even just trawling map wiki's and means your local machine is off scouring map resources to answer your prompts.

I've had a lot of success with local AIs, for map activism research.

There is an unrestricted AI on the darkweb that people are talking about. I did try it for some activism queries to see how it compares and it was pretty good, comparable to other local models. They're doing what was proposed above, just running a local AI with a web interface.

The trouble is you can't control what people are using it for and so I don't know what the legality would be of someone using it for legally questionable purposes. I mean if someone posted a question in this forum about something illegal then a moderator would see and remove it, but they could ask the same question to an AI and get an immediate response. That's why the commercial AIs have guard rails. You could try to restrict it with rules but then that becomes a slippery slope of restrictions.

What would be safer I think would either be a simple guide to running an AI locally including some useful map friendly skills to add to the AI, or a Docker image that's ready configured. But you still need a decent machine to run it, AIs are very memory and GPU hungry.