← All topics

Explore local ai

Related products and practices, with creator experiences across different uses.

With use and recommendations from

Mac Mini

Product

17 creators

Remote Codex machines for running code

"Then I set up the stack of Mac minis as remote Codex machines to run all my code on."

Claire Vo

More source quotes

Running specialist Dots agents as provisioned employee-like machines inside OpenAI

"We have them running on Mac Mini. We provision them exactly like employees — we mint a new little identity and then it's got IAM and the roles. We give them a very premium machine as well because the model is incredibly capable under the hood."

Tibo Sottiaux

Running Codex and other AI agents 24/7, remotely controllable from phone or MacBook Pro while traveling

"The Mac Mini setups remain supreme. I just bought a Mac Mini. In fact, I just bought another Mac Mini. I want to have access to Codex wherever I go. I want one instance of Codex running 24/7 and I'm going to be setting that up."

Riley Brown

View all product sources →

Mac Studio

Product

6 creators

Running open-source AI models locally

"The AI running on your Mac Studio with 256 gigs of RAM, which cost $12,000, which I just bought. It's a little too expensive right now."

This Week in Startups

More source quotes

Running local open source AI models to avoid sharing sensitive IP with closed AI providers

"I literally just ordered two Mac Studio M5s. We're going to be running local models and we're moving off Claude for a lot of our sensitive data."

Chamath Palihapitiya

Desktop computing for local AI model processing

"Having that work on the incredible hardware I'm gonna have on my desktop on this $12,000 Mac Studio."

This Week in Startups

View all product sources →

Llama

Software

3 creators

General purpose AI tasks with community support

"Llama by Meta. It's really become very important in the whole open ecosystem. It's got a huge community, a ton of fine tunes. It's got a lot of tutorials that you can go and check out. It runs almost anywhere. When in doubt, there's probably a llama for you..."

Greg Isenberg

More source quotes

Base models for fine-tuning and post-training work

"What we did to initially gain some popularity was like Llama was putting out base models. We fine-tuned those into something that we thought would be like something the market would want."

Dylan Rolnick

"We have a whole bunch of Llama and Mistral running and stuff internally and a bunch of OpenAI."

Mike Cannon Brooks

View all product sources →

go.ai

Product

1 creator

On-premises AI deployment for regulated industries (healthcare, finance) that can't put data into cloud AI services

"Go.ai formerly known as Abacus — they do on-prem and they basically make this go-in-a-box and you order this for your company. You're now compliant if you're healthcare, finance, any of the regulated industries that can't put their data into these services...."

This Week in Startups

More source quotes

Running AI models on-premises in 15 minutes via an Ethernet-connected appliance

"Aboc has changed their name, so I got to give them a proper shout out here. They're now go.ai. You plug it in and AI happens on-prem in 15 minutes. You own it. Look at that gunmetal steel. Looks like an Apple product. Go to go.ai."

This Week in Startups

View all product sources →

LM Studio

Software

1 creator

Running local AI models on a desktop machine without technical friction; first-time local AI experience for non-technical users

"For most people I would just start with LM Studio or Ollama. LM Studio feels like a normal desktop app. You download it, you search for the model, you click download, and then you can just chat with it. My opinion is it's probably one of the most friendly f..."

Greg Isenberg

More source quotes

Running AI models locally for privacy, cost control, latency, and understanding local vs. cloud architecture

"If you could run these models locally with something like Ollama, LM Studio, you start to understand what can happen on your own machine and what needs the cloud and what needs to touch private docs and what should stay behind the wall."

Greg Isenberg

Running local AI models with GUI interface

"LM Studio is the one I'd start non-technical people on because it has a real interface. It's got a model browser. You click and it runs."

Greg Isenberg

View all product sources →

Ollama

Software

1 creator

Running local AI models via command line with a local API that apps can connect to

"Ollama is a little more builder oriented or developer oriented. You install it, you run a command like 'ollama run gemma4' and now you have a model running locally with an API your apps could talk to."

Greg Isenberg

More source quotes

Running AI models locally for privacy, cost control, latency, and understanding local vs. cloud architecture

"If you could run these models locally with something like Ollama, LM Studio, you start to understand what can happen on your own machine and what needs the cloud and what needs to touch private docs and what should stay behind the wall."

Greg Isenberg

Running local AI models via command line

"There's two main names to know, Ollama and LM Studio. Ollama is usually the favorite of a lot of my developer friends because it runs from the command line."

Greg Isenberg

View all product sources →

Quantization

Technique

1 creator

Making large AI models run on consumer laptops

"Quantization is the compression for models. It allows giant models to fit on normal laptops. If you're just getting started, Q4 is just a reasonable place to begin. Q4 is usually easier to run. Q8 keeps more quality but needs more memory. I would start there."

Greg Isenberg

About these recommendations

Products are related to this topic through catalog tags. Quotes describe the creator’s stated use; they are not necessarily recommendations for this topic.

Creator counts cover all uses and all dates. Each person counts once per product family. Paid promotions and passing mentions are excluded. Items are ordered by creator count, then name.

Search all local ai matches →