Unlock 2-3x faster AI on Apple Silicon! This post explores optimizing models with Ollama and MLX, boosting performance for demanding applications.
From Ollama to MLX: Achieving 2-3x Performance on Apple Silicon
Continue reading
0 Comments
How and why to run Ollama on your own Mac?
The reason is simple: because you can. M1 or later Macs with 16GB of RAM or more are powerful enough to run useful models on device without sending any data…
Continue reading
0 Comments
Securely Expose Your Ollama Server: A macOS Guide with Caddy and Bearer Tokens
Running Ollama locally is straightforward: visit http://localhost:11434 and connect from your Python scripts or other tools. If you plan to expose your machine to the internet, though, you should add basic protections…
Continue reading
0 Comments
🧠 Local RAG Chatbot with Ollama on Mac
Lightweight, private, and customizable retrieval-augmented chatbot running entirely on your Mac. Based on the excellent work by pruthvirajcyn and his Medium article. ⚙️ About This Project This is my personal…
Continue reading
0 Comments