Inference on smcleod.net https://smcleod.net/tags/inference/ Recent content in Inference on smcleod.net smcleod.net https://smcleod.net/og-card.jpg https://smcleod.net/og-card.jpg Hugo -- 0.166.0 en-GB Fri, 09 Oct 2026 08:57:07 +1100 LLM Sampling Parameters Guide https://smcleod.net/2025/04/llm-sampling-parameters-guide/ Fri, 25 Apr 2025 01:10:00 +1000 https://smcleod.net/2025/04/llm-sampling-parameters-guide/ A practical guide to LLM sampling parameters for Ollama, llama.cpp, and MLX LLM Parameter Playground https://smcleod.net/2024/07/llm-parameter-playground/ Sat, 20 Jul 2024 01:00:10 +0000 https://smcleod.net/2024/07/llm-parameter-playground/ A web app to explore the effects of different inference parameters on LLMs.