Welcome to the AI category of my blog, where we delve into the rapidly evolving world of Artificial Intelligence. Here, I explore the latest AI trends, breakthroughs, and applications shaping our future. Whether you’re a tech enthusiast, a seasoned developer, or simply curious about AI, our posts aim to enlighten and inspire.
LLM Inference Sizing and Performance Guidance When planning to deploy a chatbot or simple Retrieval-Augmentation-Generation (RAG) pipeline on VMware Private AI Foundation with NVIDIA (PAIF-N) [1], you may…
Install llama.cpp, get a GGUF model from Hugging Face and run Llama 2 or newer models locally on CPU or NVIDIA GPU, with the current 2026 commands.
Tesla P40 specs (24 GB GDDR5, 250 W, 10.5-inch dual slot, compute 6.1), cooling and ESXi passthrough setup, llama.cpp benchmarks, and CUDA 13 limits.
Convert a Dell H200A to an H200I so it fits the R610/R710 dedicated storage slot and frees a PCIe slot, e.g. for an NVIDIA Tesla P40.
CUDA on WSL2: Windows NVIDIA driver only, cuda-toolkit from the WSL-Ubuntu repo (13.3.1) or Ubuntu repo (13.4), nvidia-smi checks and fixes.
What Intel OpenVINO brings to VMware Private AI with Intel, illustrated with a face-recognition thesis accelerated on the Neural Compute Stick 2.