In the previous sections, we discussed the importance of your computer's hardware components like the Central Processing Unit (CPU), Random Access Memory (RAM), and Graphics Processing Unit (GPU) with its dedicated Video RAM (VRAM). These components significantly affect how well and how quickly you can run Large Language Models locally. Now, let's find out the specific details of your system. Knowing your hardware specifications is the first practical step towards understanding what kinds of models your computer can handle.
Fortunately, you don't need specialized tools to find this information. Your operating system has built-in utilities that provide these details. Here’s how to check your system specifications on Windows, macOS, and Linux.
Windows provides several ways to view your system hardware. Here are two common methods:
1. Using System Information:
This tool gives a comprehensive overview of your hardware and software.
Windows key + R
to open the Run dialog.msinfo32
and press Enter.Components
> Display
in the left-hand pane. Look for:
2. Using Task Manager:
Task Manager provides a quick, real-time view of your hardware usage and specifications.
Ctrl + Shift + Esc
.Finding hardware details on macOS is straightforward using the "About This Mac" utility.
Hardware
> Graphics/Displays
in the left-hand sidebar.Linux offers flexibility, meaning the exact steps can vary depending on your distribution (like Ubuntu, Fedora, Mint) and desktop environment (like GNOME, KDE, XFCE). However, the command line provides universal methods.
1. Using the Terminal (Command Line):
Open your terminal application.
lscpu | grep "Model name"
(Often the clearest output)cat /proc/cpuinfo | grep "model name" | uniq
These commands will output your processor's model name.free -h
Look for the total
value in the Mem:
row. The -h
flag makes the output human-readable (e.g., 15G
for 16 Gigabytes, accounting for system representation).lspci | grep -i vga
lspci | grep -i nvidia
or lspci | grep -i amd
This command lists your graphics controller(s).nvidia-smi
provides detailed information, including the total VRAM (Memory Usage
section often shows used/total).radeontop
(for AMD, may need installation) or by inspecting system logs (dmesg | grep -i vram
) or specific graphics utility output. Identifying VRAM for non-NVIDIA cards via a single universal command can sometimes be tricky. Checking the output of lspci -v
for your VGA device might also provide memory size details under "prefetchable memory".2. Using GUI System Monitoring Tools:
Most desktop environments come with a graphical system monitor.
Once you have gathered information about your CPU, RAM, and GPU/VRAM, you'll be better equipped to understand the performance you can expect when running different local LLMs and to choose appropriate models and tools in the upcoming chapters. Keep these specifications handy as we proceed.
© 2025 ApX Machine Learning