Part 5: AI
19. Check the computer can handle it#
What you'll do: check memory, disk, CPU, and that the fan really spins up under load. Time: 15 minutes.
Step 1: Memory and disk#
Type on: the server
free -h
df -h /
free: look at available on theMem:line. You want at least 3 GB for the 3B model, or 2 GB for the 1.5B model.df: look at Avail. You want at least 5 GB.
Step 2: CPU#
Type on: the server
nproc
grep -o -w -m1 avx2 /proc/cpuinfo
nprocprints how many threads the CPU has (e.g.4).- The second command prints
avx2if the CPU has the feature that makes AI fast. Nothing printed means it will still work, but slowly. Use the small model.
Step 3: Heat test (stay with the computer)#
AI keeps the CPU at 100% for minutes at a time. Check that the cooling copes before you rely on it.
Type on: the server
sudo apt install stress-ng lm-sensors
Open two SSH windows to the server.
In window 1, watch the temperature (it refreshes every 2 seconds):
Type on: the server (window 1)
watch -n 2 sensors
In window 2, load the CPU for 2 minutes:
Type on: the server (window 2)
stress-ng --cpu 2 --timeout 120s
Watch window 1:
| What you see | Meaning |
|---|---|
| Temperature rises, then levels off below ~85 °C | Good |
A fan line (e.g. Exhaust) climbs from 0 to 1,000+ RPM |
The fan works |
| Temperature keeps climbing past 90 °C | Stop now with Ctrl+C in window 2. Clean the vents or improve airflow before continuing |
Press Ctrl+C in window 1 to stop watching.
Fan shows 0 RPM when idle?
That's normal on many laptops: the fan only spins when it's needed. What matters is that it rises during the test.
Done when: you know which model size fits, and the temperature stayed below about 85 °C during the test.