PCPartPicker

  • Log In
  • Register

Build

Expandable Computer for Machine Learning and Deep Learning

by thisisjeffchen

7
2 Comments

Details

Date Published

Sept. 8, 2018

Date Built

Sept. 9, 2018

CPU Clock Rate

3.5GHz

GPU Core Clock Rate

1.48GHz

GPU Effective Memory Clock Rate

11GHz

Description

Built a computer for my Deep Learning projects at Stanford University because AWS and Google Cloud was too expensive. www.thisisjeffchen.com.

If you're a grad student working on Machine Learning, ML enthusiast, startup guy in ML, or a ML weekender, you will need GPU resources to train your models for experiments. I frequently run 12 experiments across 4 GPUs, which is makes model development go 12x more quickly. (Start exps, go to sleep, wake up and check results, repeat).

But it's expensive to get a quad GPU machine (each GPU is $700+) and if you don't know how much GPU power you'll need, the best idea is build a computer with 1 GPU and more GPUs as you go along.

12 Core CPU is chosen because I've run 4 experiments / GPU before, so that's 4 threads or 2 cores per GPU. The extra 4 cores are left over so the machine can do other stuff while running experiments.

M.2 SSD is way faster 3.4GB/sec than SATA3 600MB/sec.

1080 Ti's markup over 1070 Ti is worth it since the extra speed and 3GB comes in very handy and can help you go much faster in training (larger batch sizes, more CUDA cores).

DDR4 3000 Quad channel memory chosen as Threadripper has a big performance boost when in quad channel configuration.

1600W P2 power supply chosen for noise considerations and ability to handle 4 GPUs. (G2 is very loud).

S24 cooler chosen for noise considerations and aesthetics (Air cooled options are so ugly and block too much of the motherboard).

[Note: photos show 2 GPUs, I added the second one later, which is not reflected in the parts list. It's also a 1080 Ti Founder's Edition]

Comments Sorted by:

johncolby 2 points 14 days ago

Great setup, thanks for sharing. Did you know that you can apply for academic GPU grants directly from NVIDIA? The approval rate is quite high. Good luck with your projects!

thisisjeffchen submitter 1 Build 1 point 1 day ago

Good to know, thanks!