8
SO Edge by Pine! Fantastic performance!
SO Edge by Pine! Fantastic performance!
Interesting! How do you use it? Do you connect it to your main PC? How?
Also, what RAM does it use? Does it use the main system RAM?
I think major training should just be done on dedicated servers/on the cloud. That being said it is very helpful to test locally, so in case you are planning on using Nvidia equipped servers just get any somewhat recent consumer Nvidia card and you can always run locally on some sample data and test much more easily.
I second that. Being able to test medium sized models locally can make debugging much easier.
I have a 3070 with 8GB VRAM, which can train e.g. a GPT2 with a batch-size of 1 with full precision.