I have GPU with 4 GB memory.
Which options should I use to train my model?
I got this error after few hours of training:
RuntimeError: CUDA out of memory. Tried to allocate 734.00 MiB (GPU 0; 3.95 GiB total capacity; 2.21GiB already allocated; 317.06 MiB free; 3.00 GiB reserved in total by PyTorch)
It worked well despite this errors for a while, but unfortunately stops.
I know that I have to play with batchsize and accumsize, but how?