So you have only got a little bit of data... inside the 100s of images. Well, I had that problem too... here's how I've managed to work around it.

  1. I duplicated the images that I wanted my GANs to reproduce. This increases the likelihood that your GANs converge towards generating those images (but that's kind of the point anyway.)

  2. I used DiffAugment (, specifically the transform & cutout policies.

  3. Use the Pytorch torchvision image transforms liberally. I've found that randomly applying greyscale, and horizontal flips work well. I'm sure that colour jitter is also good, but it doesn't work in my use case(s).

Covers: implementation of Limited Datasets
Estimated time needed to finish: 20 minutes
Questions this item addresses:
  • What happens when I don't have enough data?
0 comment

Quick Tips To Tune Your Gans

Total time needed: ~20 minutes
Help you get started in developing and tuning GANs which generate high-resolution artwork
Potential Use Cases
image generation of high-resolution artwork
Who is This For ?
INTERMEDIATEPython developers with some experience with Deep Neural Nets and want to try their hands at generating artwork
Click on each of the following annotated items to see details.
WRITEUP 1. GAN - Ways to improve GAN performance
  • What are the common ways to tune GANs?
10 minutes
WRITEUP 2. A couple of good ways to deal with limited datasets....
  • What happens when I don't have enough data?
20 minutes
REPO 3. Use DeepSpeed
  • What are the ways that I can parallelize and speed up my GANs' training?
10 minutes
WRITEUP 4. Use Dilations on your Discriminator to increase the receptive field size of your convolutional filters.
  • What does increasing the dilation of your convolutional filters do?
10 minutes

Concepts Covered

0 comment