Today I learned

Fastai:

  1. Dense blocks use more memory but are a good choice for lower resolution images.
  2. In CNNs, you usually double the number of channels whenever you do stride 2. Otherwise, with stride 1, you keep the number of channels the same. (I say usually because I don’t know if this is a universal recommendation.)