The partialCached template function can dramatically boost the Hugo building times. After playing around this website went from ~10 seconds to ~3 seconds, wow! Still lots of space for improvement.