There are two types:

  1. Stop growing the trees
  2. Grow the full tree, then chop.

Stop growing the trees

This can be done by setting up some threshold on the Information Gain,

Grow then chop

  • We can prune based on validation
  • MDL (Minimum Description Length) principle