There are a few instances where you introduce clauses with that and not a wh- relative.
The example you've given is one of those cases.
You use that after all, everything, nothing e.g. All that glitters is not gold.
In defining clauses after superlatives e.g. The worst thing that could happen is ... .
H. Gethin, Grammar in Context
Student or Learner