It .....that (cleft clause)

[spoon]

Hi there?

I have a question about cleft clause.

I've known that 'who', 'which', and 'whose' can respectively replace 'that' according to the focus parts. But how about when or where?

When the focus part is related to 'time' or 'place', can 'when' or 'where' substitute 'that'?

ex) It was yesterday when I went to Mary's house.

Hoping for your help!
Spoon

[Tdol]

'When' works, but 'where' doesn't there.

[spoon]

'When' works, but 'where' doesn't there.

Thank you!
Spoon