If you exclaimed "The house falls down!" you would immediately give away your non-native origins.
I can't think of a condition under which you'd say this without any qualification. Here is possible contrivance. "Each family of the native tribe of the area builds a simple mud hut. This lasts until the floods come, and then the house falls down."