As a NES, but not a teacher, I believe you are almost there, as written.
I would, personally have said something like:
"If I were arranging a moving party, I wouldn't have it at my place. I would rent a cottage somewhere, so that nobody could hear us partying." "Otherwise the police might come over and shut us down."
Hope this helps
PS It's normal to have a "leaving party" at or near your existing address, as people know where to come and/or a "house-warming" party at your new address, to get to know the neighbours - if your neighbours get an invite to the party they are less likely to complain to the police at either end!
There can't be too many people who would rent out their cottage for a rowdy party and risk it getting wrecked for a one night rental fee!
- For Teachers