Other ways of saying it are, "It made my knees turn to jelly", "It made me weak in the knees."
I haven't heard it being caused by a sound before. It's usually caused by a shock or heightened emotion.
She said "When he kissed me, my knees turned to jelly"
I felt weak in the knees when I heard about the earthquake near our village.