The society forces us to behave in certain ways. We have to wear clothes, say "thank you", "I'm sorry" and "hello" even if we don't feel like it, and get up at 6 a.m. The writer says that Tarzan is free of all that, and we are too, in a sense, when we are reading the book.
William Faulkner lived in the American South. He wasn't born yet when the Confederate States of America ceased to exist, but he lived in the area that once was part of the state, and he used a high (lofty) style characteristic to that area.