The short answer to your question is no you can't - you need to change it.
You generally don't use negative adverbs in questions. Therefore:
Do you ever (see John)?
Do you (see John)? - do not use seldom
If you use seldom, never, rarely etc. you are narrowing the question and limiting the possible responses. In very colloquial English it is possible to use them.
Here's an example of where you might use "never" in the question.
Have you never seen Avatar? It's a fantastic film. Here the speaker is expressing surprise that the other person has never seen the film.
Hope this helps
Student or Learner