"A chalk" is incorrect. If used as a countable noun, then you need to say "a piece/stick of chalk". If used as an uncountable noun, then "chalk" is fine.
I wrote the words on the blackboard with a piece of chalk.
I wrote the words on the blackboard with chalk.
We also say:
I wrote the words on the blackboard in chalk.
- For Teachers