The rule is about whether an adjective is gradable, whether it has different levels. For instance, difficult can have different levels- something can be quite/very/incredibly difficult. However, speechless is not gradable- you can either speak or not, so very speechless does't make much sense.
(These are not absolute rules and you will find examples where non-gradable adjectives are modified by very, etc.)






