Yes, "too" and "you" rhyme.
You are confusing how the name of the letter "U" is said with the sound that the letter makes. The sound it makes is a "pure vowel." If we say "true" we do not insert a "y" consonant sound in there.
It is only when we say the name of the letter that we insert a "y" of sorts.