Yes, as you yourself point out, there are career paths that lead to the rank of admiral that don't involve being the captain of a ship at any point.
I would point out that there are enough of those career paths for them to be considered "common."
You're right, I was thinking of the majority of USN flag officers being line officers, which they are, but there are enough of the others to fairly use the word "common."