I encountered that particular question years ago on a TV segment which featured interpreters for the blind, whose job is it to describe to a blind person what's happening in a performance on a stage, eg, a fashion show. And the issue came up of how to describe the colors to someone who had never had vision and I seem to recall that the approach taken was something like you suggested.
But the question just seemed to fit perfectly with the problem of describing something to someone who had never experienced anything like it, like describing dancing to a non-dancer.