Ok. I looked up the tutorial where I discovered them and remembered that you have to click the show swatch button in color sections that have that row of display buttons with RGB mode, HSV mode, etc. I'm not sure there's an option to turn that button on all the time by default.