I was also thinking along the same lines as @janedelila. I would use things like temperature, taste, smell.
Red and orange are hot, vibrant colours.
Pink is more like a sweet lolly.
Some greens and browns have an earthiness to them. So the smell of soil or leaves.