Because the color configuration in most indoor space design is not ideal, in order to meet people’s physiological and psychological needs, indoor color planning based on color image coordinate system is put forward. Design an indoor color configuration system based on RGB-D image. In terms of system hardware, TCS3415 color sensor is used to design color acquisition module, and Kinect equipment is used to design RGB-D image acquisition module. In system software, RGB-D image information extraction function and indoor color configuration function are designed. The experimental results show that: according tor²The distribution table shows that when the significance level is 0.05. When the degree of freedom is 2, r²The critical value of is 5.89. Conclusion: There is no obvious difference between the system in this paper and the color scheme designed by professional designers, which verifies the effectiveness of the system.