You can delete the Taskbar search history from Windows Settings ... Quick Access is a placeholder where you can pin the most recently used files and folders for easy access.

If you want to delete this Recent colors history in Windows 11/10 ... to create a System Restore point and backup Registry files to be on the safe side. You need to delete these values.