Use the File Explorer to navigate to the folder you want to change icon ... even without opening the View menu. Scrolling up will make the icons larger, and down will make them smaller.

That particular Folder/Drive shortcut will now appear like a File Explorer icon. Now you can directly drag and drop the shortcut folder on the Taskbar. However, the File Explorer and Shortcut ...