If you want a one-stop tool to customize the Windows 11 Start menu and Taskbar, you should take a serious look at Windhawk.
In other Microsoft programs ... To remove a button from your QAT, right-click the relevant icon, and click "Remove From Quick ...