Keep in mind that this method will likely remove the label on the jar. How to Clean Out a Candle Jar in the Freezer Another foolproof candle wax removal method is freezing, which shrinks the wax.