The palace was later destroyed, and philanthropist Tin Trai built Ngoc Son Pagoda on the site. In 1843, under King Thieu Tri, a charitable group rebuilt the temple, and renamed it Ngoc Son Temple.