The castle was built for a MP who made his fortune in opium trading with the pile then appearing in a reality television show as its owners struggled to keep it from falling down.