Whaley House, Old Town San Diego by Riccoboni. The first brick home in San Diego California is an 1856 Greek revival Mansion. According to the Travel Channel's America's Most Haunted, the Thomas Whaley House is believed to be the number one most haunted house in the United States. The mansion also housed the former county courthouse and San Diego's first commercial theater.