Did Brandi Glanville's rumors of an affair with Denise Richards lead to her dramatic season 9 exit? Denise claims it was due to her family, but fans are still not sure.