"It was kind of like a whirlwind relationship. It went into the public way sooner than we ever would have wanted it to," Cartwright said on her podcast Cartwright first shared with PEOPLE that she was ...