Scott Patterson has given all that he can give.

The Sullivan’s Crossing star addressed his departure after playing Harry “Sully” Sullivan in the romantic drama for three seasons, stating that fans of the show and the Robyn Carr novels it was adapted from “deserve to know the truth.”

“The creative differences were becoming untenable and I just sadly realized that the show was not something that I could agree to continue,” Patterson wrote in a March 5 Instagram post. “It’s unfortunate that it is now being implied that they moved on from me/Sully when the fact is the complete opposite.”

Sharing that he has “nothing but fondness” for his role, the 67-year-old continued, “I really enjoyed Sully and fought for his voice and his character. The richness and depth of Sully, whom the fans of the books all know and love, is so multi-layered and interesting.”

“The fans deserved better than to think the embodiment of this character, me, would just disrespect not only the show, but them,” added Patterson, who previously starred as Luke Danes in Gilmore Girls. “In the end, we’re all fans of these characters and stories, and I’ll always support and defend the truth.”