I have to agree with Ghosty sock girl
Once a court order is in place you are locked in. From your side of the story he truly sounds incompetent.
Great that he is fun, if you can facilitate contact and be there that sounds like the way to go.
Keep a diary of how contacts go - very important
Dave The Turning Cowboy
turning wood into art