Am I rightfully concerned, or just paranoid?

Nothing much you can do now that you are divorced from her. If she is going to be stupid enough to allow some guy she just met move in with her that is her problem. I would talk to a lawyer though and say you are concerned about the welfare of your son and see if there is anything that can be done about the custody arrangement.