Will Castol lost his good standing or even replace by Alvari? I think Castol is better than Alvari even though I am upset about him involve in slavery. 

Not necessarily. You can kill all the slavers and still keep Castol around - it depends on the arguments you make at his "trial," later in the game.