N.Y. Jud. Law § 124

§ 124. Suspension and removal of official referees. Any official\nreferee continued in office and serving under the provisions of this\narticle, as amended, except an official referee of the court of appeals,\nmay be suspended or removed by the justices of the appellate division in\nthe department in which the appointment was made.\n