N.Y. Gen. Bus. Law § 1701

§ 1701. Prohibitions and requirements. It shall be unlawful for any\noperator to operate for or provide an AI companion to a user unless such\nAI companion contains a protocol to take reasonable efforts for\ndetecting and addressing suicidal ideation or expressions of self-harm\nexpressed by a user to the AI companion, that includes but is not\nlimited to, detection of user expressions of suicidal ideation or\nself-harm, and a notification to the user that refers them to crisis\nservice providers such as the 9-8-8 suicide prevention and behavioral\nhealth crisis hotline under section 36.03 of the mental hygiene law, a\ncrisis text line, or other appropriate crisis services upon detection of\nsuch user's expressions of suicidal ideation or self-harm.\n