N.Y. General Business Law § 1701: Prohibitions and requirements

§ 1701. Prohibitions and requirements. It shall be unlawful for any

operator to operate for or provide an AI companion to a user unless such

AI companion contains a protocol to take reasonable efforts for

detecting and addressing suicidal ideation or expressions of self-harm

expressed by a user to the AI companion, that includes but is not

limited to, detection of user expressions of suicidal ideation or

self-harm, and a notification to the user that refers them to crisis

service providers such as the 9-8-8 suicide prevention and behavioral

health crisis hotline under section 36.03 of the mental hygiene law, a

crisis text line, or other appropriate crisis services upon detection of

such user's expressions of suicidal ideation or self-harm.