The Secretary of State, after having given bond as required by section 52:16-1 of this Title, shall take and subscribe the following oath before the Chief Justice or any associate justice of the Supreme Court or any judge of the Superior Court:
"I, A. B., do solemnly swear that I will well and truly, faithfully, impartially and justly execute the office of Secretary of State of New Jersey, of the same, agreeably to law, according to the best of my skill and understanding."
Said oath, so subscribed, shall be delivered by the justice or judge administering the same to the State Treasurer who shall keep it among the public papers of his office.