Miss. Code Ann. § 11-53-11

The clerk or justice of the peace shall be liable on his official bond to all persons having any claim to or interest in any money so deposited for costs; and for failure to pay over the same, as required, to the person entitled to it, shall, besides any other penalty provided, be liable to be dealt with for contempt by the court in which the deposit was made. A deposit in the hands of a clerk or justice at the expiration of his term of office shall be delivered to his successor.