The attorney in any action or proceeding may be changed at any time before judgment or after final determination, as follows:
A. upon his own consent filed with the clerk or entered upon the minutes;
B. upon the order of the court or the judge thereof, upon application of the client after notice to the attorney. And when such change is made as provided in this section written notice of the change and of the substitution of a new attorney must be given to the adverse party; until such notice he must recognize the former attorney.