A stenographic record or sound tape record shall be taken in each appeal. It is not necessary to transcribe the record unless so ordered by the Chairman or the Board. Any party may order a transcript at the expense of that party, and any party taking an appeal to the courts shall order and obtain a transcript at the expense of the party so appealing. The Board may require a party granted a rehearing to order and obtain a transcript at the expense of that party. Whenever a transcript is made, a copy shall be deposited with the secretary of the Board.