I have made a couple of boxes for Rise of Empires for the coins, much like these.

They are made to print on A4 and go quite close to the edge of the paper, so they may not fit on B4 paper. In that case you may have to reduce their size a bit to use them.