What buttons do you mean? The ones that trigger the overlay or the close button? You can totally change both.
The first ones you can change in absolutely any way you like since (as can be seen in one of the demos) you can also programmatically trigger overlays and therefor any javascript can trigger an overlay.
The latter button can be changed by modifying the background-image of the .close element of your overlay element.