I made some changes to the camera and the physics of the dice falling, and also made the front of the tower see-through. I also changed it so you go straight to score select after your second reroll. I haven't updated the game on itch, but I made a quick video to show those changes off if you don't mind taking a look and telling me what you think: https://twitter.com/Shiiro_10psi/status/1553526713858117632
I did the camera and physics things first because those are the most portable parts. If I do any more updates to this game however I will take some more of your suggestions. I think for the reroll selection I would change it so that the selected dice move to a separated part of the tray off to the side, and then stay there while the unselected dice are rerolled. That way it would be much clearer which dice will be rerolled.
The collision boxes not moving was an effect of me setting time scale to 0 to stop the dice from falling back down when they are selected and move up. I changed it so that the dice's rigidbody ignores gravity and locks all constraints instead, so the collision moves with the die now.
I do agree that the dice sounds aren't perfect, so I will probably try to record some of my own to get some more variety.