The vacuum brake is not supposed to "hold" vacuum. It is activated to varying degrees by varying vacuum. As the vacuum decreases it is suppose to drop down onto the timing advance disk to "brake" it and retard vacuum. As the vacuum increases it lifts the brake off of the disk to let the mechanical timing advance work to advance the timing.
Here is how the vacuum advance brake is adjusted: