As I understand it, for parallel, as you said, the voltage must be the same, or you will be breaking Kirchoff's loop law.
For series, voltages basically sum. One point that can be tricky is that direction of voltage sources must be considered. If a battery is reversed in direction, its voltage will subtract rather than add.