You said "A stereocenter means that by swapping the position of two groups, you would get a stereoisomer."
If we flip the C=C bond to make it from trans to cis, the two products are not mirror images, which is what stereoisomers are. These cis and trans molecules are diastereomers, which are not stereoisomers. Any carbon in an alkene bond cannot be a stereocenter.