Quick question about Type-C USB connectors- a switchless one takes up 4 ports?

If flipping the type-c connector causes it to appear on a different port, does it mean I have to use 4 ports to support a single connector? ie. SS side A, HS side A, SS side B, HS side B. That would really use up available ports quickly!