About a million or so joined the Nazis after the invasion.Not quite. Most people would surrender and join the winning side. Lot's of soviets did that.
Probably disaffected minorities and anti communists.
It appears that the core of the population didn't surrender and Join the winning side.