If a rollup operator withdrew their stake, they would simply no longer be able to advance the state of the rollup on L1. If no one advanced the state on L1, then no one can withdraw. However, the idea is that for big rollups, multiple parties will stake and independently validate the rollup. For example, imagine a big MMO game operated as a rollup. Once they reach a certain size, guilds might want to pool money to operate their own rollup validator, keeping everyone else honest, including the game devs. This all holds in principle for other rollups, but in practice, many Ethereum rollups use a permissioned set of validators. Tezos SORU rollups are permissionless - anyone who can raise 10K xtz can protect the rollup.
d4hines answer