Why movie extras silently mouth nonsense

You might think a crowded restaurant scene would be deafening, but it is actually quieter than a library. Any genuine talking from the background would completely ruin the primary dialogue recording. Therefore, dozens of adults are paid to sit in the background aggressively mouthing absolute nonsense at each other like trapped goldfish.