Time matters. What you typically get from the vaccine are B-cells that know how to make antibodies to fight COVID-19. When they detect the antigen, they start cranking up production so your body is immediately fighting the contagion. Without the vaccine, you don't have the machinery ready so it takes longer for the body to make the required response. Meanwhile the virus is reproducing itself exponentially.