It is maybe a genetic defect as well as hereditory, such as two non-force sensitive parents who have the right genetic make up, mix those genes into one (AKA child) and vuala, Force sensitive offspring. This may be rare, but the galaxy would be an enormous space, so try not to think of it in our world sense, the galaxy could produce literally millions of these potential jedi.