Can the flex of the shaft make that much difference?
Absolutely! Clubs that are too stiff will tend to leave the ball out to the right (for a right handed golfer) and often go shorter distances, while those that are to flexible may increase distance with the downside of lack of control and shots that land left of the target (again for a right handed golfer).