The terms "elitist" and "elitism" are used per the following definitions:

 Cambridge Dictionary of American English: elitist - adjective = Characteristic of the elite, and esp. not caring about the interests or values of ordinary people.

 Cambridge Advanced Learner's Dictionary: elitism - noun = When things are organized for the benefit of a few people with special interests or abilities.

American Heritage Dictionary: elitism = The belief that certain persons or members of certain classes or groups deserve favored treatment by virtue of their perceived superiority, as in intellect, social status, or financial resources.
The sense of entitlement enjoyed by such a group or class. Control, rule, or domination by such a group or class.

These terms are NOT meant to describe  those who simply pursue their sport in the manner they see fit, so long as they do not try to impose THEIR desires or values on OTHERS.