What stops hair from falling, brushed or torn out of it's tiny follicle?

Hair is very easy to pull out. However, when you brush or pull hair, you are pulling on many strands at once. You are spreading the force over all the individual hairs, and each one is strong enough to resist their own tiny fraction of the total force. If you were to apply the same force to an individual strand, you'd easily remove it.