Many smaller traders deal with the general public and not businesses. So being VAT registered is an extra cost basically and can make you uncompetitive as the end user can not claim the VAT back.
There is a big discussion
here which answers all your questions.