Concerns are being raised over 'charity collectors' intimidating people in Horsham town centre into handing over money.