He brought a bag with first aid equipment, which is where the gloves came from. When treating an injury you wear those gloves to keep things sanitary.

He wasn't there with a gun by himself, either; he was there are part of a militia group, and all of them had guns. As this is America, lots of protestors and counter-protestors bring guns to protests. It doesn't mean they're looking to shoot someone just because they have them.