Liberals are concerned Sunday's antifa-led violence will do their cause more harm than good.