My take on it is this as a strongly left-leaning libertarian:
How sad is it that a country's people are so morally and ethically deficient that a chunk of concrete is feared to cause civil unrest?
I condemn violence, hatred, racism, and classism. I think that part of history is in the past for a reason, but to assume that removing a statue or a flag will stop it (or that not removing them will cause it) does two things in my mind: 1) it gives zero credit to our human ability to overcome - like child safety locks for a 20-year old, and 2) incites the belief that in order to protect our citizens we have to wash away the bad things and infringe upon a 1st amendment right. Basically, in order to protect our civil rights, we're deciding to remove our civil rights.
This is true pretty much across the board these days. We've had guns for two centuries and we've had the second amendment for two centuries. Now that we have a gun violence problem, liberals are looking into how far they can stretch gun legislation without infringing upon the second amendment, while conservatives are pushing back equally claiming that the amendment is carte blanche to own a tank, a few surface-to-air missiles, and 65 Howitzers.
As far as flags and statues are concerned, its what it means to YOU PERSONALLY as far as I'm concerned. If you like the statue of [insert confederate general here] because it looks good in your town, great. If you like the statue because you're a racist, black-killing, muslim-hating, fag-lynching buttwipe, then we have failed as a society, and the solution is not to take away your toys. The solution is a comprehensive and fundamental change in how we operate. (and don't ask me how to do that because its a 45-page essay)
Here is a story that is part of my personal extended family regarding flags and statues. My uncle's cousin (I called him my great uncle) lived in South Carolina. He had a daughter with a black woman in the late 50s. He was 16, she was 15, they weren't married, couldn't get married, and would likely be stoned to death or hanged if the word got out. They put the child up for adoption. Some couple from Massachusetts adopted her and moved to the UK. My great uncle sent along the daughter's snuggle blanket with the adopting parents; a flannel blanket with the confederate flag printed on it. I have not kept up with that relative. I met her once when I was young, but somewhere in the UK there lives a lesbian, adopted, half-black woman who cherishes a confederate flag because of what it represents to HER. She loves it because it is a symbol of her birthplace, and a symbol that her birth parents loved her enough to protect her from the crap that was going on in SC at the time. To her, I imagine that confederate flag symbolizes love, home, and her blood family. It doesn't represent hate, racism, or white supremacy to her.
While this is an extreme example, I don't think that banning a flag or a statue is the solution any more than banning guns is a solution. It is not the correct solution. Its attacking the rights of the majority in a feeble attempt to strike a blow at the minority, and the worst part is, it won't work. Washing away history won't change the opinions of a white supremacist who is already entrenched in his/her beliefs.
I don't see anyone taking away my right to drink a beer because there is a minority of people out there who get behind the wheel of a car drunk and kill someone. I don't see new laws curbing my right to operate a telephone just because there are a few unscrupulous phone scammers out there.
Having traveled so much in my life, I'm privileged to have seen countless other cultures and see what works and what doesn't. Sadly, the US (despite all of our privilege and wealth) is woefully incapable of the education and enlightenment needed for our citizens to function as a democratic society. We are a society of fear and individualism. We, as individuals, (in general) have zero compassion for others because we lack the empathic ability to even comprehend that our actions (though they may suit ourself) have repercussions for everyone else. Conservatives don't want their taxes going to welfare queens, but can't see that the $64 they pay every year supports millions of people like me who couldn't work when I was mentally unstable. Those individuals only care that they want $64 more dollars per year so that they can evict the handful of welfare queens, but since they have never been mentally ill, their answer is "something something bootstraps get a job." The far left wants to ban guns to stop gun violence, not having any empathy for the fact that billions of guns out there DON'T kill innocent people but do provide a good source for people to harvest organic free-range meat without supporting inhumane feedlot farming... something they should LOVE.
Nobody in the US gives a E36 M3 about anyone but themselves in all the places where they should, but they stick their noses in everyone's business where they shouldn't. And the only difference between the liberals and the conservatives is that one side meddles in things because they think they're being selfless while ignoring the impact on the greater good, and the other side meddles because they think they're being beneficial to the greater good, but it ends up just being selfish because they can't imagine why everyone else isn't exactly like them. The net result is they both end up helping one facet of society while hurting everyone else. One side is too much love for the baby seals while ignoring greater issues, and the other side is bootstrap tough-love for anyone who isn't privileged like them. The truth is, we won't need liberals once our society develops to a point where we intrinsically understand that clubbing baby seals is bad, and we won't need conservatives when we understand that amassing wealth at the expense of others isn't necessary or humane. I like to live like I drive: Merge, go with the flow, don't be a vigilante and cause others to hit their brakes and change the traffic pattern. Just drive and don't berkeley with others. As soon as you spike the brakes because someone is tailgating you, you cause an accident and someone dies because you were trying to protect your needless sense of personal bumper space. Yes, that is a metaphor for life. Not everyone cares about bumpers the same as you.
This is all after ample amounts of time in Mainland Europe, Scandinavia, China, and Central America. Every American should go there before formulating these opinions. And I don't mean take a bus tour with a bunch of Westerners with fanny packs and Nikons, I mean experience the cultures with a backpack and a passport.