I've lived in MD since late 2012 and Baltimore city since 2015. I'm saving/renovating so I can move down to Florida as soon as possible. I've done my best to keep an open mind so here's my thoughts on Baltimore.
Most importantly, do you have children or plan on having them? If the answer is yes, do not live in Baltimore city unless you can afford to live in a wealthy area with good schools. Baltimore city's schools are notoriously bad, and many don't even have A/C or heat so they're closed all the time due to weather. Unless you're in a really nice neighborhood, but for that you can wind up paying $400K for a 9 foot wide row home. If schools are important, I would recommend living in Baltimore county instead of the city. Property taxes are lower, crime is far lower, schools are better.
If you are single or just have a partner, grabbing an apartment in Fell's Point, Hampden, Federal Hill, or Canton would be neat. And by apartment I mean probably a row home. It'll be pricey but those are neighborhoods where you can walk down your street to the corner pub/restaurant. Lots of stuff to do. I work in Fell's Point and my wife and I grab dinner in these neighborhoods often. Hampden is a few miles north and basically hipsterville, but there's lots of neat stuff.
As has been said, Baltimore is a city of neighborhoods. Pay VERY close attention to that. I once lived in an upscale high rise apartment in a nice neighborhood. 3 blocks to the west, you could get robbed or murdered. Baltimore has extremely high crime but most of it is localized to specific areas - pay attention to crime maps and learn the good and bad areas. Also if you park your car in the city, never leave anything visible inside or there's a good chance someone will break a window to grab it.
Baltimore is an excellent city for the arts, live music (especially rock/punk/metal) gastropubs, craft beer, and things of that nature. There's always a ton of neat stuff to do. And it's in a great central location where you can take day trips to DC, Northern VA, Philly, Delaware, all sorts of neat places. Even NYC is a 4 hour drive.
The roads pretty much suck. The nearest autocrossing is in Washington DC. Nearest race track I believe is VIR. Not the best state for motorsports, I would say.
There's positives and negatives to Baltimore. I wouldn't choose settling down here but if it fits your current life situation right, you could have an excellent few years, especially with a good job that paid well.