I recently learned about Google privacy settings, and turned most of mine off. There is one kink to this which I do not understand. When I go to use the maps in Android Auto, I cannot access any of my saved addressed. I saved these intentionally, they are not just past addressed. Oddly enough, if I recently searched for a place in the car, it will be in my search history in Android Auto. If I put the saved address in, it will find it. If I type in my own address, it finds it, then says that it's my saved location "Hey, you have that saved as "home!"". If I type in "home", it goes "huh?"
Which Google setting do I need to enable to make that work, and why is that a privacy setting?