Thanks fox. While everything was connected I tried using the adjustment bolt, and all the way in or all the way out I could not get the actuating arm to grab enough. After I tore everything apart I tried the arm and it seems to engage the shoes and grab the drum just fine. IDK what is up with that part.
I did go ahead and clean the drum and will see if that helps.