The harm he did outweighs the good
By Austen Scoggins
The Indian Removal Act
Andrew Jackson during his presidency forcibly moved massive amounts of Native Americans in the "Indian Removal Act," which forced Native Americans to move west or be killed, and when they resisted, the army marched them into Oklahoma territory, during the march, thousands of Natives died.
The Destruction of the Second Bank of the United States.
Andrew Jackson, while not opposed to Central banking, believed that the Second Bank of the United States was corrupt and sought to bring its closure, which he did and had the support of most people. But Jackson took a risk of destabilizing the economy and ruining businesses by this move, which a President shouldn't do unless necessary.
The Spoils System
The Spoils System means that you give political jobs to your supporters, regardless if they're qualified for the job or not. The term 'Spoils System' was first used by New York Senator William L. Marcy, in response to Jackson's 1828 Presidential success, and Jackson used the system to boost his popularity and give him an advantage over all his political rivals.