tough row to hoe

Also, hard row to hoe. A difficult course, hard work to accomplish, as in He knew he’d have a tough row to hoe by running against this popular incumbent. [First half of 1800s]