It does not matter if the force is constant or not. Gravity is not constant at planetary scale but still remains conservative. The definition is that for conservative forces the work needed to move an object from point A to point B does not depend on the path taken between A and B.
If you move an object 10 m up, you'll always have to do 10*mg J of work - regardless if you're lifting it straight up, or pushing it up on a frictionless ramp or taking any arbitrary path. That's not true when talking about work done by friction - here, the longer the path is, the more work is being done.
Gravity and electrostatic forces are the typical conservative forces that you'll encounter for MCAT purposes.