That's correct. Right-sided heart failure (ex. from MI) is what people call "preload dependent". Acutely, we try to improve the patient's hemodynamic state by increasing cardiac output of the heart. For the right side, we do this by increasing preload, which would increase wall tension, and thus stroke volume (Frank-Starling Curve). If you give nitroglycerin, you dilate the vessels so less blood returns to the heart (increased venous capacitance->more blood distributed to venous system), decreased stroke volume of right heart.
In regards to afterload, afterload is not the problem in the situation you are describing, ie. right sided MI or right heart failure due to right sided MI. But, in the case of right heart failure due to chronic advanced pulmonary disease (quite common), afterload reduction is an important factor of treatment because increased afterload from increased pulmonary resistance is the primary cause of the heart failure. As you might expect, you use care at achieving a balance between dilating the pulmonic vessels with dilating systemic vessels.
Hope this helps!