very gently round up when you let go of the tiller
If you are constantly hauling on the tiller to prevent her rounding up, or leaning against the tiller to prevent her high-tailing off downwind, get an expert to adjust your rig or your rudder size or position. A light tiller grip should keep the boat going straight, then as a useful safety feature, when you let go, she gently rounds up into the wind