Hello Ifful,
Of course that ships do turn due to their rudder, even when the engine is stopped. In fact, it was already known before engines were invented...
Now, the waterflow, the wash of the propeller on the rudder increases the speed of the water, and as a consequence the rudder force, in drag and in lift. So, stopping a propeller in front of a rudder decreases the rudder effect, the more the area of the screw shadows the rudder.
If you search the forum, or perhaps look at these extracts (http://books.google.com/books?id=SQ488peU_kgC&pg=PA248&lpg=PA248&dq=ship+rudder+action&source=web&ots=Vj-EBhvW_u&sig=YWDuFgWQRJZ-IRuwX7fPVyOfXEk) of a book, you will have a better idea of the forces involved. Googling "ship rudder action handling manoeuvring" or any other words will give you excellent links describing the rudder action, in so far the ship has rudders.
Good reading,
Luc