Check your driver's seat switch. QSilver7 and Bluebee posted nice pics.
What I do: adjust the SW and driver's seat to the way you want. Then pull Fuse #13 (glovebox). This disables BOTH the SW and driver's seat but I do not care.
In my other cars, I virtually never adjust the SW or driver's seat (I am the only driver).
The SW adjustment motor is very expensive, this is why I do this.
If I ever want to adjust the SW and seat, simply re-insert Fuse #13.
I have pulled Fuse #13 now for a few months and do not miss the SW going up and down during entry and exit from the car!