Thanks for yours comments.
The problem is probably less visible with the X-3 35i sport. My car is the 2.8 without any sport adjustment for the suspension. I experience this instability at almost any speed in windy conditions! The four cylinders is lighter and really leave a lot of empty space in the front of the car. I think they didn't make the necessary adjustments for that. Again...not what you expect from a BMW.