Not impossible. You just need to be a bit cocky.

And start shutting them down when they start switching to English on you -- by switching seamlessly back to your hobbled Swedish, no matter how bad it is.