Stangely enough, I hesitate more when speaking in English than I do in French. Could be because, in day to day life, OH is the only person I speak English to. Even then, he is Welsh and we both sometimes use a Welsh construction even when speaking in English and certainly we use many Welsh words.
For English, it's not just speaking but writing too, stupid hesitations like, well,like writing "stupid" and I think I need an e as in stupide.
With speaking, it's words like responsabilité, qualité, capacité, etc.
Mind you, English isn't my first language either though, when I was in university, I was classed as a "native speaker" (a course that requires the student to be a "native speaker" of English, whatever native speaker means).
As for words like bache (no it's not exactly tarpaulin, is it) or poele or devis, I stopped thinking of these things in English a very long time ago
N'allez pas trop vite - Proust