Interesting, I'm using Firefox too (but on Mac, that may be the difference).
Yes, I'm certain it's removed from all of my sidebar areas (I checked again under Appearance > Widgets just now to be sure). I also checked the document, page, content, and comment headers and footers, and they have no widgets in them, search or otherwise.