Well, one spot had what looked like bathtub caulk under the brown exterior caulk.

I'm also moving furniture to get to the windows, cleaning behind and under the furniture, cutting dowels to hold the upper portion of the sash windows up (I'm not going to try to re-hang the old weights), vacuuming-and scraping-and vacuuming-and-painting the inner sills, messing with storm windows where needed, and other such stuff. I'll have to go back with the temporary winterizing stuff in places where the storms don't fit right and probably shrinkwrap a couple of the screens where one of the storm windows is missing too. Fun fun.