Are your themes up to date?
If you see that button, try giving it a click. What you’re seeing isn’t normal behavior and we don’t have reports of it elsewhere. I’m glad to hear that it isn’t interrupting page performance but it sounds annoying all the same
