Its not clear what specifically you are referring to as a problem. Do you have recycle plugin windows disabled?
If so its normal for windows to appear pinned when you open them. The pin icon means that the window will stay when you open another another plugin window. Unpinning and closing won't change that behavior since unpinning doesn't persist once you close the window.
Here is the help for
plugin window recycling