Agreed, it's the wad. (cup that holds the shot inside the hull) If you were watching someone else shoot, you'd probably see one fly out with every shot.
Welcome to shotgunning, it's an awfully nice place to be.
I have the least amount of practical use for a shotgun..yet they tend to be what I'm drawn to most. Go figure.