There's also that one plastic "bolt" around the center that snaps in place...I believe the intent is to support the panel while you put in the other fasteners.It's the clips. Just make sure that they are snapped solidly into place. It's really easy to mistake them being all the way in when the center hasn't actually penetrated fully into the outer piece. To assure full connection, remove the center piece, push the outer piece all the way in, then push the center piece until it is flush. You'll also feel/hear it click.
I bet having the front edge of the panel below the bumper edge, rather than above it, is the source of a lot of these problems as it leaves a front-facing edge for wind, water, debris, etc to snag on. And only putting the rivets through one layer instead of both.
There are also holes near each plastic rivet (blue circle below) that will let you reach in, hold the panel edge against the bumper edge, and feel that the river is through both panels:
