What you describe was how it used to be.
The Great Kills dump on Staten Island was one of the big polluters.
They had to make major improvements to stay open.
Install a trash/security fence
Trash barrier at the water’s edge
Trash barges must be covered
Dumped trash must be covered daily
All water runoff and seepage is processed before being released into the Author Kill.
No medical waste can enter the dump
The only remaining issue is from the storms and wind direction. It pushes any debris away from Staten Island towards NJ, plus the trash left behind by the slobs that visit the shore line.
I’ve worked, boated, dove, swam, fished, crabbed and eaten what I caught from the bay and have never had any adverse effects on me. If you ask my wife she will tell you different. Lol
Enjoy the water!