Depends on what your sump is made of and how big the sump is. If the sump is made of glass, then it will be difficult to bond the plastic to the glass. If it is acrylic, plexiglas might work but it will be weak so size of the sump will be an issue. If it is only going to hold 10-15 gallons, you might be able to do it. If it were me, I wouldn't trust it. I know a bunch of people use it but it could break loose. For your application, baffles, not much to worry about but others create entire sumps out of the stuff.
The other option is to just go to HD and have them cut the baffles for you out of glass and then you only need to silicone the glass in place. HD can cut glass up to 1/64 of an inch so measure and get a close fit.
If it is acrylic, just find a plastic's shop and ask them for a couple of cast acrylic pieces cut to size.
Scott