You guys are probably onto the root causes of the poor performance. The port looks like it was cut with the centerpoint on the bottom rather than "x" dimension below.
Mrchet check the 2.6" dimension and see if it is not 3.5" instead. If this is wrong you should be able to set your baffle about 2.6" from the bottom and then use a Dremel or jigsaw to carefully "widen" the port. This I think should help with the low end freq while moving the baffle back up to a more "normal" position should bring back the "punch" you are now missing.

Now I tell you after you've already got the baffle sealed!
One other thing I did was use some weatherstripping for a gasget on the top. Even with a very snug fit mine still leaked without a gasket. Any leakage will cause cancellation and distortion.
Good Luck