Couple of things going on here.
#1 The yellow you see was likely Kapton tape (a very high temperature tape) used during assembly and wave soldering of the typical PCB to prevent the solder from sticking and or shorting connectors and places the solder should not flow into or coat.
https://www.youtube.com/watch?v=lvh7G8f0jOU
It would seem to me from that picture you are missing the security screws/standoffs? Those at one point in time were common parts- something Radioshack or other electronics stores would have.
Keyword search at MTH parts "TIU" https://www.mthpartsandsales.com/shop/search/results
"I was considering installing plastic dowel or screw but am concerned about creating a short. Is it safe to do this or should I consider a different option?"
I'm slightly confused by this, and unsure if you meant somehow replacing the rivets holding the black plastic connector outer shell (not the contacts) ?
These are replacement snap in style connectors if the connector is really damaged. Snap meaning you unsolder the old connector, remove the existing rivets, insert this style snap in and the clips hold it before soldering, and then solder the connections. Unsure if the rivet holes have through plated copper to solder to as my rivets completely block any view of the PCB hole. Found on the A site "PC Accessories - Connectors Pro DB9 Female Right Angle PCB Mount Connector, 90 Degree D-Sub"