I'm no chemist but I see no reason to try and remove solvent residue with solvent. And that includes "solvent lite" like goo gone.
I would have first tried a degreasing detergent like Simple Green or formula 409 or the Walmart concentrated versions of them of whose name I can't recall now.
And i'd first try it underneath where it's not visible to see what the affect/effect is.