You do realize that the charging circuit is going to put around 10 VDC on that capacitor, right? I can't tell what you have with all that sticky electrical tape on it, but it looks like one 5V supercap, that's going to croak within minutes!
Here's what I put into supercaps for the 5V board. The two caps are in series giving me a 10V rating.