It depends. As mentioned above. 3-rail standards for flangeways and frogs are grosser than 2-rail, so derailments may occur. On the other hand with your curves, if you have decent turnouts, you should have no problems.
As to couplers, Atlas O cars and Weaver cars come with Kadee compatible couplers. Older Atlas couplers will couple fine, but are hard to uncouple. The new ones are Kadde knockoffs.
Most all 2 rail cars made recently that come without couplers come with pads drilled and tapped to mount Kadees. And many come with mounting screws.
If it is a car you like give it a try. Worst case, you have to replace the wheel sets.