Men say relying on a partner financially feels worse than rejection.