So, I got in touch with some friends and scientists I studied with at the University of Cape Town. In short, they confirmed something many professionals already suspected: the main culprit for sexual impotence and a small penis is the buildup of toxins in the testicles. The problem starts in the early years of life. We get essential vaccines and medicines, but they leave chemical residues behind.