Sperm count is an essential factor in male fertility and successful conception. This situation is medically known as oligospermia. There are various factors which can affect sperm count. Lifestyle changes, maintaining a healthy weight, yoga and avoiding harmful habits can improve this.