Mohammed Shami was born on 3 September 1990 and grew up in the village of Sahaspur in Amroha district, Uttar Pradesh. His father, Tauseef Ali, is a farmer who was himself a fast bowler in his youth. Shami is one of five children; his father and brothers all played cricket. His younger brother Mohammed Kaif has played for Bengal.
At 15, Shami's father took him to coach Badruddin Siddique in Moradabad, who trained him for trials. In 2005 he moved to Kolkata to improve his chances of selection. He played club cricket for Dalhousie AC and Town Club, and later for Mohun Bagan. Sourav Ganguly recommended him to the Bengal selectors, and he made his first-class debut for Bengal in 2010.