Babulal Gaur the home minister responsible for law and order in the BJP-run central state of Madhya Pradesh said: 'This is a social crime which depends on men and women. Sometimes it's right, sometimes it's wrong.'
He added: 'Until there's a complaint, nothing can happen.'
In the recent election, Mulayam criticised legal changes that foresee the death penalty for gang rape, saying: 'Boys commit mistakes: Will they be hanged for rape?'
The BJP dismissed Gaur's comments as an expression of his personal views, and not the party's.
The father and uncle of one of the victims said they tried to report the crime to local police but had been turned away.
Three men have been arrested over the killings. Two policemen were held on suspicion of trying to cover up the crime.
Although a rape is reported in India every 21 minutes on average, law enforcement failures mean that such crimes - a symptom of pervasive sexual and caste oppression - are often not reported or properly investigated, human rights groups say.
More sex crimes have come to light in recent days.
A woman in a nearby district of Uttar Pradesh was gang-raped, forced to drink acid and strangled to death. Another was shot dead in northeast India while resisting attackers, media reports said.
U.N. Secretary General Ban Ki-moon has said he was 'especially appalled' by the rape and murder of the two girls.
'We say no to the dismissive, destructive attitude of, 'Boys will be boys',' he said in a statement this week that made clear his contempt for the language used by Mulayam Singh Yadav.
Read more: http://www.dailymail.co.uk/news/article-2650553/Rape-Sometimes-RIGHT-Indian-state-minister-says-offence-crime-woman-reports-police-days-murderous-gang-rape-two-sisters.html#ixzz33rR8ieU1
Follow us: @MailOnline on Twitter | DailyMail on Facebook