Matt Taylor's salute to Rotherham United match-winner Georgie Kelly
The second-half introduction of Kelly from the bench proved to be pivotal, with the 25-year-old netting the decisive goal just three minutes after coming on.
Following his first victory in his third match as Millers boss, Taylor said: “It’s the most consistent performance we have had since I came in.
“I thought we kept Huddersfield at arm’s length in the second half. The players will get all the praise and rightly so. We are judged on winning games of football, even more so at home.
“We looked a good team for certain parts of the match."
Kelly has yet to start a league fixture since after being plucked from part-time football in Ireland last January but has hit three goals as a sub, including a promotion-clinching one at Gillingham last April.
Taylor said: “I am still learning about Georgie. He seems to be a cult hero in these parts due to last season.
"In terms of the impact with his physicality, he is second to none. His goal was a big moment for us.
“He was in the right place at the right time and he did affect the game with his physicality.
“You could sense the atmosphere changing as he came on. We have got to keep working with him because he’s raw.”
Both sides struck within four minutes of each other before the break.
Rotherham went ahead on 25 minutes as Conor Washington curled a shot into the top corner after being played in by Dan Barlaser.
Huddersfield struck back from a well-worked move which saw Sorba Thomas find Millers old boy Danny Ward, who swept the ball beyond Viktor Johansson.
Kelly put Rotherham back in front on 61 minutes when he forced the ball over the line from close range.
The win lifted the Millers into midtable and left Town second from bottom.
Terriers head coach Mark Fotheringham said: “It was bitterly disappointing to lose two goals like that.
“On another day we put that game to bed early on. We are a team at the bottom of the league but still creating loads of chances. The final ball and killer instinct has got to be there.
“We know we can defend the two goals much better than what we did. I have to take responsibility for it.”