Crystal Palace had to be content with a point as lowly but plucky Rotherham, who had goalkeeper Michael Pollitt sent off late on, held out at Selhurst Park.
It looked as if the Millers had broken their duck of 14 away games without a win when Chris Swailes headed them into a 32nd minute lead but Dougie Freedman levelled in the second half with his seventh goal of the season.
The Millers' goal came from their first shot on 32 minutes. Scott Minto's corner was aimed perfectly towards Swailes who stooped low and produced a firm header which nestled neatly into the bottom corner.
And just before the break Darren Byfield headed over when he had all the time and space in the world to double the visitor's lead.
In the second half Danny Butterfield curled a shot from 25 yards out which Pollitt was relieved to see go past the upright and Andy Johnson shot straight at the Millers' custodian after a superb run by Wayne Routledge.
But Byfield missed another good chance. This time he was clean through but arrowed his shot wide of the post.
Rotherham were made to pay immediately as at the other end Tommy Black's cross was missed by Carl Robinson leaving Freedman unmarked to tap home the simplest of goals.
Palace were firmly in control with Routledge's pace causing problems while Butterfield was inspirational in midfield.
Four minutes from the end Pollitt was sent off in most unfortunate circumstances. He left his goal to gather a loose ball and the momentum took him a whisker outside his area.
Referee Peter Walter blew the dust off his red card to record his first dismissal of the season to order off the unhappy keeper.
In the frantic finish Darren Powell had a header cleared off the line by Swailes and the same player was unlucky once again when another header hit the foot of the post.