Freedman, 36, is charged with guiding the Eagles out of the bottom three and preserving the struggling London club's npower Championship status.
But if he needed a reminder of the challenge ahead then he received just that in his first match in charge since being promoted from caretaker boss on Tuesday, as Darren Pratley's 43rd-minute opener and a second-half penalty brace from Scott Sinclair handed the hosts a deserved victory.
"I know how hard this job will be," said Freedman. "We are in the bottom three and have been there for most of the season. It is the most difficult challenge of my life."
Speaking about the defeat, Palace`s 11th from 14 away games in the league this term, Freedman added: "This was always going to be a difficult game considering the way Swansea pass the ball and where they are in the table
"We played with a lot of confidence and it was a disciplined performance. I'm a very black and white person and straight down the line and, for large parts, the players stuck to the game plan. I've no complaints about the penalties but, overall, I'm pleased with what the players took on board."