The Eagles are now light in attack after James Vaughan's three-month loan spell came to an end following Saturday's goalless draw against Hull.
Andrew has made three appearances for the Lions so far but was an unused substitute in the 1-1 draw at Swansea on Friday night.
"He has had a couple of games for Millwall and it will be an option to bring him back," said Burley.
Source: PA
Source: PA