James Waite winner sees Newport knock out Portsmouth
Aaron Wildig glanced in a second equaliser for the Welsh side four minutes after the restart before Day prevented a Curtis hat-trick with a fingertip save.
The end-to-end contest turned into more of a chess match in the middle of the second half as both sides introduced experienced defenders to bring some control to their respective back lines.
The tie looked to be heading for a penalty shootout but Waite, who also scored the winner at Luton in the first round, had other ideas.
Introduced in the 71st minute, the 23-year-old midfielder – signed from Welsh Premier League club Penybont in January – conjured up the winner within three minutes.
Teed up by Evans, Waite strode forward with purpose and fired into the bottom corner from 25 yards.
Support our Nation today
For the price of a cup of coffee a month you can help us create an independent, not-for-profit, national news service for the people of Wales, by the people of Wales.