Johnson, who joined from Oxford on transfer deadline day for an undisclosed fee, came off the bench to score the third goal in Boro’s 3-0 win at the Macron Stadium.
Fellow deadline-day signing Ryan Shotton is likely to have to wait longer for his debut after being an unused substitute, while Britt Assombalonga, who took his tally to four goals this season at the weekend, will lead the line once again.
Rudy Gestede is out for an unspecified amount of time due to surgery on a thigh injury while Martin Braithwaite is unlikely to feature as he recovers from a hamstring problem.
Josh Onomah, Andre Green and Keinan Davis will all be assessed after they were withdrawn in Saturday’s 0-0 draw with Brentford.
Jack Grealish and Rushian Hepburn-Murphy are out as Villa search for their second league win of the season.