Millers chief ponders changes
Evans was disappointed with the match officials, claiming that few 50-50 decisions went Rotherham's way and that Hylton's third goal was offside.
But he said that should not camouflage the team's weaknesses on the day and he promised changes for Saturday's home league clash with Barnet.
He said: "We should have been capable of going to Aldershot and winning. To get success in the FA Cup, you need your 11 to have heart, spirit, tenacity and steel and one or two didn't have that and we're out and it's no surprise.
"It was a long journey home and one or two will pay the price in terms of selection. We'll certainly have a different team out there (on Saturday) and different personnel."
At least one change is guaranteed due to Kari Arnason's late dismissal and one-match suspension for picking up two yellow cards. Man of the match Hylton was also red-carded late on.
Evans added: "We dominated the second half. We got a penalty and then hit the post when we should have scored. If we had done then we might have still been in the cup because at that stage we were so dominant but we're taking nothing away from Aldershot and wish them every success."