Van Gaal admits that his side got "lucky" with the manner in which they won the game, having seen a one-goal lead slip away in the second half, but believes that Taylor almost cost his side a famous win.
"In the second half, I think the referee changed the match," he is quoted as saying by Sky Sports News. "I think the penalty was OK, I don't argue with that.
"I argue with all the 50-50 decisions went against us, and when you do that in a 10 or 15-minute period, you have a big influence on the game. After it went 1-1, we showed our mental spirit.
"It was unbelievable. We were in the game, out of the game, and then we were in the game. We are lucky that we scored in the last minute, but we deserved to win. Everton also created a lot of chances."