The Panthers rallied from behind three times over the course of the contest, including a 14-point deficit to start the match, to defeat their rivals 41-38 to clinch the NFC South crown and a place in the playoffs.
Olsen believes that his side displayed great character to win the match and feels that bodes well for their ambition to win the Super Bowl.
He told reporters: "For every team that looks back on a special season or a championship season, you look back, 'hey, that game could have gone against us. That game could have not gone our way'.
"But good teams make their own luck. Good teams respond. We couldn't have had more negative, critical errors go against us and to still score 41 points and win the game, to me it says a lot about the guys we have."
The Panthers moved to 12-0 in their season as a result of their win.