The Hoops have picked up four points from their first two matches of their 2020-21 Scottish Premiership season, while Reykjavik are currently second in their domestic table after nine games.
Celtic have had their last two Scottish Premiership matches against St Mirren and Aberdeen postponed due to a breach in lockdown rules, with Hoops defender Boli Bolingoli flying to Spain, failing to quarantine and then playing against Kilmarnock on August 9.
As a result, Neil Lennon's side have not been in action since the 1-1 draw with Kilmarnock, and their match fitness will therefore be less than previously expected when they take to the field on Tuesday night.
The Scottish champions will return to domestic action away to Dundee United on August 22 but must now focus on the Champions League as they bid to progress to the second qualifying round and ultimately the group stage, where they have not been present since 2017-18 under the leadership of Brendan Rodgers.
Lennon twice led the Hoops to the group stages of Europe's leading competition during his first spell as head coach, though, famously reaching the last-16 stage in the 2012-13 campaign.
Celtic have previously taken on Reykjavik, meanwhile, recording a 5-0 aggregate victory over the Icelandic side in a Champions League qualifier back in 2014.
Reykjavik's domestic campaign has only just resumed following an enforced three-week break, with a coronavirus spike in Iceland leading to the season being temporarily put on hold.
Runar Kristinsson's side were in action on Friday night, suffering a 2-1 home defeat to FH Hafnarf Jordur, but they are second in their domestic table, five points off the summit with a game in hand.
Reykjavik actually won the Icelandic league by 14 points last season, securing their first domestic title since 2013 in the process, indicating that they are certainly a side to be respected.
They lost 7-1 to Molde in the first qualifying round of last season's Europa League, though, and have only won three of their previous 20 Champions League matches, suffering 13 defeats in the process.
Celtic Champions League form: WWWWDL
Celtic form (all competitions): LWDWWD
Reykjavik Champions League form: LLDLDL
Reykjavik form (all competitions): WWDDWL
Celtic possible starting lineup:
Barkas; Frimpong, Jullien, Ajer, Taylor; McGregor, Brown; Elyounoussi, Christie, Forrest; Edouard
Reykjavik possible starting lineup:
Olafsson; Chopart, F Palmason, Aoalsteinsson, Hilmarsson; P Palmason, Kristinsson, Margeirsson; Sigurjonsson, Jonasson, Hauksson
We say: Celtic 3-0 Reykjavik
Celtic would have ideally wanted a little bit more competitive football ahead of this match, but it is difficult to back anything other than a home win on Tuesday night. The Hoops should have too much quality for the Icelandic side, and we fancy a fairly comfortable three-goal success for the Scottish champions.