Not necessarily. We know the EF has gods. It’s possible that the church line is related to them (Eric’s people seemed to worship Ursula the goddess) rather than to Christianity.
Except the places of worship associated with pantheistic religions were not called churches. They are called temples. Church is a Christian term, not general religion.
Temple, is from the Latin templum which is a general structure for religious services.
Chruch (big C or little c) comes from some Greek verbage. You have kyriakos okios (house of the Lord) and ekklesia which has a broader meaning of assembly but is used to specifically mean Christian Church when used in a religious context. We got a lot of Christian/church words from that last one…like ecclesiastical matters, matters relating specifically to the church.
(thank you 5 years of Greek and Latin. You sometimes come in handy…)