Immaculate Heart of Mary, formerly named Le Sacre Coeur de Marie, was the first church built in Rutland for the French Canadian population.

Despite the depression in the mid-1870s, the Sacre Coeur de Marie congregation continued to grow, numbering 263 families in 1888. It was becoming clear that a new, larger building would be needed. An architect was chosen and work began in the early fall of 1891. The cornerstone was blessed by Bishop John Stephen Michaud on 18 August 1892.

The new church was ready for Christmas midnight Mass in 1893. A large terra cotta statue of the Blessed Virgin Mary, made in Holland, had been set in place over the front entrance, and finishing touches continued. The three bells were named; Jesus, Mary and Joseph; Leo, Louis, and John; and Norbert. These rang for the first time on 25 June 1894, having been blessed the previous day. Shortly thereafter, the stained glass windows were installed.

In 1948, because of a decrease in French-speaking parishioners, the church was officially renamed "Immaculate Heart of Mary" and shortened quickly to "IHM". In 1945, Pope Pius XII declared the feast of the Immaculate Heart of Mary as one for recognition by the universal Church.

Immaculate Heart of Mary parish was closed on January 1, 2023, by Bishop Christopher Coyne.