Built in 1895, the Baylar Mosque is a significant historical and architectural monument in Icherisheher. It stands out due to its large hall and unique construction, which incorporates European, Eastern, and local architectural principles. The upper part of its minaret features decorative elements typical of Western Europe, and the interior showcases exquisite stone carving artistry.

The restoration and conservation work on the Baylar Mosque was led by renowned Austrian restoration expert Erich Pummer, invited by the Icherisheher State Historical-Architectural Reserve Administration. The Icherisheher Traditional Art Center also participated in the restoration in 2014–2015, decorating the mosque’s doors and windows with architectural elements.

As a result of the restoration, the mosque was converted into a museum featuring the “Sacred Relics” exhibition. This exhibition includes 73 Qurans, 7 religious books, 19 religious artifacts, and a total of 99 items. The collection features ancient Qurans from various periods, including pages protected from fire and Qurans preserved in the walls of the Derbent Mosque.

In December 2016, President Ilham Aliyev and First Lady Mehriban Aliyeva attended the opening ceremony of the Baylar Mosque.