This is largely a cost issue. Whilst I cannot speak for the entirety of Europe in the UK the Romans were able to create Ceramic Building Materials (CBM) due to the sophistication of their economy and abundance of free labour (a large percentage of tile and brick shows legionary marks). However their creation requires a heavily vested industry and high level of expertise. After they left the UK this skill was essentially lost. The Anglo-Saxons and Normans had very limited knowledge of CBM construction but were quite happy to reuse existing material. Most notably Brixworth Church which is Anglo-Saxon is constructed entirely with reused Roman brick. Wood was far easier to source, far cheaper and ultimately, available. It also demanded less complex knowledge of architectural construction.

The reintroduction of brick manufacture did not appear until the 14thc. and only in a very limited way. There is one earlier example at Coggesall Chapel dating to around 1220 but it is not represented anywhere else and is thought to have been made due to the lack of nearby stone. Brick was the preserve of the nobility and clergy at this point, it was phenomenally expensive and most brick being used was made specifically for purpose on site. During the Tudor period this remained, with only the upper strata of society affording Brick. It was used to dramatic effect though with buildings such as the Layer Marney Tower being created. Whilst slowly falling in price, the availability of brick to the masses does not really change until around the 17th c. when brick from Europe, most significantly from the Netherlands, begins to enter the UK market. The Dutch had a much longer brick making tradition due to the lack of quality stone and once it entered the UK market it was very popular. As well as practical concerns such as resistance to fire, weather and its longevity it was also a very obvious status symbol. Brick can also perform architecturally in ways wood cannot and be formed into incredibly intricate moulds to create stunning façades and detailing.

Therefore as soon as it becomes commercially available people want it, hence by the 1700's as the industry builds people move across. I hope this helps. Let me know if you have any questions.