That's far too early to be referring to anything that would be considered "civilization" by most anthropologists. That term typically refers to sedentism, urbanization, and agriculture, which didn't start cropping up until roughly 10k years ago. What they are more likely referring to is evidence of human material culture, meaning artifacts that show human worksmanship. More specifically, they are probably referring to things like cave paintings and, as you mentioned, jewelry that started to show up in Europe around 50k-60k years ago. Because these objects are not explicitly functional (i.e. tools), they've often been attributed to a developing cognitive complexity that symbolic behavior that would have gone hand-in-hand with language.

The trouble with this idea is that it's very Eurocentric. This article does a very good job of breaking down some of the evidence of far earlier material culture in Africa, including symbolic behavior. Nailing down exactly what the significance of these behaviors was and how they relate to things like language is extremely difficult because of how ephemeral they are, but it's safe to say that they far predate 50k years ago.