Not in the same way as there were cults for other gods, no. Set wasn't really a god who had large temples dedicated to him or priests who served him specifically, because he held a strange position in that he wasn't necessarily evil, but was often the antagonist and embodiment of negative concepts in Egyptian mythology. In fact, Egyptians would sometimes go out of their way to not mention Set's name or depict him in art because he was so likely to invoke chaos and mayhem. However, once outside religious influence entered Egypt in the Late and Graeco-Roman periods, its possible that people would worship syncretic forms of Set with other war/storm gods like Zeus or Baal, since these gods are often the head of the pantheon in other polytheistic religions.

Pi-Ramesses did have a temple dedicated to him that was on the larger side, he was patron of a few administrative districts, and he replaced Horus as chief deity for a bit during the Second Dynasty. The Hyksos (overlapping the 16th dynasty) took him on as chief deity as well during their occupation. There is little evidence of true cults with devoted sects, although a lot of compendiums vaguely point to "cults of gods like Horus, Seth..." without trying to defend their position on his inclusion in the list.

The most reliable information that yore going to find will be in Te Velde's "Seth, God of Confusion." (Yes, the book is not super recent; however, it's still considered a reliable source by Egyptologists.)

I'm not sure that you're going to find certain groups or affinities who worshipped Seth. The way that Egyptian polytheism tended to work was that there were local gods (think, Hathor of Dendera) who had temples and were worshiped locally, and then national gods who had higher places in the pantheon. There wasn't so much deliberate choice involved in seeking out the god that fit your needs - but it's been a while since I read Te Velde's book, which will certainly answer your question more thoroughly than I can.