Of course, the purpose for swap is if your RAM runs out. But with 256GB RAM, I doubt this will happen.
A greater concern is that the frequent writing of the swap partition could wear out the SSD. As we know, flash drives have a limited number of reads and writes. That's why I specifically bought a datacenter grade SSD for my server, because consumer SSD is a risky endeavor for a live web server.
I once killed a 400GB consumer micro SD because I attached a swap partition. I had partitioned the micro sd and used a software to put a swap partition on it through Android. I can't verify that was the cause, but it's the only time a micro SD died on me.
With 256GB of RAM in my server, are there any potential risks to NOT having a swap partition at all?