Nightshade might work but I am skeptical.
In regard to stable diffusion in particular...
Large models use enormous database.
For instance the latest stable diffusion model (SDXL) was trained on the Liaon-5B dataset.
It has over 5 billions images. You can check it here in all it's glory.
I searched a few keywords and the results are not impressive.
To summarize, it uses a lot of images butThe quality is inconsistant. Most images are crappy.
The tagging of images is poor, especially compared to an image database like Danbooru (NSFW).
For an AI, the database is dumb as hell. In that regard, I don't know how Nightshade could affect these large models.
But, most people do not use the main models... They use fine tuned models that are retrained on smaller curated dataset. Maybe a few thousands images at most.
It could work but if you carefully select the images, you could somewhat avoid the poisoned ones. Or only use older images.
Thankfully, there are projects like this one that aim to train model on good dataset ethically.
Even with a much smaller dataset, if the quality is much better, it could result in a much better model.
Here are some examples of map (map like) images I've generated.
I can't say that I've spent that much time on that topic, but I've generated quite a lot of AI images.
If you are curious, you can just drag these images in Comfyui and you will get the complet workflow.
These images were generated during the SDXL beta on their website and I'm not sure how to replicate them: