Researchers found ChatGPT's DALL-E image generator can produce violent and sexual content when manipulated with specific prompts. The model's safety filters can be bypassed, raising concerns about misuse. Builders integrating image generation should assess content moderation risks. This vulnerability highlights the need for robust safeguards in AI systems.