Rendered at 17:24:46 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
flextheruler 1 hours ago [-]
I've started looking at profiles of the non-technical "AI at any cost" people on Reddit and noticed a trend towards AI generated NSFW posts and anime. Unsurprisingly they tend to have zero tolerance towards accepting legitimate criticisms or concerns.
After reading about the blackmail a school system in the UK faced because criminals took a public post of 10 year old soccer players and generated sexual child abuse materials with the real girls faces it's in everyones best interests to not post their children's images until or unless we can regulate this behavior.
"By November 2025, IWF reports of AI-generated CSAM had more than doubled year over year, rising from 199 to 426. Girls accounted for 94% of the victims. Reported cases included children ranging from newborns to two-year-olds, according to the organization.
The ecosystem around these tools is industrial. In April 2025, a researcher found an exposed AWS S3 bucket belonging to South Korean “nudify” app GenNomis containing 93,485 AI-generated images alongside the prompts that produced them."
0cf8612b2e1e 35 minutes ago [-]
What more regulation needs to happen? Real or synthetic CSAM is already illegal. Adding another law that is effectively, “Same thing as the previous ones, but this time the generator is a LLM, not Photoshop”.
thatguy0900 12 minutes ago [-]
They want the regulation to be that Ai models cannot produce such images at all, not that producing them is illegal
zamalek 8 minutes ago [-]
You'd have to have a model that has never seen children, which is perfectly fine, but I can't see any of those with the resources to train such a model form scratch actually doing so.
da-x 43 minutes ago [-]
I am looking for signs we are at 'peak AI', is this it?
skylurk 1 hours ago [-]
Sounds like UBI to me
dpark 1 hours ago [-]
> Joi AI is an online platform that includes AI-generated avatars, voice interactions, and personalized chat experiences built around companionship and intimacy.
Companionship and intimacy, two things people desperately want and two things AI cannot deliver.
This stuff is deeply dystopian and I struggle to believe good faith on the part of people selling this stuff.
pixel_popping 10 minutes ago [-]
I disagree in part and I say that really sadly, but I genuinely think many people will be completely ok with having "AI friends" if let say it was absolutely or close to 1:1 for a human (which should be the case someday) as in good-looking humanoids, you might want to see how a very old person (>80 years old) behave when you put ElevenLabs in a flawless manner, it can be hours of convo daily without stopping, the "joy" they feel by this companion is quite real, at least it's felt.
We might even reach the point where having AI companions somehow will become essential and primary, even with an already fulfilled social life.
theragra 1 hours ago [-]
Users think otherwise. I agree it is dystopian, but to me it is the same bucket as sex work. There are people that won't be able to get a sex partner in a "normal" way. The only way for them is sex workers.
I assume the same is true here. A lot of people have real trouble to get romantic partner, and AI filla the void. It may look bad from the outside, but I don't think normal people can judge romantically deprived.
What would be even more dystopian than AI-partner society is not only to blame incels for each and any issue, but also to disallow them even right to use AI for romantic feelings.
ericmcer 1 minutes ago [-]
That is a sort of a nightmare. On demand sex work for extremely low cost with 0 risk of disease...
We are slowly stripping everyone of the will to build meaningful lives by fulfilling all wants with soulless instant gratification. No perfection of AI/sex work whatever can match actual intimacy with someone.
That is at the root of most of our current societal ills I believe. Bad economy, Bad job market, etc. are all a smokescreen over the fact that people can escape their problems which enables many to live numb half-lives and avoid any crisis that might trigger real change.
dpark 52 minutes ago [-]
I’m not blaming incels. I’m blaming the people building companies with the express goal of extracting money from them.
There is no moral imperative to allow predatory behavior. We can recognize the difficulty many experience with romantic relationships without blessing others to take advantage of them.
I also very much doubt that people struggling with romantic relationships actually show any measure of mental health improvement after engaging with these AI bots. I imagine the pattern is one of addiction, where participants feel better while actively using the product but then worse at baseline because none of their actual problems have improved.
danudey 34 minutes ago [-]
I mean, this seems like another step further.
Having an actual romantic partner provides physical and emotional intimacy.
Hiring a sex worker provides physical intimacy and no emotional intimacy (unless you're paying for that as well, I suppose), but lonely people can project onto the SW and mistake physical intimacy for emotional intimacy. That can be unhealthy.
With this, there's no physical intimacy and a simulated level of barebones interaction, meaning that you're getting the physical release but no actual intimacy and none of the other stuff that comes with any sort of relationship, let alone a romantic one, let alone a healthy and rewarding romantic one.
There's a time and a place for this, but it's a digital sex toy and that's all. AI isn't filling the void of a romantic partner any more than eating a bacon double cheeseburger every day is filling the void of a healthy balanced diet. It keeps the body going, but it doesn't deliver what you and your body need to thrive.
(All of this outside of the context of asexual/aromantic individuals, who may or may not need or want or be comfortable with any level of any of this and for whom this might be the perfect product for all I know.)
bigstrat2003 38 minutes ago [-]
Providing an AI "companion" to those who are lonely is kind of like selling drugs to addicts. Yes, it's what they are seeking, and yes, they are suffering. But what you're giving them causes them to suffer more, not less, and it's evil to profit by giving people something that is harming them even if they ask for it.
root-parent 18 minutes ago [-]
This is another job H1Bs will do for half the price.
bitwize 2 hours ago [-]
Just when you thought Juicero was the bottom of the silly valley barrel... a startup called Joi offers JOI by AI
https://www.malwarebytes.com/blog/family-and-parenting/2026/...
"By November 2025, IWF reports of AI-generated CSAM had more than doubled year over year, rising from 199 to 426. Girls accounted for 94% of the victims. Reported cases included children ranging from newborns to two-year-olds, according to the organization.
The ecosystem around these tools is industrial. In April 2025, a researcher found an exposed AWS S3 bucket belonging to South Korean “nudify” app GenNomis containing 93,485 AI-generated images alongside the prompts that produced them."
Companionship and intimacy, two things people desperately want and two things AI cannot deliver.
This stuff is deeply dystopian and I struggle to believe good faith on the part of people selling this stuff.
We might even reach the point where having AI companions somehow will become essential and primary, even with an already fulfilled social life.
I assume the same is true here. A lot of people have real trouble to get romantic partner, and AI filla the void. It may look bad from the outside, but I don't think normal people can judge romantically deprived.
What would be even more dystopian than AI-partner society is not only to blame incels for each and any issue, but also to disallow them even right to use AI for romantic feelings.
We are slowly stripping everyone of the will to build meaningful lives by fulfilling all wants with soulless instant gratification. No perfection of AI/sex work whatever can match actual intimacy with someone.
That is at the root of most of our current societal ills I believe. Bad economy, Bad job market, etc. are all a smokescreen over the fact that people can escape their problems which enables many to live numb half-lives and avoid any crisis that might trigger real change.
There is no moral imperative to allow predatory behavior. We can recognize the difficulty many experience with romantic relationships without blessing others to take advantage of them.
I also very much doubt that people struggling with romantic relationships actually show any measure of mental health improvement after engaging with these AI bots. I imagine the pattern is one of addiction, where participants feel better while actively using the product but then worse at baseline because none of their actual problems have improved.
Having an actual romantic partner provides physical and emotional intimacy.
Hiring a sex worker provides physical intimacy and no emotional intimacy (unless you're paying for that as well, I suppose), but lonely people can project onto the SW and mistake physical intimacy for emotional intimacy. That can be unhealthy.
With this, there's no physical intimacy and a simulated level of barebones interaction, meaning that you're getting the physical release but no actual intimacy and none of the other stuff that comes with any sort of relationship, let alone a romantic one, let alone a healthy and rewarding romantic one.
There's a time and a place for this, but it's a digital sex toy and that's all. AI isn't filling the void of a romantic partner any more than eating a bacon double cheeseburger every day is filling the void of a healthy balanced diet. It keeps the body going, but it doesn't deliver what you and your body need to thrive.
(All of this outside of the context of asexual/aromantic individuals, who may or may not need or want or be comfortable with any level of any of this and for whom this might be the perfect product for all I know.)