I recently discovered that some popular federated instances have been using LLM-assisted moderation tooling that evaluates whether someone has said something bannable. They do this by running a script/app that sends the user’s comment history to OpenAI with the question “analyze this content for evidence of specific political ideology sentiment. Also identify any related political ideology tropes“. (The italic bits are where I’ve redacted the ideology they’re seeking).
OpenAI’s LLM (they’re using GPT-5.3-mini) then responds with something like:
and so on, hundreds of comments.
I have not named the instances or people involved, to give them time to consider the results of this discussion, make any corrective changes they want and disclose their practices at their own pace and in their own way. I have also redacted the evidence to avoid personal attacks and dogpiling. Let’s focus on the system, not the individuals involved. Today these instances and people are using it and maybe we’re ok with that because it’s being used by groups we agree with but what if people we strongly disagree with used it on their instances tomorrow?
The use and existence of this tooling raises a lot of other questions too.
What are the risks? Fedi moderators are often unsupervised, untrained volunteers and these are powerful tools.
What safeguards do we need?
Would asking a LLM “please evaluate this person’s political opinions” give different results than “find evidence we can use to ban them” (as used in the cases I’ve seen)?
What are our transparency expectations?
Is this acceptable and normal?
Should this tooling be disclosed? (it was not – should it have been?)
If you were given a choice, would you have opted out of it?
Can we opt out?
Are there GDPR implications? Privacy implications? Should these tools be described in a privacy policy?
Are private messages being scanned and sent to OpenAI?
How long should these assessments be retained and can we request to see it, or ask for it to be deleted?
Once the user’s comments are sent to OpenAI, is it used to train their models?
What will the effect be on our discourse and culture if people know they are being politically profiled?
Where are the lines between normal moderation assistance tools, political profiling and opaque 3rd-party data processing?
I hope that by chewing over these questions we can begin to establish some norms and expectations around this technology. The fediverse doesn’t have any centralized enforcement so we need discussions like this to develop an awareness of what people want in terms of disclosure, privacy, consent and acceptable use. Then people can make choices about which instances they join and which ones they interact with remotely.
And of course there are the other issues with LLMs relating to environmental sustainability, erosion of worker’s rights, increasing the cost of living and on and on. I can’t see PieFed adding any functionality like this anytime soon. But it’s happening out there anyway so now we need to talk about it.
What do you make of this?
I’m mostly just surprised that a mod would pay for tokens to moderate. The Fediverse is radically public by design, so I don’t have any expectation of privacy. I’d bet at least someone is gobbling up the entire Fediverse to train AI, since companies are so desperate for new human-generated data.
LinkedIn’s LLM-powered automation banned my account on a false positive a few months ago, and it took ages to get it sorted out and they treated me like shit the entire way through even after acknowledging that they’d made a mistake. Sadly it’s extremely difficult to operate in my field without a LinkedIn account, because I would love to be able to delete it.
This shit is poison
Is Rimu okay lately? He’s been acting so hostile.
What now? Nothing, really, because nothing has really changed. I don’t care whether an admin tool is based on an LLM or on a simple regular expression. I only care about the outcome, meaning the mod actions it takes.
I think you’re just looking for excuses to defederate from dbzer0. I think you’re throwing things at the wall to see what sticks.
GDPR-wise, this is the absolute nightmare scenario.
Data about the political orientation is defined as especially sensitive (“special category data”). When people just straight post their ideological leanings, that’s one thing. But what’s described here is profiling. All the available data relating to a person is analyzed by “automatic means” and used to assess their leanings. This then is used to discriminate against them. It doesn’t get much worse.
This might be legal in very specific circumstances. EG non-profit religious or political organizations are allowed to police their members and associates to some degree. That would involve quite some extra paperwork. But it doesn’t apply here anyway.
Apparently that is on top of ordinary GDPR violations. The processing is done by a third party (OpenAI) without the necessary paperwork. You remember that billion Euro fine that Meta got? That was because they processed data outside the EU, in the US. And that wasn’t even “special” data.
You know how those cookie banners in the EU look like? That’s for normal data. All the disclosure, all those settings are legally required. Some people on the Fediverse go apeshit over far smaller things.
This may also be a problem for other instances. Your instance sends all your data (except e-mail and IP address) to anyone in the world who asks, with no strings attached. That may be okay as long as users understand that that’s exactly what they sign up for. Looking at comments here, it doesn’t seem like that is universally understood. That’s a problem. On top of that, we now have a situation where there are hints that the personal data is being abused.
This is the person calling you a tankie. Someone so afraid of words that they need a hallucinating robot to hold their hand and confirm that everything is a secret plot against them. The absolute only way I could see this being useful is for something like trying to sniff out if a Lemmy.world mod account is a leftist infiltrator or not. Someone who had a different opinion on a current event.
You could maybe run a speech pattern comparison but that’s it. For everything else you just made Stupid Reddit and the purpose of their forum is to feed training data to ChatGPT so that it can profile Fediverse users.
This is the kind of shit dystopian novels are made out of. So angry about people calling out actions you built a tool to analyze why they did it, so you can purge users from your digital kingdom.
I for one welcome flat.world and Piefed showing their true intentions. Digital colonization of activitypub and removal of the people who helped to built it. They didn’t want to leave reddit, they wanted to be reddit. This is some Spez shit.
Maybe in 2 weeks Piefed will hard code that anyone Rimu has tagged for disagreeing with them mild criticism to be unable to make accounts or federate posts with a false error code.
Defederate, no question.
Are you gonna tell us which instance is doing this?
OP already answered this: not at the present time.
Oh fucking YIKES.
Do NOT send our post history straight to OpenAI, that’s just … extremely gross.
Sure, it’s “public”, but that doesn’t mean feeding it directly to the slop machine is okay.
– Frost
Not comfortable with this. Not at all.
Aside from the ethical implications of profiling users or of using a corporatly owned server and model to execute this, I see nothing uniquely concerning about this practice that isnt already a risk of federated social media generally.
Every mod on every instance is free to use whatever tools or standards for moderation they want - that’s an intentional byproduct of federation. Similarly, the collection of this data for use with llms is a bygone conclusion at this point - there was never any way of preventing that from happening with a federated network.
I think the only thing here to talk about is the way these questions are being framed as a question of intra-instance policy. We already have communities where moderation abuse can be called out and adjudicated- why pose this as a question of instance administration when there doesnt seem to be any evidence for it?
these questions are being framed as a question of intra-instance policy
I think this is just more of the ongoing controversy being spun up against db0.
This weeks flavor appears to be more data driven, a ‘just asking questions’ phase. I guess in hope the whole ‘falsifying evidence to make db0 users look like neo-nazis’ thing blows over.
Like it’s clear there’s an effort to rid db0 from the fediverse, and it’s just the pretext hasn’t been sorted out yet.
I don’t doubt it even for a second.
I’m lowkey kind of fascinated this morning with what feels like a moment of real panic among western liberal-democratic institutions (projecting a little from my morning news and coffee). That an anarchist instance is getting this much targeted harassment feels like a microscopic extension of that (if I allow myself to be so bold)
As far as I can tell, dbzer0 isnt even being explicitly called out here, but it has an undeniable bdzer0 flavor to it. If it doesnt come out that this was one of our mods at this point, I’d almost be disappointed.
Yep and it doesn’t help that Rimu himself is a very questionable dude. He says he defederated from lemy.lol over their pepe frog logo but honestly I don’t believe it is the reason/ He hates memes. He said as much to me himself. A while back, someone realized that piefed was hard coded to give negative reputation to certain people, regardless of what settings the admins had made. Piefed is built off of Rimu’s opinions and he puts the majority there as an opt-out, not an opt-in. When I made a jokingly apology for all the memes I post, he said “It’s not your fault that the lemmy devs didn’t put guardrails in.”
If he’s that opinionated about memes…
Combine that with the fact that this post has literally no information other than “Trust me bro”? I don’t trust Rimu as far as I can throw his garbage platform and I can’t even throw the thing because its digital code. Hell, Mr. Kaplan even had to do a ton of un-fucking of Piefed to get piefed.world to work and was talking with me about it at the time. Just LITTERED with Rimu’s stances.
Not to mention that Rimu routinely comes in with preconcieved notions that others have to point out the bullshit of and he quietly then steps back from it or refuses to engage entirely and dismisses it out of hand.
Like… the Lemmy devs suck, absolutely. But the only facet in which Rimu is better is he’s not a transphobe.
Edit: See below for screenshots. I’m tired of this shit. Yes. He’s wildly opinionated.
Edit 2: Lol this comment is not visible on piefed.social. Rimu out here screaming about fiefdoms and hidin things critical of him.
hates memes
builds reddit clone
I’m creating my own reddit - without blackjack and hookers!
That’s worthy of a meme in and of itself.
A while back, someone realized that piefed was hard coded to give negative reputation to certain people, regardless of what settings the admins had made.
Please don’t spread old mis-info or at least back this up with actual links to the source-code (and if we are talking about the same thing, this was clearly debunked).
As for the OP post, this is factually correct and I have seen the evidence. Although maybe Rimu should have been more clear in pointing out that this seems to be not an official instance tool, but rather something some moderators have cobbled together themselves.
Please don’t spread old mis-info
I mean, you just did it. The OP post is not factually correct as he stated that it is at an instance level. It is not. It is at a moderator level.
Please don’t spread old mis-info or at least back this up with actual links to the source-code (and if we are talking about the same thing, this was clearly debunked).
Gotta say though, getting real tired of people telling me that I didn’t understand conversations I was a part of. No. It was not ‘debunked’. It was added under an opt-in toggle after everyone noticed it and called out his bullshit. You might be thinking of something else, but this is what I was talking about.
Piefed is infected with Rimu’s extreme opinionated garbage and he only backs down and puts them into a toggle after someone notices it. That’s not the behavior of a developer that I find personally trustworthy. So when he’s out here making a post that is outright false, claiming that instances are doing something that moderators are doing, I don’t trust him. Not to mention the extremely long conversations I had with Mr Kaplan about how Piefed.world needed to be un-rimu’d in order to work as LW wanted it to.
Piefed is infected with Rimu’s extreme opinionated garbage and he only backs down and puts them into a toggle after someone notices it.
I personally prefer Rimu taking feedback into account and then making changes than Lemmy devs bluntly closing feature requests widely upvoted by the community because “reasons”
Let’s be honest here, it’s not like there are so many options we can choose from.
Also, the example you gave about shows more than anything else that Rimu did change his mind.
“All the settings in this screenshot are off by default”
He only changed his mind after someone discovered it. The thing I don’t like is his obfuscating his opinions that he’s injected into Lemmy. Having to manually discover them and then bug him about adding an opt out toggle is not exactly trustworthy behavior nor is it something I’m going to applaud. He still tried to sneak it in regardless and only backed down when called out. I’m not giving him props for that.
I was referring to a different but similar case where someone intentionally spread mis-information about supposedly hardcoded things that turned out to be a complete nothingburger as all of it was behind an admin toggle. The same seems to be now true for this old issue you specifically pointed out here.
It is true that there is some experimental stuff in Piefed, which is part of the relatively rapid iteration of features, but looking at the code and also the explanations given by the Piefed development team I can really not see any malice in those settings. It is perfectly normal that things get overlooked or implemented partially and when someone reports a bug (like a missing admin configuration setting) it usually gets fixed quite quickly, and at least in my experience without much discussions.
The same seems to be now true for this old issue you specifically pointed out here.
But it isn’t. First off, you made an assumption and dismissed my initial complaint. Now you’re dismissing this one saying it’s basically the same thing when it isn’t. Having a long discussion with large admins saying “Hey. What the fuck is this stuff?” only for Rimu to constantly push back and saying how he wants to reshape everything is fucking concerning. The fact it took everyone pushing back against him to add it under a toggle even more so. You’d have a point with the whole “this happens” if this didn’t happen with every single major Rimu feature.
But, once again, Rimu is actively pushing misinformation and you have dodged the point that you are doing the same. This is not an admin or instance level problem. Moderators are doing this and claiming this is “instance level” is to be a liar.
It is perfectly normal that things get overlooked or implemented partially and when someone reports a bug (like a missing admin configuration setting) it usually gets fixed quite quickly, and at least in my experience without much discussions.
And, as we all know, your experience is the only universal experience that everyone has at all times. I guess the month long conversation I had with Kaplan, head admin of Lemmy.world, about unfucking Piefed because Rimu filled it with his opinionated garbage didn’t happen. I guess the fork of Piefed being created that’s taking out all of his opinionated garbage didn’t happen. Not to mention his 4chan screenshot scanner (that can be bypassed immediately), the cm0002 filter he put onto piefed.social (that can be bypassed immediately), the blocking of any numbers of 88 put together (which can be bypassed immediately), the private votes that would prevent admins from locating vote brigaders (which can be opted, granted, but after a HEATED discussion in the piefed matrix).
Rimu is over opinionated to a fault and Piefed is the same.
You know nothing of which you speak.
But, once again, the only important point is that Rimu is actively spreading misinformation by claiming this is an instance problem when it is moderators that is doing it. Once again, with action after action, Rimu cannot be trusted.
Although maybe Rimu should have been more clear in pointing out that this seems to be not an official instance tool, but rather something some moderators have cobbled together themselves.
This isn’t an issue of clarity. His closing call to action is to ‘develop awareness so that people can choose which instances to join and interact with’. There aren’t any practical administrative solutions to the problem being called out, with the exception of defederation or the threat thereof. Any single user on the entire fediverse can copy-paste user activity into any LLM and use the output to make moderation decisions, or craft personalized agitprop or whatever else, but centering the focus on instances that allow their usage turns the issue into a nail that can be solved with a hammer.
You are jumping to conclusions. I think it is generally worthwhile to discuss the use of LLMs for making moderation decisions and also using them to produce ideological profiles of users.
The worthiness of a discussion has no bearing on the intent and framing of the person prompting it.
The questions are being raised by the same person who included global reputation scores in his backend piefed code for the purposes of suppressing his personal pet peve behaviors. I find that to be informative context for considering the intent of the discussion being prompted.
edit: Oh look, here he is saying exactly what I was just pointing out was likely the intent
I’m lowkey kind of fascinated this morning with what feels like a moment of real panic among western liberal-democratic institutions (projecting a little from my morning news and coffee). That an anarchist instance is getting this much targeted harassment feels like a microscopic extension of that (if I allow myself to be so bold)
As far as I can tell, dbzer0 isnt even being explicitly called out here, but it has an undeniable bdzer0 flavor to it. If it doesnt come out that this was one of our mods at this point, I’d almost be disappointed
These type of posts are why people (from all walks of life) view western leftism as more of an aesthetic, performative thing.
So right wingers complaining about leftists is why people view western leftism as performative?
Honestly sounds like maybe people should be taking issue with the complaining right wingers there.
Right - which is why it was quite interesting watching Fox news have a 20 minute power struggle over the sudden popularity of May Day in the US and the rise of ““extreme socialist sentiment””
All online political discourse is performance - feel free to speculate how well it is representative of IRL leftist spaces in the west.
From my time in the US, what you describe seems like a pretty run of the mill local rhetorical strategy; a tried and true American polemic if you will.
Sure, but even with something like online political discourse you can do better than getting obsessed over a bastardized provincial political term (liberal which means something completely different outside of the US) and providing cover for promoters of russian and Chinese genocidal imperialism and propaganda. We are not talking about a deep discussion on philosophy and political economy, just the absolute basics.
Can’t speak for your definition of leftist spaces, but many (not all of course) self-proclaimed western leftists IRL have a very performative approach to imperialism (among other things).
Sure, but even with something like online political discourse you can do better than getting obsessed over a bastardized provincial political term (liberal which means something completely different outside of the US)
Sorry, I’m having a hard time following the train of thought - are you referring to my use of ‘liberal-democratic institutions’?
I don’t want to word-vomit on you unnecessarily if you’re pointing to something else or speaking broadly about leftist discourse on lemmy (i’ve seen plenty of debates like the one you’re describing)
and providing cover for promoters of russian and Chinese genocidal imperialism and propaganda
Ok well now i’m even more confused - where is this jab coming from?
Maybe you’re taking issue with my categorizing db0 as a leftist space and are speaking broadly about the perspectives about china and russia from that instance? What are we talking about here?
liberal which means something completely different outside of the US
Not really, both imply right wing pro-capitalist beliefs. American Liberals just tack ‘progressivism’ onto their meaning to steal some left clout.
whats funny is I don’t have much negative dbzer0 experience until you two guys start making this about that.
That’s an odd takeaway, for sure.
Is this a negative db0 experience for you?
im just saying when there is a particular thing and someone starts pulling in something unrelated as a conspiracy it leaves a bad taste. Its a bit like folks suddenly saying something about lemmy.ml being so and so in an unrelated type post that gets me to do my posting in their communities but in a reverse kinda way. rimus last post about a trend he saw I think it had some interesting perspectives and few if any where that the instances were ban happy. Similarly this one has some good conversations going.
Rimu has confirmed this is about db0.
unrelated
Well, it is noting that there’s now at least an appearance of a relationship going on. Especially so, if you’re already clued into the ‘ban-happy’ statistics magic thread.
Similarly this one has some good conversations going.
Hopefully those continue unimpeded and this can remain contextual or tangental.
this one did not name any instances. paranoia is the only reason to link them or knowldge that the two things are indeed connected. Each is fine to me though. Bringing up data and slicing and dicing it a bit is fine and the convo brought up issues with the way it was massaged. Similarly this is about a particular thing. Niether indicated an opinion or want for some sort of action against instances. so yeah. unrelated. but yeah I like good and vibrant convo which is why I have enjoyed both posts. one thing im not wild about this is some comments suggest its an admin thing and should be discussed in some admin community but im not wild about the cigar filled room type thing.
Well, it was fun while it lasted…
Lol it’s dbzer0 isn’t it.
But also, I don’t really care. The fediverse is open by design, you don’t even need an account to access the data. I don’t like it but we can’t really do anything against it.
If it can be done, it sooner or later will be done.
That’s a lot of why I have a couple of dozen accounts scattered around the threadiverse and new ones whenever I come across a server that looks promising - because it takes a while to get used to one and get a feel for whether it’s one I like or not, and because there’s always the possibility that one I like will go sideways and/or shut down, in which case I can just unpin it and go on.
And in fact, I’m only using this account on something of a whim for this post - I don’t normally use it because one of the instances I don’t like much is yours. And specifically what I don’t like about it is you, and your bland presumption that you know what’s best for me - which communities I should subscribe to, which posters I should trust or even becallowed to see, which sources I should be allowed to use or see…
And really, I’m sort of surprised that you’re the OP here and not the subject. I would think that the whole idea of commissioning a review of a user’s posting history in pursuit of grounds to ban them would be right up your alley. Is the problem just that it’s AI?
In any event, this is just a thing that might prove to be an issue. And if it does, I’ll just move off of the affected server(s) and keep using the unaffected ones. And if enough people share my sentiment and the admin cares enough, they might change their ways. Or they might not. It’s not a big deal either way - it’s just part of life on the fediverse, and IMO the benefits make it worth it.
Is it not public knowledge that lemmy already gets scraped by LLM bots? Which is why every bigger instance has anti-LLM measures in place now to limit that behavior? To me this just looks like a mod trying to get ai-generated reports which is not a bad idea imo since I know reporting is not often done by users who see rule breaking stuff.
This is AI generated bullshit below, it should be treated as such. I only want to convey the idea that what you do on lemmy is already fed to LLM’s.
here is chatgpt's reply for
What do you know about lemmy user and piefed dev rimu?Here’s a grounded picture of “rimu” in the Lemmy / fediverse context:
🧑💻 Who “rimu” is
- Rimu (Rimu Atkinson) is the lead developer of PieFed, a Reddit/Lemmy-style platform in the fediverse. (Elite AI Tools)
- He’s also the main author of the underlying software (pyfedi), built with Python/Flask and designed as an alternative to Lemmy and Mbin. (IFTAS)
- The flagship instance is piefed.social, which he runs and develops actively. (IFTAS)
🧩 Role in the fediverse
- He’s not just a random user—he’s a core project maintainer / “benevolent dictator” style lead for PieFed’s development. (PieFed)
- He’s fairly active on Lemmy via rimu@piefed.social, with hundreds of posts and thousands of comments across tech, politics, and general discussion. (lemmy.world)
- He moderates multiple communities and participates in meta discussions about federation, scaling, and platform design. (lemmy.world)
🛠️ What PieFed (his project) is about
PieFed is positioned as:
-
A federated Reddit-like platform interoperable with Lemmy via ActivityPub (Elite AI Tools)
-
Focused on:
- Simplicity of codebase (easy for contributors) (PieFed)
- Trust/safety features (reputation systems, filtering, anti-spam tooling) (Elite AI Tools)
- Some experimental ideas, like merged cross-posts and AI-content detection (Elite AI Tools)
💬 Reputation & controversy
Rimu is somewhat known and occasionally controversial in fediverse circles:
-
Supporters see him as:
- A productive solo/lead dev shipping features quickly
- Someone pushing new ideas beyond Lemmy’s design
-
Critics argue:
- Some features reflect strong personal opinions embedded in the platform (e.g., moderation logic, reputation systems) (lemmy.world)
- PieFed can feel more opinionated / experimental compared to Lemmy’s more neutral baseline
Important nuance: because everything is open source and instance-configurable, many of these behaviors can be changed by instance admins.
🧠 What he’s like as a user
From his public activity:
- Talks about tech (ActivityPub, scaling, APIs)
- Engages in global politics and news discussions
- Shares design decisions and roadmap thoughts about PieFed
- Generally communicates in a direct, pragmatic developer tone
🧾 Bottom line
-
Rimu is a real, identifiable fediverse developer, not just a random Lemmy user.
-
He’s best understood as:
a lead dev + active community participant shaping an alternative to Lemmy
-
His visibility comes mainly from his project (PieFed) rather than mainstream recognition.
If you want, I can compare PieFed vs Lemmy vs Mbin in terms of ideology/design—that’s usually where discussions about Rimu get interesting.
He’s not just a random user—he’s a “dictator” style lead for PieFed’s development.
😂
Chairman Rimu please save us from the memes
Maybe we need a meanwhile on piefed community to talk about drama related to Rimu’s flinging of mud and insults, as well as the many additions to piefed’s code which make it a much worse platform. It doesn’t get talked about much except in comment chains and Rimu controls most communities about piefed itself. So a community beyond his reach would probably be good.
I think we just need Rimu to stop making so much drama. Things were fine a few weeks ago but something with him changed.
I don’t agree, he’s had a history of being weirdly controlling and opinionated. Piefed’s codebase is a testament to that. @Stamets@lemmy.dbzer0.com already pointed out one such malicious change Rimu put in and then decided to add a toggle to when he got backlash for it. He did the thing where meme communities were marked low quality long before this recent drama ark of his.
That comment will be invisible on piefed.social as Rimu has sidestepped the modlog and personally silenced me for criticising him <3
I know, he did it to me too. He’s angry that I called him a Zionist. Which I will continue to do so because it’s true. He sticks up for Samskara, a known Hasbara troll.
That whole blocking thing won’t make others comments appear is so egregious imagine being able slander someone and they’re unable to reply because obviously the slanderer would have them blocked.
Please dont.
this is flat out not ok, does not matter who is doing it. our instance ls should defederate all which do this.
I would opt out that’s no question, but I don’t believe it’s possible. GDPR does not matter here, as nothing can be proven unless the perpetrators give up themselves
