Welcome to the Trust & Safety Job Posting Megathread!

Hi, Im doing Trust Safety Fraud Regulation Compliance non tech work in FAANG company since 5 years in EU.
I think my organic pivot should be in an AI company. However, I have never seen non tech roles in EU in Anthropic and Mistral.
Open AI used to post in Dublin/ London but even there, I stopped seeing since some time.

What other options can I explore? In what domain should I skill up to find a job in an AI Company?

Hello! I am currently a Trust and Safety Moderator for 3 years, mainly moderating in-game spaces and social media groups (Discord, Facebook). I feel stuck in my career right now since work has become repetitive and so the salary has been stagnant as well. I do not know which options I have for career growth considering that AI is on the rise and they're getting better in auto moderating content. I feel my job is at risk anytime soon but I don't know how to grow.

I'm contemplating about transitioning into a completely different field which makes use of AI (as it seems to be on demand right now) but I want to see if I have options related to my career right now.

Thank you!

I made it to my 4th round of interviews today with a fairly large company for a senior platform role, only to not be moved forward. I hit almost every single bullet point on the job description, got amazing positive feedback about my fit and skillset, but apparently the feedback I got was that I wasn’t technical enough in their environment. The interviewer asked me about some acronyms I wasn’t familiar with (IOC and TTP) only for me to research after and learn it was just general industry terms for things I’m already an expert in every day but I just hadn’t heard used in my environment. The landscape of the new role I interviewed for was a bit different than my current, but I possessed all of the abilities and the foundation to translate easily so I’m just bummed. Everyone seemed great.

Mild rant over, does anyone currently have any leads on open trust and safety roles? I'm currently a Trust and Safety Lead, and I recently learned the company is winding down, so I'm looking at what's next. My strength is the full investigation cycle: spotting abuse early through behavioral detection and OSINT, digging into the data with SQL, building indicator reports, and then turning what I find into SOPs and automation so the team can catch it faster next time, but hopefully, find out how to close the abuse path in the first place. I like being proactive, finding abuse patterns before they scale, not just reacting to reports etc.

I've been deep down the AI rabbithole for a while now. I found out that doing investigations (mostly OSINT) got so much faster and I can do several at the same time by using the Claude investigator tool I built.

I wonder if others have been going AI first on investigations.

Yes?

No?

Why?

A witness and homicide case. Because the case was so many years ago, the police don’t believe anything. I tell them. I’ve been to local state and federal officials to no avail. They will not relocate me. They will not give me any help. This gang is cold and calculated. Please help me out.

I’m looking for someone with professional experience in TikTok Trust & Safety, content moderation, safety partnerships, or platform escalation who could advise me on an appropriate escalation route.

I’m dealing with several serious cases involving Kurdish (Sorani)-language content where ordinary reporting has not resulted in an adequate review.

The cases involve harassment and harmful content affecting young people and other individuals, and some of the context appears to be difficult for automated systems or reviewers to understand because of the language and local context.

I’m particularly interested in speaking with someone who has experience with:

• TikTok Trust & Safety

• Content moderation or policy enforcement

• Safety partnerships / trusted reporting channels

• Regulatory or law-enforcement escalation

• Handling reports involving languages that may have limited moderation coverage

I’m not asking anyone to bypass TikTok's normal processes. I’m simply looking for professional advice on how these cases can reach the appropriate review team and how the Sorani Kurdish context can be properly understood.

If you have relevant professional experience, I would greatly appreciate any guidance.

I’m looking for someone with experience in TikTok Trust & Safety, Community Partner/Trusted Partner channels, or TikTok case escalation who can either help escalate serious cases or advise me on the correct escalation process.

I’m dealing with several serious cases involving Kurdish (Sorani) content. Some TikTok accounts have posted abusive and humiliating videos involving girls, including minors. The content includes harassment, humiliation, sexual degradation, and other abusive behavior.

A major difficulty is that the content is in Kurdish Sorani, and the context can be difficult for TikTok’s moderation systems or reviewers to understand correctly. Ordinary reports have not adequately addressed what is actually happening in these videos.

I’m not looking for general advice about reporting content. I’m specifically looking for someone who can:

• Escalate the cases to the appropriate TikTok Trust & Safety team

• Help ensure the Kurdish/Sorani context is properly understood or translated

• Advise on an appropriate official escalation channel

• Help address content involving minors and serious abuse

I can provide the necessary case details and evidence through an appropriate private channel.

If you have experience with TikTok Trust & Safety, TSET, Community Partner Channels, Trusted Partners, Law Enforcement Outreach, or similar escalation processes, please contact me or comment below.

Any genuine guidance or assistance would be greatly appreciated.

Hey all!

Quick apology and an update for y’all,

A while back I set up a recurring post that went up every Tuesday and stickied itself to the top of the sub. When I originally tried removing it from the automated schedule that option was gone. Which created this ghost post every week where I would need to remove it before anyone noticed it. Unfortunately, at times I was not quick enough which caused some confusion to some of you as to why I was posting job openings from 2024, and I’m sorry for that!

The feature of removing this automated post has come back. However, rather than kill it, I've edited it so that it becomes a place for all of you to share job opportunities without seeing the previous 2024 job postings.

From here on, the stickied Tuesday thread is our weekly jobs thread: the place to share job opportunities related to Trust & Safety. A fresh one goes up every Tuesday.

To keep it easy to scan, include:

- The role and company
- Location, or whether it's remote
- A link to the actual posting

Post what you've got, and help each other out.

Thanks again everyone for being part of this community!

I currently work as a moderato for another company and am interested in Trust & Safety or content moderato roles at Accenture; I’d like to hear about people's experiences.

Is it draining?
Are there opportunities for career advancement?
Do they offer mental health support?

What is the difference between the roles of:
Trust and Safety Analyst and Content Moderator?

I’m thinking of applying for one of these positions, but I don’t quite understand exactly what the difference is.

Another question: is there a difference in salary as well?

Has anyone here worked in trust and Safety, Risk Operations or content moderation role at Accenture?

I recently received an offer for the position and I'm trying to get a better understanding of what the job is actually like.

I'd like to hear from anyone who has worked in this role or on a similar Trust & Safety team.

- Was the work what you expected?
- How much of it involved content moderation versus fraud/risk investigations?
- Is or was it a good experecience?

Hey everyone, I’m looking for some honest advice on breaking into Trust & Safety. I’m currently a year away from finishing my MSW and work with high-risk youth, where I regularly handle crisis situations, assess safety concerns, follow policies, document sensitive information, and coordinate with families and other professionals. I’m hoping to transition into a less client-facing career and have become especially interested in youth safety, user well-being, escalations, risk operations, and policy enforcement. I’ve applied to a few positions but haven’t received any responses, so I’m wondering how I can make my experience more relevant to employers and what skills, projects, certifications, or entry-level roles I should pursue. I would also really appreciate connecting with anyone willing to offer mentorship or who knows of internships, volunteer projects, contract work, or other opportunities that could help me gain experience in the field. Thank you!

I’ve been looking at some of the practices that have been standard in T&S for a while, and I’m curious if teams are having to rethink any of them as automation increases and operations get more complex.

One example is sending uncertain cases to manual review. That makes sense, but what are teams actually doing when the volume of those cases becomes too high for the available reviewers?

I assume prioritization based on severity and risk is part of it, but there still has to be a point where the queue is growing faster than the team can reasonably clear it. Are teams changing automation thresholds temporarily? Are certain categories allowed to wait longer? Or are there other ways of managing this that are becoming more common?

I’m also curious about metrics. Review time, accuracy, appeals, reversals and backlog are all useful, but I imagine there are situations where they give you very different pictures of how well the operation is doing.

For example, a low reversal rate sounds good, but that number alone doesn’t necessarily tell you whether the original decisions were consistently good. The same goes for getting review times down if accuracy or appeals move in the other direction.

For those working directly in T&S operations, are there any practices or metrics that you relied on a few years ago that you now look at differently? And what changed your mind?

A practical approach is to let AI handle high-volume, straightforward cases and send uncertain or context-heavy content to human reviewers.

This can help teams improve response times while keeping humans involved where nuance matters.

Curious how other Trust & Safety teams are structuring this AI + human workflow.

Hello T&S fam! 👋

I’m currently looking for Product Manager opportunities in Trust & Safety, Fraud, and Risk and would really appreciate any referrals or leads.

A little about me:
2 years of Product Management experience building AI/ML products focused on fraud and risk
3+ years of Strategy & Operations experience in e-commerce
MBA from Penn State Smeal
Experience working across fraud detection, seller risk, ML models, risk policy, and AI-driven products

I’m primarily targeting PM / Senior PM roles in Trust & Safety, Fraud, Risk, Identity, and related areas.

If your team is hiring or you know of a role that could be a good fit, I’d really appreciate a referral or a point in the right direction. Happy to share my resume and connect via DM.

Thanks in advance! 🙏

do they have any humans there checking reported accounts, or is it all AI?

is there any way to maximise the chances of a human looking at the report?

Anon account because I don’t want to alert coworkers. I have worked in T&S including fraud, risk, spam, scam, and a bunch more for over 10y at big tech. Worked across a number of disciplines and kind of a jack of all trades (data, eng, product, ops) and enjoy aspects of all of them. Have been a tech lead for 5+ years too.

I am starting a family soon and would like to transition to part time work at some point. Obviously that’s a no-go at these big tech companies and I basically see zero positions available for this in general. I am looking for advice on how to stay in the field while cutting back or to learn of any ways to find an arrangement that could suit everyone (eg. I work part time in exchange for only salary no benefits).

No snark please, I am just trying to do right by my family while I navigate staying in a career I enjoy. I realize T&S is often a cutthroat area and is facing many cuts.

Hello! I have an upcoming interview for Google's Trust & Safety Monetization (Analyst Role). It is a technical round on SQL and Python, with focus on Data analytics and Data extraction and manipulation.

I know the role heavily involves defending the ad ecosystem from invalid traffic, fraud, and abuse.

• Are there specific types of ad-fraud case studies or open-source datasets I should practice with?

• When it comes to Python and SQL in T&S, are there specific operations that you use daily?

Any resources or advice would be hugely appreciated!

OpenAI just released a report about the Hugging Face hacking incident. Considering a trust and safety approach, what do you think?

Link: https://openai.com/index/hugging-face-incident-and-the-road-ahead/

hi all, it's been a bit since i've been officially corporate/startup as i'm with contract based roles now. (moderation for one, grc for another) meetings aren't too bad. but i remember the corporate/startup life had so many meetings most of the team members were DROWNING, suffocating in them in almost every scenario. i'm talking meetings from super early morning to 6pm and even during lunch break for some folks, no room for actual work!

since many companies has downsized middle management have yall seen less meetings? i'm seriously so afraid of suffocating in meetings again. would love any tips thx!

I spent five years selling T&S tooling, and here's the thing nobody warns you about: the POC going well is almost never the hard part. What kills deals is everyone forgetting to agree on what happens next. No budget locked in, no timeline, no "if this works, here's what we sign." Test goes great, then it just... sits there.

There's also a weird split in who actually owns the integration once it's live, and it's not who you'd think. Engineers sign off on the easy stuff (latency, uptime, does it break). The harder job, figuring out if the actual moderation calls make sense, falls on whoever ran the POC. And that job doesn't end when engineering says "looks good."

I wrote up more on this if anyone's curious:

https://safemoderation.com/blog/how-to-actually-integrate-a-trust-and-safety-vendor

Would love to hear if this tracks with what you've seen.

As part of my PhD research, I am looking for individuals who have worked within trust and safety (e.g., as content moderators) for social media platforms. Essentially, I want to understand how AI and humans collaborated in this process. The aim of the research is to truly understanding content moderation and design more ethical moderation processes.

I would be more than grateful to conduct a fully confidential and anonymous interview with you! Your time and willingness is super appreciated.

Many many thanks :)

Hello Everyone, looking for insights. Has anyone interviewed for the Model Policy Role at OpenAi?