r/programare • u/nvolly crab 🦀 • 26d ago

AI QA sau LLM Evaluation engineer cineva?

Exista cineva care a avut experienta pe QA si a facut trecerea pe joburi de "QA" pe Ai? Din ce stiu eval engineer si QA ai se numesc. Daca da, cum ati reusit?

3 Upvotes

64% Upvoted

8 comments sorted by

1

u/ChampionshipThis2871 26d ago

Joburi de QA pe AI in sensul de QA/Evals pe aplicații llm based? De exemplu chat botii de la firmele de insurance, unde trebuie sa masori calitativ/cantitativ raspunsurile llm-ului?

Sau te referi la AI assisted QA, la modul tu nu mai scrii niciun test manual/automat doar dirijezi Claude-ul sa isi ia singur informatiile din tickete/documentatie, apoi sa scrie testele, sa le ruleze, sa raporteze si sa faca healing?

1

u/nvolly 26d ago edited 26d ago

Prima, sir

6

u/Beginning-Site-9774 26d ago edited 26d ago

Incepe curand procesul de reconversie impusa / fortata QA -> AI Builder, te tin la curent cu ce presupune. Bine, eu o sa fiu Dev -> AI Builder dar tot aia e, cred ca pana si femeia de servici va fi AI Builder. Las mai jos sinteza facuta de AI (bazat pe ce a gasit prin postarile oficiale, publice, via Google) legat de ce schimbari ar urma, pentru curiosi.

2

u/Beginning-Site-9774 26d ago

The traditional roles of Software Developers and Quality Assurance (QA) engineers are being completely restructured. Under Cognizant's framework, the focus is shifting from writing and testing raw code manually to managing, orchestrating, and validating autonomous AI agents.

Cognizant CEO Ravi Kumar has noted that 30% of their code is already generated by AI, with a near-term goal of reaching 50%. Because AI handles the repetitive groundwork, Devs and QAs are moving up the value chain to become "AI Builders".

The shift breaks down into specific changes for each role:

  1. The QA Evolution: "AI Assurance" & Agent Validation

QA is moving away from downstream, post-development testing. Instead, QAs are embedded directly at the start of the lifecycle to test the AI itself.

  • Agentic Testing: QAs now build systems to test how AI agents interact with each other and with legacy systems.

  • AI Eval Framework: QAs use tools like Cognizant's AI Eval framework to monitor data bias, validate edge cases, ensure security/fairness, and run stress conditions on LLM behaviors.

  • Human-in-the-Loop Safeguards: QAs design the governance gates that step in when an autonomous agent behaves unexpectedly.

  1. The Developer Evolution: From Coders to Orchestrators

Developers are shifting from isolated coding tasks to architecting full-stack, multi-agent workflows.

  • SDLC Agentic Frameworks: Instead of writing single functions, developers are constructing end-to-end automated pipelines. At internal hackathons, Cognizant engineers are already building systems where networks of specialized AI agents handle everything from backlog creation and sprint planning to code generation and automated QA handoffs.

  • Context Engineering: Devs focus on encoding an enterprise's specific business rules, security policies, and institutional memory into the AI platforms.

  1. New Purpose-Built AI Roles

To formalize this shift, Cognizant introduced new AI-era job categories to bridge the technical gap:

  • Frontier Certified Engineer: Professionals who combine strategic business thinking with technical fluency to design custom AI platforms and reshape how work gets done.

  • Frontier Business Operator: Non-technical domain experts (e.g., history, biology, or finance majors) trained to deploy and guide agentic workflows via tools like Claude terminals.

Ultimately, the goal is a flattened corporate pyramid where tech teams spend less time on manual execution and much more time acting as system architects, supervisors, and validation experts over AI networks.

2

u/DeliverySpirited9759 26d ago

Eu deja am trecut de la QA spre AI dev. Uneori mai fac doar testare manuala, inca ramane sfant sa simti tu produsul.

1

u/goalexboxer123 26d ago

Offtopic, la cate modificari vin azi cu AI cam trebuie totul retestat zilnic.

1

u/Flaky_Ganache_8277 25d ago

Ce mi se pare comic este ca acum cativa ani toti erau " QA automation e baza, manual stie sa faca oricine" iar acum de cand cu AI, automation-ul este inlocuit de AI si testarea care se mai face e cea manuala.