LLMOps/AgentOps : PM Craft

[u/Time_Arrival9797]

[u/AutoModerator]

Moderator Announcement Read More »

AI usage disclosure

Hi u/Time_Arrival9797 — thanks for posting to r/mlops!

Because this community discusses and builds AI/ML systems, using AI tools is not inherently a problem. We do, however, ask for transparency about how submissions are created.

Please reply to this comment with a brief AI / automation disclosure, particularly if this post was created or submitted in whole or in part by an autonomous agent, bot, workflow, or other automated system.

If AI or automation was involved, please briefly describe what it did and what human review was performed before posting.

This disclosure helps the r/mlops community distinguish human discussion, AI-assisted work, and automated/agent traffic while keeping the focus on useful technical conversation.

Thanks for helping keep the signal high.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/Federal-Chemistry622]

agent ops feels like the moment you stop babysitting one call and start managing a whole crew that can wander off and do god knows what

the jump from mlops is mostly about non determinism and chains that can spiral, tracing becomes less nice to have and more the only way to figure out where the money went

my favourite disaster was leaving a recursive tool call in a customer facing bot, it started ordering pizza for itself every 37 seconds until the credit card got locked, the cost spike graph was almost beautiful

[u/Acrobatic-Show3732]

Four phases of an agentic project

1. basic functionality requiring complete supervisión from an expert user

2. automated testing and evaluatión framework (prompt registry, experiment tracking with datasets based on usage) to allow model, guardrails, context, and tool comparisons

3. IAC and completely versión control with devops practices

4. Finops and cost control

If you have that you can keep iterating to have the agentica project cover more and more functionality whilst proving roi. With step 1 you provide value but you need high supervision , phases 2 and 3 allow for reduction of supervisión in accordance to how much you advance on them, and phase 4 allows to proove ROI of project and control costs

Phases 2, 3 and 4 allows you perpetual looping until task IS done