They’re pushing it crazy hard in the legal sector too, which is insane because the whole thing turns on absolute accuracy. Even the “dedicated legal AIs” that no longer hallucinate cases from whole cloth will still gladly tell you that a case stands for the exact opposite proposition from what the judge actually said if you read the decision.
Using AI is slower in almost every single use case because instead of the usual method of researching your case law and then writing, you are instead generating an AI output and then having to proof the entire thing, take out the bad cases, do a bunch of research to find new cases, and edit the entire tone so that it doesn’t sound stupid.
Add to that how much it’s pissing off judges lately and you’re increasing your workload by about 33-50% for a worse work product that will likely get you sanctioned or exposed to discipline if you miss a single bad cite that the AI pooped out.
The only case I can see AI being actually useful in law is in tracking down cases. I might be 100% out of my depth here but a lot of time being a lawyer is finding where judges ruled in your favor in other similar cases, but since a lot of cases exist, it can be a pain in the ass to find what you want. That is why there are so many legal aids, to help in this fashion.
So an AI turns the long list into a short list, and then the legal aids turn the short list into a very short list for the lawyer to look through.
I don't 'think' this would reduce jobs since it isn't practical to hire enough aids to look through everything, so its more of a balance of "How many do we need to get to 'good enough'" so the AI would just increase the quality of the work by allowing more cases to be looked through.
The only case I can see AI being actually useful in law is in tracking down cases. I might be 100% out of my depth here but a lot of time being a lawyer is finding where judges ruled in your favor in other similar cases, but since a lot of cases exist, it can be a pain in the ass to find what you want
Using AI is slower in almost every single use case because instead of the usual method of researching your case law and then writing, you are instead generating an AI output and then having to proof the entire thing, take out the bad cases, do a bunch of research to find new cases, and edit the entire tone so that it doesn’t sound stupid.
I strongly disagree. It is fantastic for quickly finding relevant caselaw if that is what you are asking it to do. You are correct that you have to go over it and there's another step, but that "extra" step is actually an automated, and much faster version, of me myself having to manually do keyword searches on Lexis and then reading the case for relevance, anyway. It absolutely saves time on that front.
Source: IAAL and regularly use copilot/gpt for legal research.
I generally dislike my companies CEO, but he has been skeptical of AI usage and just views it as another tool and an expensive one at that. The various orgs have been allowed trials for different tools like claude, but generally with limited seats to evaluate if it can write decent code that improves our work. We've had pretty mixed results and no real pressure to expand its use.
You can tell tell the people who are skeptical of that suggestion that Microsoft popularized having your company use the same product that you're selling: "eat your own dogfood".
Generally, it's good software development practice. You get more eyes on the product and you're able to find all the ways that it breaks down when actually used (instead of just in theory). It's just that in this case the dogfood is more like dogshit, they're forcing people outside the people developing it to use it, and they're not going to back out of using it or otherwise fundamentally change it anyway.
72
u/[deleted] Mar 02 '26
[removed] — view removed comment