Z.ai GLM-Legal Outscores Rivals on Harvey Legal Benchmark

2 Min Read

According to a report by MarkTechPost, Z.ai has introduced GLM-Legal, a new legal artificial intelligence model built on the GLM-5.3-Flash architecture. In recent evaluations on Harvey’s Legal Agent Benchmark, known as Harvey LAB, GLM-Legal achieved a 19.2% all-pass score. This performance places it ahead of competing models including Claude Fable 5 and Kimi K3. The model achieved this score at a cost of $0.15 per test, and access to the system is currently restricted to those who submit an application.

Legal agent benchmarks are increasingly used to evaluate how well artificial intelligence models can handle complex, multi-step legal tasks and reasoning. Unlike general-purpose benchmarks, domain-specific tests like Harvey LAB measure practical execution in legal workflows, such as document review, contract analysis, and legal research. Z.ai’s performance indicates a significant jump over its base model, coming in at nearly three times the capability measured by the same benchmark.

Unknowns and Future Access

Despite the benchmark results, several details about the deployment and full capabilities of GLM-Legal remain unannounced. The announcement did not specify the exact criteria for application approval, nor did it disclose when or if broader availability would be granted. Furthermore, public details regarding the exact parameter count, training data, and broader legal task breakdown beyond the headline score were omitted from the initial disclosure.

Observers will need to watch for future updates from Z.ai regarding application response times and wider access tiers for the legal sector.

Lead image: Moe Magners / Pexels

Share This Article