Insiders LLM Bench­mar­king Mai 2025

    Published: June 10, 2025

    Last update: September 16, 2026

    With Insiders LLM Benchmarking, we—as AI experts—keep a close eye on the world of LLMs, compare the highest-performing models, and provide our clients with reliable guidance through the fast-paced LLM landscape.

    Insiders LLM Benchmarking is entering its next round: Building on the first comprehensive performance comparison, we have further refined our methodology and introduced new dimensions. While the first benchmarking focused primarily on pure performance in the areas of information classification and extraction, we now also take into account speed, data protection, and relative cost structure—critical criteria for productive use in the IDP environment.

    What does LLM benchmarking at Insiders entail? The benchmarking was based on a standardized IDP dataset containing real documents from the insurance and financial sectors —including a new use case: claims settlements. This ensures that the results are directly applicable to our customers’ needs. Our AI experts regularly analyze and evaluate the top-performing models in the rapidly changing global technologymarket and identify the LLMs that are best suited for the data-to-process domain.

    Insiders’ LLM benchmarking is an ongoing process that drives the best-of-breed approach. This enables Insiders to stay on top of the performance of the latest LLMs and ensure that its customers always use the best possible solution for their needs through the flexible LLM integration of the Insiders OvAItion Engine. This enables AI to be used effectively and securely within the enterprise.

    The new benchmarking also shows that the question of “the best LLM” is not a black-and-white issue. Performance alone is not enough. In highly regulated industries such as insurance and finance, reliability, data protection, and integration capabilities are particularly important.

    For specific use cases, Insiders’ AI experts offer in-depth consulting for your company. We’d be happy to include your data in an upcoming industry-specific benchmarking study. Simply reach out to our Insiders AI experts.

    Benchmark my use case