Magid empowers its newsroom clients with Galileo

Magid is a leading consumer intelligence & activation provider for brand marketing teams, global and local media brands, and newsrooms. With a strong history of leveraging technology to understand consumer behavior and uncover attitudinal insights, Magid has recently expanded its portfolio with generative AI-powered products. These innovations enable clients to act on insights and streamline essential business workflows.

One notable product, Collaborator Newsroom, acts as an assistant to journalists. Journalists input their original written content, provide guidance, and Collaborator automatically repurposes the content for various communication platforms, such as web and social, all while ensuring brand consistency, journalistic best-practices, and factual accuracy.

CHALLENGE

As Magid built its Collaborator product for newsrooms and media organizations, they faced the challenge of ensuring consistent, high-quality output in an unpredictable environment. The nature of news content can be extremely varied, ranging from sports to local news to international affairs. This makes it extremely difficult to maintain quality, accuracy, and brand consistency when generating content. Errors such as misquotes or misinformation could have significant consequences.

To address this, Magid developed a RAG-based system that provided users with more granular control over Collaborator's outputs. However, they still needed a robust observability layer to monitor and evaluate these outputs for factual accuracy, tone, and format, ensuring they consistently met the stringent standards required by their clients.

Initially, Magid manually reviewed outputs to lay the foundation for their tool. However, to successfully launch their product, they needed a scalable solution. With a growing client base and each newsroom producing 20–30 stories daily—multiplied across local and national newsrooms nationwide—a scalable solution was urgently required.

SOLUTION

To address their need for robust observability of AI-driven workflows, Magid integrated Galileo’s real-time observability capabilities directly into their product ecosystem.

The decision to choose Galileo was driven by three key factors:

• First, Galileo’s focus on real-time production monitoring stood out, as it was specifically tailored for production AI application monitoring rather than pre-production training.
• Second, the out-of-the-box metrics provided by Galileo were highly relevant, allowing Magid to monitor critical aspects like tone, factual accuracy, and format adherence effectively.
• Third, Galileo’s extensibility was a significant advantage, enabling Magid to integrate their own custom-built metrics, tailored by their specialized domain expertise. This, combined with Galileo’s flexible tagging system, allowed Magid to track and share detailed metrics with their clients, seamlessly aligning with the operational needs of their newsrooms.

Drawn to Galileo’s consistent output quality, Magid uses Galileo as part of their workflow acceleration strategy for clients, to ensure and mitigate incorrect outputs that are critical in journalistic workflows.

RESULTS

With Galileo, Magid has achieved complete visibility over all AI inputs and outputs, providing a solid foundation for further customization and refinement as they scale. This visibility allows Magid to track usage patterns, identify trends, and seamlessly share insights with clients. Additionally, Magid is now developing custom metrics tailored to the unique needs of each client, such as quickly identifying and mitigating "direct-quote hallucinations." The team also plans to leverage these metrics to block hallucinations and misinformation in real-time using Galileo Protect.

Equipped with Galileo, Magid is empowering newsrooms across the country to deliver accurate trustworthy news faster.

"You can't deploy an AI application in a critical production workflow, like a newsroom, without a dependable real-time trust layer. Galileo has become that essential layer, providing us with real-time insights into crucial metrics."

Alberto Melgoza

CTO