Enhancing Sales Meeting Analysis with Advanced LLM-powered Pipeline

Metal Trading Company

A leading metal trading company in Latin America faced significant challenges analyzing its sales meeting minutes. The company aimed to derive valuable insights from highly unstructured data to drive business decisions. As their trusted LLM partner, we gathered the requirements, designed the architecture, and implemented a comprehensive solution.

The project objective was to provide a solution for analyzing unstructured meeting minutes from sales meetings to gain insights into sales volumes, complaints, and salespeople performance.

01

Challenges

1. Unstructured Meeting Notes

The sales meeting notes are in Spanish and highly unstructured. Each salesperson had a unique style and described different events and issues, making it challenging for other people involved in the process (e.g., the managers) to extract consistent information.

2. Lack of Comprehensive Sales Operations View

In order to improve sales processes and grow the organization, it was crucial for the business users to have a 360-degree view of sales operations, including details on salespeople, product performance, sales volumes, and complaints. Such a view would allow for cross-analysis between the accounts and trend-capturing. However, it required structuring data coming from different sources, following different patterns, and written in different languages.

3. Quick Summary Generation

While instant answers were not required, it was important to avoid user frustration and present summaries based on the gathered data in seconds rather than minutes.

4. Entity Disambiguation

Many ambiguities related to people’s names and company-specific acronyms made it difficult to analyze data and make data-driven decisions. It was crucial to ensure that the LLM understood all these ambiguities and that the entities mentioned in queries corresponded to the correct entities.

5. Ensuring Efficiency and Speed

The whole process of processing queries, retrieving information generating the response by AI, sending it to API, and presenting information to the user is quite a complex process. However, it was crucial to optimize its performance to the limits.

02

Solutions

Our approach to addressing these challenges involved three major steps:
1. Data Ingestion Pipeline

We built a robust data ingestion pipeline using GPT to extract predefined entities from the raw text. These entities included people, prices, products, places, and companies. The goal was to identify and label these entities properly for further processing.

2. Entity Linking and Disambiguation

The next step was developing an Entity Linking/Disambiguation pipeline. This involved cross-checking recognized entities against a knowledge base to ensure accuracy. The knowledge base comprised entity names, categories, definitions, and sample usage to determine the correct entities. Our approach included several low-cost filtering steps, such as:

  • Category Matching: Initial narrowing down of search results based on entity categories.
  • Fuzzy Matching: Further refining search results to match similar entities.
  • Vector Search: Final candidate selection based on the meeting notes’ context and knowledge base definitions.

Human supervision was employed in cases of ambiguity, where no entity scored high, or multiple entities had similar scores. This ensured proper entity marking and provided feedback for further refinement.

3. Natural Language Query Processing

Finally, we enabled users to ask natural language queries, such as “How many meetings did José attend in the past month?” These queries were translated into MongoDB queries, allowing efficient retrieval of structured data from the preprocessed notes. Finally, the answer can be presented to the end user, according to their preferences, in tabular or text format.

Technologies we used
GPT-3.5
Mongo DB
Langchain
Azure
03

Results

The implemented solution gave our client a powerful tool to analyze their sales meeting minutes effectively. Key benefits included:

Improved Data Insights

Users could quickly derive insights from unstructured meeting notes, and get analysis on patterns and trends between clients in terms of prices, sell volume, etc., which enables better decision-making.

Comprehensive Sales Overview

This option allows business users to view detailed information on sales operations, product performance, and complaints, improve offers, and detect the main issues or claims our clients have.

Efficiency and Speed

Summaries were generated in seconds, making it possible for business users to get the information they need within seconds (e.g., during a sales call).

Accurate Entity Disambiguation

Enhanced accuracy in identifying and linking entities, reducing ambiguities.

Conclusion

Implemented solutions successfully transformed the client’s sales meeting analysis process. By leveraging advanced data ingestion, entity linking, and natural language processing techniques, we provided a solution that met their needs and delivered significant value.

Read other case studies

Building a complex generative AI platform from scratch in only 8 months
What's the secret to building a successful generative AI platform (in only 8 months)? Read the case study and and find out!...
Using predictive models to reduce customer churn by more than 20%
Read the case study and learn how to use predictive models to reduce churn by more than 20% and get 10x return on your investment....
Generative-AI-powered maintenance assistant
A generative AI-powered maintenance assistant was implemented to help employees identify root causes and solutions for maintenance challenges...
clutch logoTop Artificial Intelligence Companies 2023
clutch logoTop AI Companies 2023
clutch logoTop Web Developers 2023
clutch logoTop Web Developers 2023