Technology
  • Industry: Technology
  • Headquartered: Los Angeles, CA
  • Team Size: 4
the_client

The Client

A non-profit technology organization focused on transforming how people learn through the integration of AI in written content and video-based instruction. Their goal is to allow people to learn more quickly than ever before using a human-led, AI-assisted approach to synthesizing data and oral content. They are currently developing their own Learning Model and regularly share product updates.

The Challenge

The client hired our team to help develop a video curation blog that compiles and organizes sermon videos from across the web. This site would require advanced features such as the ability to categorize, annotate, subtitle, and provide easy access to bible verses quoted in the uploaded videos.

In addition to these features, the client was having issues with OpenAI’s Whisper AI manually uploading videos. Whisper AI’s 25mb limit was insufficient for gathering the various church services due to video length (40 minutes to 4 hours).

Our team would also need to develop an AI-powered application that could identify Bible verses (both exact and partial), reduce their current reference annotation time from an average of 10 hours per video, and greatly reduce manual effort spent per upload.

The tech we used for our solution

Our software architects and engineers are experts in using the latest technologies.

  • Python
    Python
  • YouTube API
    YouTube API
  • RapidAPI
    RapidAPI
  • Whisper API
    Whisper API
  • GPT-4o
    GPT-4o

The Solution

Here’s how we solved the client’s challenges:

Website Development

Before developing the advanced video features, our team collaborated with the client’s team to begin building the website. This approach aimed to establish a secure and well-performing foundation for intelligent applications that would need to be implemented later.

Batch Transcription

For large videos that couldn’t be uploaded via Whisper API, our team converted the videos into audio format and split them into overlapping 25 MB chunks for transcription. Using parallel processing, they were able to simultaneously split and merge the chunks with corrected text and timestamps during the uploading process. This reduced the annotation time from 10 hours to less than an hour, as well as enabled the use of automatic subtitles and summary generation for each video.

Reference Extraction

We created a custom prompt with Open AI's GPT-4o model to extract Bible references, achieving ~99% accuracy for exact quotes and ~85% for partial quotes. Alternative methods such as RAG and Levenshtein distance were tested but ultimately discarded due to lower accuracy.

Fine Tuning

Our team collaborated closely with the client to integrate the custom intelligent application into their newly developed website. After a successful integration, we worked to continuously fine tune the application for greater speed, flexibility, and accuracy.

Our Team Built a Custom Intelligent Application

To substantially reduce manual processing time for a new, cutting-edge website.

  • billing-cycles

    Up to 95% reduction in annotation time

  • billing-cycles

    99-100% direct bible quote detection accuracy

Here’s how we did it

  • Increased Video Size Limit

    With batch processing and parallel audio/video processing.

  • Reduced Manual Effort

    Through automating the processing and integration of new videos.

  • Enhanced Accuracy

    By developing and fine-tuning purpose-built features for the website.

we-did-it

Client Testimonials

Our clients share their experiences with our developers. Reach out to a platform trusted by businesses seeking quality over quantity.

  • Over the past year I have worked with them, they have worked very hard to understand our highly customized system and troubleshoot things with little or no documentation while managing to keep the business up and running normally. Without the hard work and dedication they have shown, I know we would have had some issues causing downtime or lost production. I am looking forward to continuing working them in the next year as well.

    ‐ Information Technology Supervisor
  • I wanted to take a moment to highlight and commemorate the efforts from our dedicated team. To preface, the projects we work on here are complex, with rigid objectives, budgets, and timelines. Expectations are always high and are ever-changing. From the start of our relationship, the IO team was able to exceed expectations and make our business wishes a reality.

    ‐ Project Manager
  • I have been working with this team for more than 5 years now and I have been pleased with all projects and developers that I have worked with. We have had a few issues here and there but they have always fixed and made it right. They have been an excellent addition to our business.

    ‐ Director Of Development
video-testimonials
Ken Stewart, PMP, CSM

Vice President Of Operations & Engineering

PSIGEN Software INC.

video-testimonials
Brandy Churchill

Software Development Manager

Western National Insurance

video-testimonials
Jackie Flummer

Director, Technical Business Systems

AmerCareRoyal

Build Your Team Today.

Find out how Programmers.ai can help your business get to the next level.

Risk Free! We guarantee you’ll be happy after 30 days or we won’t invoice you.

  • 1000+Qualified Developers
  • 2000+Projects Delivered
  • 480+Happy Customers
  • 63%YOY Growth
  • 12+Years in Business