Programmers.ai Transforms Video Curation Website with Custom AI Features
About the Client
A non-profit technology organization focused on transforming how people learn through the integration of AI in written content and video-based instruction. Their goal is to allow people to learn more quickly than ever before using a human-led, AI-assisted approach to synthesizing data and oral content. They are currently developing their own Learning Model and regularly share product updates.
- Industry: Technology
- Headquartered: Los Angeles, CA
- Platforms: Python, Whisper API
- Team Size: 4
The Challenge
The client hired our team to help develop a video curation blog that compiles and organizes sermon videos from across the web. This site would require advanced features such as the ability to categorize, annotate, subtitle, and provide easy access to bible verses quoted in the uploaded videos.
In addition to these features, the client was having issues with OpenAI’s Whisper AI manually uploading videos. Whisper AI’s 25mb limit was insufficient for gathering the various church services due to video length (40 minutes to 4 hours).
Our team would also need to develop an AI-powered application that could identify Bible verses (both exact and partial), reduce their current reference annotation time from an average of 10 hours per video, and greatly reduce manual effort spent per upload.
Our Solution
Here’s how we solved the client’s challenges:
Website Development
Before developing the advanced video features, our team collaborated with the client’s team to begin building the website. This approach aimed to establish a secure and well-performing foundation for the AI features that would need to be implemented later.
Batch Transcription
For large videos that couldn't be uploaded automatically via Whisper AI, our team converted the videos into audio format and split them into 25 MB chunks for transcription. Using parallel processing, they were able to split and merge the chunks with corrected text and timestamps during the uploading process. This reduced the annotation time from 10 hours to < 1 hour.
Reference Extraction
We created a custom prompt with Open AI's GPT-4o model to extract Bible references, achieving ~99% accuracy for exact quotes and ~85% for partial quotes. Alternative methods such as RAG and Levenshtein distance were tested but ultimately discarded due to lower accuracy.
AI Pipeline
We built a custom NLP pipeline for Bible verse detection, fine-tuned with regex and semantic matching for improved accuracy and timestamping. The frontend connects to WordPress via REST APIs, with Python backend services processing video content. It supports YouTube and local MP4s, displaying verses dynamically during playback.
Fine Tuning
Our team collaborated closely with the client to integrate the custom intelligent application into their newly developed website. After a successful integration, we worked to continuously fine tune the application for greater speed, flexibility, and accuracy.
Technologies Used
Our software architects and engineers are experts in using the latest technologies.
-
Python
-
YouTube API
-
RapidAPI
-
Whisper API
-
GPT-4o
Business Impact
By automating verse extraction and syncing during upload, the client's platform became more engaging and scalable.
200% increase in content upload speed
75% reduction in manual effort per video
Here’s how we did it
-
Increased Video Size Limit
With batch processing and parallel audio/video processing.
-
Reduced Manual Effort
Through automating the processing and integration of new videos.
-
Enhanced Accuracy
By developing and fine-tuning purpose-built features for the website.
Other Case Studies
Revolutionizing Customer Financing with Advanced OCR Technology for Personalized, Real-Time Quotes a...
Custom AI Chatbot Reduces Daily Customer Support Workload by 80%
I wanted to take a moment to highlight and commemorate the efforts from our dedicated PIO team. To preface, the projects we work on here are complex, with rigid objectives, budgets, and timelines. Expectations are always high and are ever-changing. From the start of our relationship, the IO team was able to exceed expectations and make our business wishes a reality.
Over the past year I have worked with them, they have worked very hard to understand our highly customized system and troubleshoot things with little or no documentation while managing to keep the business up and running normally. Without the hard work and dedication they have shown, I know we would have had some issues causing downtime or lost production. I am looking forward to continuing working them in the next year as well.
I have been working with Programmers IO for more than 5 years now and I have been pleased with all projects and developers that I have worked with. We have had a few issues here and there but they have always fixed and made it right. They have been an excellent addition to our business.
Let’s Build Your AI-Readiness Roadmap Together
Contact us for a free strategy session with our experts.
Talk to an AI Expert
