30+
International Air & Sea Carriers Integrated
5
Scraping Methods (JSON, Gateway, Playwright, Selenium, CAPTCHA Bypass)
AI
Audio CAPTCHA Solved Automatically via AssemblyAI
The Problem

Every Freight Carrier Has Its Own Portal: Manual Tracking Across 30+ Is Unmanageable

A single freight tracking API that spans every carrier a forwarder actually uses was missing from the market. Freight forwarding companies need to track shipments across dozens of airlines and shipping lines, each with a completely different tracking interface. Some carriers have clean JSON APIs. Others render tracking data with JavaScript after several redirects. Others are behind Cloudflare with reCAPTCHA or audio CAPTCHA challenges. A few use internal SOAP/XML formats. There was no single system that could query all of them and return standardised tracking data without human intervention.
Our Solution

A Five-Method Freight Tracking API Engine Covering Every Carrier Protection Level

The system is built as a Flask REST API with a dedicated scraper module per carrier, each using the right tool for that carrier's specific protection level. Simple carriers are handled with direct JSON calls with browser-spoofing headers. A gateway handles 15+ airlines via a single POST with the carrier code, with CAPTCHA solving integration for reCAPTCHA-protected variants. Playwright with headless Firefox and rotating proxies handles JS-rendered pages. For one carrier that combines JS rendering and audio CAPTCHA, we built a full automated bypass: Playwright detects the CAPTCHA iframe, captures the audio, submits it to a transcription API, extracts the digit string, and types it into the CAPTCHA input, entirely without human involvement.
Architecture
Flask microservice API (threaded, port 5000). API key authentication. Playwright (headless Firefox) with Webshare rotating proxy pool. Selenium Wire + Undetected ChromeDriver for Cloudflare-protected carriers. aiohttp async HTTP scraping. BeautifulSoup + lxml XPath parsing. 2captcha API for reCAPTCHA v2/v3 solving. AssemblyAI audio CAPTCHA transcription bypass. scraping.narf.ai JS rendering proxy for Hapag-Lloyd. CrawlBase fallback scraper. Fake user agent rotation.
The Result

30+ Carriers, One API Call, Fully Automated Including Audio CAPTCHA Resolution

The client now runs a single integration point covering all 30+ carrier systems in production, replacing a manual process of logging into individual carrier portals with a single authenticated API call per shipment. Every carrier returns the same standardised JSON structure. The audio CAPTCHA bypass eliminated the last manual bottleneck: audio CAPTCHA resolution, which previously required human intervention, is now solved fully automatically in every request. The standardised response format means the client's freight management system displays tracking events from any carrier in the same UI component. Adding new carriers requires only a new scraper module, no client-side updates. If your business needs a similar carrier tracking system built, our team can scope it the same way.
Want scalable architecture and measurable results like this?
Book an Architecture Audit
Build Something Like This
// free scoping call · senior engineers · no commitment

Project scope, timelines, and architecture options in one 45-minute session.

Start a Project
More Work

Related Projects

The Marble Group: Natural Stone Inventory Intelligence Platform for UK Stone Buyers
Django Docker PostgreSQL
The Marble Group: Natural Stone Inventory Intelligence Platform for UK Stone Buyers
Inventory management software development unifying 10 UK stone suppliers in one dashboard: automated price reconciliation, stock alerts, PDF/Excel export.
View Details
Farming Product Monitor: Real-Time Agricultural Price & Stock Intelligence for Pakistani Markets
Django Node.js PostgreSQL
Farming Product Monitor: Real-Time Agricultural Price & Stock Intelligence for Pakistani Markets
Competitor price monitoring tool: instant Discord alerts on price and stock changes across Kissanghar.pk and Syngenta Pakistan, full history, stealth scraping.
View Details
SlateDesk: Film & TV Talent Submission Management, From Public Pitch Link to Structured Deal Pipeline
Django Material UI PostgreSQL
SlateDesk: Film & TV Talent Submission Management, From Public Pitch Link to Structured Deal Pipeline
A talent management platform for film and TV: public submission links, internal pipeline, meeting scheduling, contact management, and Stripe subscription tiers.
View Details