How I stitched a 3‑stage Entity Resolution pipeline that stopped duplicate KYC alerts in a Bangladeshi fintech
AI-generated illustration Bangladesh, 03:15 am. My phone buzzed. The compliance dashboard lit up with 1,342 new SARs from a single MFS provider. Every one flagged the same name – “Mohammed Rahman” – but with different phone numbers, ID numbers, and addresses. The senior manager stared at me, eyebrows knit. ‘What the heck is happening?’ he asked. My heart hammered. If we didn’t sort this out, the BFIU would slap us with a fine for missing the real suspect hidden behind a mountain of noise. The hidden problem: why the usual deduplication tricks crumble in Bangladesh Most teams lean on a single‑field match – ID number, phone, or email. In Dhaka’s bustling market, a person can hold three SIMs, two passports, and a driver’s licence that changes spelling with every bank. The BFIU’s 100 k BDT threshold for MFS monitoring forces us to capture every tiny transaction. That creates a flood of partial records. A naive join produces thousands of false matches, inflating the SAR count and drowning ...