---
title: "Autonomous data cleaning, normalisation and deduplication"
description: "CSV and Excel from different sources with different formats (+3630…, 06-30…, 30/…; 2026.03.19, 19/03/2026, March 19). The AI fixes encoding (ISO-8859-2 mangled "
canonical: https://automataaicegeknek.hu/en/workflows/data-analytics/data-cleaning-autopilot
language: en
publisher: Automata AI Cégeknek
updated: 2026-09-19
---

# Autonomous data cleaning, normalisation and deduplication

Category: Data processing, spreadsheets, databases and analytics


CSV and Excel from different sources with different formats (+3630…, 06-30…, 30/…; 2026.03.19, 19/03/2026, March 19). The AI fixes encoding (ISO-8859-2 mangled ő and ű), standardises addresses, tax numbers, IBANs and names, and fuzzy-matches 'Kovács és Társa Kft.', 'Kovács & Társa Kft' and 'Kovacs es Tarsa Kft.' as one partner, merging histories in the CRM and mailing lists.

## How it works

1. Encoding and format repair
2. Standardisation of key fields
3. Semantic deduplication and merge

Tools: Claude, n8n, Supabase

Source: AI Automation Market Report and Practical Guide (2025–2026)