File-based Incremental Loading — A Practical Approach with MS Fabric, dltHub, MotherDuck & PythonContext9h ago9h ago
Ditch the Overhead: Metadata-Driven Data Transformation with DuckDB & Polars in Microsoft FabricContextFeb 13Feb 13
Addressing Data Transformation Challenges: A Strategic Initiative in MS FabricThrough extensive experience working with diverse consulting clients and teams, I have observed a recurring pattern: the use of multiple…Feb 12Feb 12
Event-Driven Data Ingestion with Microsoft Fabric & dltHub — No More Scheduling Hassles!Data teams often face the challenge of not being able to directly connect to data sources, forcing raw data to be pushed to landing zones…Feb 11Feb 11
Setting up ingestion with MS Fabric, dltHub, and LakehouseThis is the first part of a six-part series on building end-to-end analytics in Microsoft Fabric — without Spark.Feb 4Feb 4
From RTBF to Delta Tables: A Modern Approach to PII in Data EngineeringHandling PII (Personally Identifiable Information) is a critical responsibility in data engineering, especially to comply with GDPR and…Jan 27Jan 27
How to build end to end analytics in Microsoft Fabric using dltHub and duckdb without sparkMicrosoft Fabric is an end-to-end data analytics platform that unifies data engineering, integration, warehousing, science, and business…Jan 211Jan 211
dltHub + Edge Analytics + AI Agents = Factory of the Future!I recently explored how dltHub can revolutionize IIoT edge analytics — and the immense possibilities! Being a huge fan of DuckDB , I…Jan 7Jan 7
How I used RAG, AWS Bedrock, dltHub and Pinecone to Explore UK Property DataI recently started exploring the idea of building an AI agent focused on UK government property datasets. This stemmed from an evening…Dec 30, 2024Dec 30, 2024
