BroadOakData.UK

A personal website related to data processing and data pipelines using latest technologies.

Spark
Flink
Kafka
Hudi
IceBerg

I enjoy solving complex data integration and data migration problems.

Latest blogs

Using Apache Flink to process data from Kafka and MySQL database

Jan 10, 2024

—

by

broadoakdata

in articles
Using Apache Flink to process apache web log files

Jan 2, 2024

—

by

broadoakdata

in articles
Migrate WordPress to Drupal

Dec 31, 2023

—

by

broadoakdata

in articles
Read data from and write data to Kafka using PySpark

Dec 31, 2023

—

by

broadoakdata

in articles
Apache Spark UI and key metrics

Dec 20, 2023

—

by

broadoakdata

in articles
Take extra care when processing CSV file using Apache Spark

Dec 19, 2023

—

by

broadoakdata

in articles
Streaming data processing using Apache Kafka and Flink

Dec 8, 2023

—

by

broadoakdata

in articles
Quick look at Apache Flink

Dec 6, 2023

—

by

broadoakdata

in articles
Welcome to the world of Generated AI and LLMs

Nov 21, 2023

—

by

broadoakdata

in articles
Google Earth Engine and Geospatial analysis

Oct 3, 2023

—

by

broadoakdata

in articles