Distributed Systems group project

Apache Flink Code Examples

Trying out some big data technologies

Projeto de BigData Mestrado Mackenzie

This project aims to predict the delays on the Yellow taxi dataset, by implementing an application based on Apache Flink.

A Reliable Benchmark Framework for Streaming Systems. This is an instrumentation tool based on DS2, Flink and NEXMark in order to evaluate the performance of streaming systems.

Includes examples for Apache Flink

Distributed Random Forest in Apache Flink

Stream processing of AIS data with Flink

🚖 TLC 데이터를 이용한 택시요금 예측 실시간 파이프라인

Prink (Privacy-Preserving Flink) is a data anonymization solution for Apache Flink, that provides k-anonymity and l-diversity for data streams.

Flink Example

Docker packaging for Apache Flink

Apache Flink Aggregation job

Demo 2020

This project focuses on building a real-time streaming pipeline using Apache Flink and Apache Kafka. The goal is to enrich checkout data with user information, identify the first click leading to a checkout, and log the attributed checkouts into a Postgres sink table. The project implements concepts like state management, time attributes, watermark

Apache Flink simple word count job

Using Apache Flink to write to s3 in Apache Iceberg format

installs packages from https://archive.apache.org/dist/