Published inTASK GroupReshaping Data Engineering at PlexureIn technology, it is very common to see companies shifting focus back and forth between delivery and foundational work. The former makes…Dec 6, 20223Dec 6, 20223
Team leadership for technical backgrounds: does it work ?Does having line management responsibilities work for tech-driven people ?Nov 9, 2021Nov 9, 2021
Published inTowards Data ScienceIntroducing a Dataflow Management System Backed Up by Prefect, AWS, and Github ActionsApr 26, 2021Apr 26, 2021
Published inTowards Data ScienceReal-time analytics in the aviation industry - Part 2: leveraging Kinesis Analytics for SQLHow Kinesis Analytics for SQL fits into our Data Pipeline and what challenges we faced with itJan 20, 20211Jan 20, 20211
Published inTowards Data ScienceReal-time analytics in the aviation industry — Part 1At Spidertracks we work to help make aviation safer by providing real-time aircraft tracking as well as transforming flight data into…Jan 13, 2021Jan 13, 2021
Workflow Automation: Empowering teams through our in-house, self-service frameworkA Workflow consists of steps, configured to respect a predefined order and accomplish a specific business objective. They vary from…Jun 22, 20201Jun 22, 20201
Building a Kafka playground on AWS — Part 3: Streaming database events and querying with KSQLThis is Part 3 of this blog series and we are now going to make use of the architecture described on Parts 1 and 2 to stream database…Mar 2, 2020Mar 2, 2020
Building a Kafka playground on AWS — Part 2: The AWS ArchitectureThis is part 2 of my blog series about building a Kafka playground on AWS. If you missed part 1 please check this.Feb 24, 2020Feb 24, 2020
Building a Kafka playground on AWS — Part 1: Setting the FoundationAs part of my recent studies I decided to explore Apache Kafka. Kafka is an open-source streaming platform used to collect/analyse high…Feb 17, 20203Feb 17, 20203
Published inTrade Me BlogSnowflake: the details of our first Data Warehousing project in the CloudTrade Me, like many companies around the globe, is gradually moving to the public cloud. The countless services and the cost-saving…Jul 29, 20192Jul 29, 20192