A place for my tech stuff

In this part of the MiWaitWay series, we will improve GTFS-rt (real-time) vehicle location ingestor reliability using Write-Ahead-File (WAF) and Sentry monitoring. [Read More]

In this part of the MiWaitWay series, I transform raw data loaded in the previous article so that it can be used with BigQuery’s powerful GEOGRAPHY functions. [Read More]

In this part of the MiWaitWay series, I will describe how I loaded data from the MiWay website into BigQuery. [Read More]

In this part of the series, I want to share how I imagine data flowing throughout the BigQuery in the MiWaitWay project. [Read More]

In this part of the MiWaitWay series, I focus on configuring Apache Airflow to consume as few resources as possible and deploy it to a small VM on Google Cloud. In addition, I need to leave some resources for a web app that will host a dashboard/map showing the average... [Read More]