Want your own private, S3-compatible object storage accessible securely from anywhere? Running MinIO on an always-on Mac Mini combined with Docker and Tailscale is a fantastic solution. This post walks you through setting it up, including navigating a common hurdle when using external drives on macOS with Docker Compose. What...
Continue reading...My Journey: Taming VPN Conflicts and Securing Server Access with Tailscale
Ever found yourself constantly connecting and disconnecting your regular VPN just to SSH into your own server? I certainly did. It was a daily annoyance: fire up the privacy VPN (like ProtonVPN in my case) for general browsing, then disconnect it because my server, secured by firewall rules allowing only specific IPs,...
Continue reading...Installing RedPanda Streaming Data Platform on Oracle ARM Ubuntu 24.04 with Docker and Caddy
Level: IntermediateEnvironment: Oracle Cloud ARM VM, Ubuntu 24.04, Docker, Caddy (non-Docker), Cloudflare Introduction: What is RedPanda and Why Should Analytics Engineers/Data Scientists Care? In the world of data, moving information quickly and reliably is crucial. Enter RedPanda, a modern streaming data platform designed for simplicity and performance. Think of it as a Kafka-compatible alternative, but...
Continue reading...Installing Apache Airflow with Docker and Caddy on Oracle ARM (Ubuntu 24.04)
Running data pipelines often requires a robust orchestrator like Apache Airflow. Setting it up on modern ARM-based cloud infrastructure, such as Oracle Cloud’s Ampere A1 instances, can be efficient and cost-effective. This guide walks you through installing Apache Airflow using Docker Compose on an Ubuntu 24.04 ARM VM, using Caddy...
Continue reading...Installing Self-Hosted Airbyte on Oracle ARM Ubuntu 24.04 with Caddy & Cloudflare
Airbyte is a powerful open-source data integration platform, allowing you to sync data between various sources and destinations. Self-hosting Airbyte gives you full control over your data pipelines. This guide walks through installing Airbyte on an Oracle Cloud ARM Ampere VM running Ubuntu 24.04, making it accessible via a secure...
Continue reading...