Overview Execute Jupyter notebooks locally in VS Code while leveraging Databricks compute infrastructure. Your code runs on Databricks’ serverless compute, but you edit and manage files locally—giving you the best of both worlds: local development experience with cloud compute power. Prerequisites Setup Steps 1. Install VS Code Extension 2. Let...
Continue reading...Data Science
Markmap: Convert Markdown to Interactive Mindmaps
What is Markmap? Markmap is a simple yet powerful tool that transforms markdown files into interactive, visual mindmaps. It eliminates the need for complex mindmapping software—just write markdown, and Markmap handles the rest. The result is a beautiful, interactive HTML visualization that you can share or embed. Why Use Markmap?...
Continue reading...LaTeX on Ubuntu ARM: Quick Setup & Reference Guide
A streamlined guide to setting up LaTeX on Ubuntu ARM servers and using it with VS Code What is LaTeX? LaTeX (pronounced “LAH-tech” or “LAY-tech”) is a high-quality typesetting system designed for the production of technical and scientific documents. Unlike traditional word processors like Microsoft Word, LaTeX uses a markup...
Continue reading...The Powerful COPY Command in DuckDB / MotherDuck: A Quick Reference Guide
The COPY command in DuckDB and MotherDuck is a versatile tool for importing and exporting data. This guide provides a concise overview of how to use COPY both from the DuckDB CLI (SQL only) and from Python, including workflows with Ibis and pandas. Use this as a quick reference for your data engineering tasks!...
Continue reading...Building a Complete DuckLake Solution: From Local Development to Cloud Production
Introduction DuckLake is revolutionizing the lakehouse architecture by combining the simplicity of DuckDB with the power of modern data lake formats. In this comprehensive guide, I’ll walk you through building a complete DuckLake solution in two parts: first creating a local development environment, then scaling it to a cloud-based production...
Continue reading...