Skip to main content

All posts
Benchmarks
Apache Spark
Apache Iceberg
Cost & FinOps
Architecture
Product

Product Solutions Pricing Security Contact Book a Demo

All posts

2026

We Moved Cazpian's Spark Pools to ARM — 2x Faster Under Load
100 Concurrent Spark Jobs, 67 Seconds, One $2/Hour Pool
What a Terabyte Actually Costs: TPC-DS on Cazpian
We Benchmarked Native Query Acceleration on Iceberg — Up to 4.14x, and the Version Number That Almost Fooled Us
The Serverless Black Box: What You Lose on Databricks Serverless Compute
Databricks System Tables: The Observability Gap — What They Expose vs What You Actually Need for Cost Control
How to Profile Spark Jobs After Completion: The Complete Guide to Collecting Metrics on Databricks, EMR, and Dataproc
Iceberg Scan and Commit Fine-Tuning: The Production Operations Guide for Spark
Spark Runtime Metrics Collection with DriverPlugin, ExecutorPlugin, and SparkListener
The Complete Apache Spark and Iceberg Performance Tuning Checklist
Spark Execution Plan Deep Dive: Reading EXPLAIN Like a Pro
Spark OOM Debugging: The Complete Guide to Fixing Out of Memory Errors
Spark Memory Architecture: The Complete Guide to the Unified Memory Model
Spark SQL Join Strategy: The Complete Optimization Guide
Spark JDBC Data Source: The Complete Optimization Guide for Reads, Writes, and Pushdown
Spark Data Skew: The Complete Guide to Identification, Debugging, and Optimization
Spark Caching and Persistence: The Complete Guide for Iceberg and Cazpian
Spark Broadcast Joins: The Complete Guide for Iceberg and Cazpian
Iceberg Metrics Reporting: How to Monitor Scan and Commit Health with Spark
Iceberg Bloom Filters with Spark: Configuration, Validation, and Performance Guide
Storage Partitioned Joins in Apache Iceberg with Spark
Iceberg on AWS: S3FileIO, Glue Catalog, and Performance Optimization Guide
Iceberg CDC: Patterns, Best Practices, and Real-World Pipelines
Writing Efficient MERGE INTO Queries on Iceberg with Spark
Iceberg Backup, Recovery, and Disaster Recovery: A Complete Guide
Iceberg Query Performance Tuning: Partition Pruning, Bloom Filters, and Spark Configs
Iceberg Table Design: Properties, Partitioning, and Commit Best Practices
How Apache Iceberg Makes Your Data AI-Ready: Feature Stores, Training Pipelines, and Agentic AI
Migrating From Hive Tables to Apache Iceberg: The Complete Guide — From On-Prem Hadoop to Cloud Lakehouse
Time Travel in Apache Iceberg: Beyond the Basics — Auditing, Debugging, and ML Reproducibility
Schema Evolution in Apache Iceberg: The Feature That Saves Data Teams Thousands of Hours
Apache Polaris: How Policy-Managed Table Maintenance Eliminates Iceberg Operational Overhead
Mastering Iceberg File Sizes: How Spark Write Controls and Table Optimization Prevent the Small File Nightmare
Why Every Data Company Is Betting on Apache Iceberg — And What It Means for AI
One Engine, Two Access Paths: How Arrow Flight SQL Makes a Single-Engine Lakehouse Possible
Why Your Data Platform Runs Two Engines — And Why That's Costing You
Databricks Classic vs. Serverless vs. Cazpian: The 2026 Compute Cost Showdown
Zero Cold Starts: How Cazpian Compute Pools Cut Your Spark Bills in Half
The Small Job Tax: How Spark Cold Starts Are Silently Draining Your Data Budget
Lakehouse vs Data Warehouse for Multi-Cloud Systems (2026 Guide)

2025

AI Studio for Data Teams
Introducing Cazpian: An AWS-first Lakehouse Platform
Why Apache Iceberg and Spark for Cazpian?

Yangshun Tay

Ex-Meta Staff Engineer, Co-founder GreatFrontEnd

View all authors

This author has not written any posts yet.

The high-performance lakehouse platform for modern analytics, seamless data pipelines, and autonomous AI agents.

Product

Control Plane
Compute Workbench
Iceberg Ops
AI Studio
Pricing

Solutions

Self-Serve Analytics
Platform Consolidation & Cost
Query Federation
Data Products & Mesh
Governance & Compliance
All Solutions

Resources

Documentation
Blog
Architecture
Security

Company

About
Contact
Book a Demo

© 2026 Cazpian. All rights reserved.