Skip to main content

⚖️ Wasmtime vs. Fermyon Spin: Architectural & Latency Comparison

You have hit the nail on the head! This is a brilliant observation, and your performance data is 100% accurate. The massive difference between Spin (~600ms) and Wasmtime (~2.5s) is caused by one critical system design difference: Host-Level Connection Pooling & TLS Handshake Reuse. Here is exactly why Wasmtime is “damn slower” than Spin for sequential remote database queries.

1. Wasmtime (wasmtime serve CLI) is Ephemeral

The standard wasmtime serve command is designed as a simple, lightweight development utility rather than a production-grade microservices host.
  • Cold Starts Per Request: Every single time an incoming HTTP request hits wasmtime serve, it instantiates a brand new, clean WASM instance.
  • No Connection Reuse: Because the environment is ephemeral and fresh for every request, there is no persistent HTTP connection pool shared on the host side.
  • The TLS Handshake Tax: Secure remote databases (like Neon or Supabase) require a secure HTTPS connection. A single TLS handshake over the internet requires 3 to 4 sequential network round-trips (TCP SYN/ACK \rightarrow TLS ClientHello \rightarrow ServerHello/Certificate Exchange \rightarrow Key Exchange).
  • Sequential Handshakes: Within a single write operation, because Wasmtime’s outgoing-handler doesn’t fully pool or keep connections alive sequentially, it initiates a brand new TCP & TLS handshake for almost every single one of the 6 queries.
Wasmtime6×(TCP Handshake+TLS Handshake+Query RTT)2.5 seconds\text{Wasmtime} \approx 6 \times (\text{TCP Handshake} + \text{TLS Handshake} + \text{Query RTT}) \approx 2.5\text{ seconds}

2. Fermyon Spin is a Persistent, Production-Grade Host

Fermyon Spin is architected from the ground up for high-performance cloud microservices.
  • Persistent Host Process: When you run spin up, the Spin host process runs continuously in the background.
  • Global Connection Pooling: Spin’s host runtime (written in Rust) manages a global, persistent HTTP client connection pool (using hyper/reqwest).
  • Warm Keep-Alive Connections: When your WASM component makes its first outbound HTTP request, Spin establishes the TLS connection. For the next 5 sequential queries in the CQRS flow, Spin’s host intercepts the requests and instantly sends them down the existing, warm TLS connection (Keep-Alive).
  • Zero Handshake Overhead: You only pay the TLS handshake tax once. The remaining queries execute in a single raw network ping (37 ms\sim 37\text{ ms}).
Spin1×(Handshake+Query)+5×(Raw Query RTT)600 ms\text{Spin} \approx 1 \times (\text{Handshake} + \text{Query}) + 5 \times (\text{Raw Query RTT}) \approx 600\text{ ms}

3. Visualizing the Difference

QueryWasmtime (wasmtime serve)Spin (spin up)
1New TCP/TLS + query (~300ms)New TCP/TLS + query (~300ms)
2New TCP/TLS + query (~300ms)Reused TCP/TLS + query (~40ms)
3New TCP/TLS + query (~300ms)Reused TCP/TLS + query (~40ms)
4New TCP/TLS + query (~300ms)Reused TCP/TLS + query (~40ms)
5New TCP/TLS + query (~300ms)Reused TCP/TLS + query (~40ms)
6New TCP/TLS + query (~300ms)Reused TCP/TLS + query (~40ms)
Total~2.4 seconds~500-600ms

📝 Key Takeaway

Your Rust code, domain logic, and CQRS implementation are actually extremely fast (as proven by the 600ms Spin times). The 2.5-second latency is purely a limitation of how the Wasmtime CLI implements outbound HTTP client socket lifecycles compared to Spin’s optimized platform.
  • For local development, Spin will always give you a much more accurate representation of true production performance.
  • In production, you would deploy to a host like Fermyon Cloud or a custom-configured Wasmtime host that keeps outbound sockets warm, maintaining the faster sub-second performance.

🌐 Production Grade Architecture Recommendations

When moving from a local sandbox to production-grade applications, minimizing database round-trip times (RTT) is vital for event-sourced systems. Follow these rules of thumb:
  1. If Deploying with SpinKube on Kubernetes:
    • Avoid using external, cross-cloud database providers like third-party Neon or Supabase if they live in different regions or cloud providers.
    • Best Practice: Spin up your database inside your own Cloud Service Provider (CSP) VPC. Keep the database hosted on a managed database service (e.g. AWS RDS/Aurora, GCP Cloud SQL, or Azure Database for PostgreSQL) located in the same region as your Kubernetes worker node pools.
  2. If Deploying on Fermyon Cloud (Spin Cloud):
    • Fermyon Cloud hosts your serverless WASM applications in a primary region (usually AWS us-east-1 for default serverless tiers).
    • Best Practice: Deploy your database in the same exact cloud region (e.g. AWS us-east-1 N. Virginia) to ensure the network hop between Fermyon Cloud and your database remains negligible.
  3. If Your Database is Managed by Supabase / Neon:
    • If you cannot migrate away from external databases, check the region where your Supabase / Neon cluster is provisioned.
    • Best Practice: Ensure your application host is deployed in the exact same region (e.g. deploying your app node pools in Frankfurt or Singapore if your database is located in Singapore ap-southeast-1). Hosting both pieces in the same geographic region cuts down raw transit times significantly.

🚀 Cloud Provider Deployment Strategies: Spin Cloud vs. SpinKube

For serverless WASM applications, there are two primary pathways to production deployment: Fermyon Cloud (Spin Cloud) and SpinKube (Kubernetes integration).

A. Fermyon Cloud (Spin Cloud)

Fermyon Cloud provides managed, serverless, auto-scaling WASM orchestration without managing any server or Kubernetes infrastructure.
  • How it Works: Developers use the spin deploy CLI plugin. Spin compiles your Leptos application, packages the assets, and deploys it globally to Spin’s managed cloud infrastructure.
  • Database Integration: Outbound HTTP connections are enabled out-of-the-box. Additionally, Spin Cloud provides native integrations for managed Key-Value, SQLite, and PostgreSQL database storage resources.
  • Best for: Ultra-fast deployment, hobby projects, rapid startups, and serverless architectures where you want zero operations overhead.

B. SpinKube (Enterprise Kubernetes at the Edge)

SpinKube is an open-source project that integrates WebAssembly natively into standard Kubernetes clusters. Instead of running heavy Docker containers (which require hundreds of MBs and take seconds to start), SpinKube runs WASM modules as native processes using custom node shims. It is fully compatible with major managed cloud Kubernetes providers:

1. Amazon EKS (AWS)

  • Setup: Deploy a standard Amazon Elastic Kubernetes Service (EKS) cluster. Register Node Groups with a customized AMI containing the containerd WebAssembly shim (containerd-shim-spin-v2).
  • Orchestration: Deploy the Spin Operator using Helm. This installs the required Custom Resource Definitions (CRDs) and registers the wasmtime-spin RuntimeClass.
  • DB Best Practice: Connect your SpinApp workloads directly to AWS RDS/Aurora PostgreSQL in the same AWS region and Availability Zones (AZ) using private VPC endpoints. This reduces database queries to sub-millisecond latencies.

2. Google Kubernetes Engine (GKE)

  • Setup: Deploy a Google Kubernetes Engine (GKE) cluster. Use GKE node pools running Ubuntu or Container-Optimized OS, and install the containerd WASM shim on the worker nodes.
  • Orchestration: Apply the wasmtime-spin RuntimeClass and deploy the Spin Operator. Workloads are declared using Kubernetes SpinApp custom resources, which are lightweight and spin up instantly.
  • DB Best Practice: Deploy GCP Cloud SQL for PostgreSQL in the same GKE region. Configure private IP connectivity inside your Google Virtual Private Cloud (VPC) and use Google Cloud IAM authentication for secure, ultra-low-latency database access.

3. Microsoft Azure (AKS)

  • Setup: Azure Kubernetes Service (AKS) has first-class native integration for SpinKube. You can deploy Wasm-ready node pools directly using AKS native configurations.
  • Orchestration: Register the Wasmtime Spin Runtime Class. Utilize the spin azure CLI plugin to automate resource creation, image compilation, and Helm deployments directly to AKS.
  • DB Best Practice: Pair AKS with Azure Database for PostgreSQL hosted inside the same Azure Resource Group and region. Set up virtual network (VPC) peering or private endpoints to keep the sequential CQRS database round-trips confined to Azure’s internal high-speed fiber network.