Momento Migrates Object Cache as a Service to Ampere Altra

Momento: Serverless Caching on Ampere-powered Google Cloud

The Challenge: Managing caching infrastructure for cloud applications is complex and time-consuming. Traditional solutions demand significant resources for tasks like replication, failover, backups, and lifecycle management. This operational overhead diverts valuable resources from core business functions and innovation.

Momento's Solution: Momento offers a serverless caching solution built on Ampere-based Google Tau T2A instances. This eliminates the need for manual infrastructure management, providing developers with a fast, reliable cache without the operational burden. Leveraging the Apache Pelikan open-source project, Momento automates resource management and optimization, offering a streamlined API experience.

Key Features:

• Serverless Architecture: No server management required.
• Zero Configuration: Automatic infrastructure optimization.
• High Performance: Achieves a 2ms P99.9 round-trip time for cache requests.
• Scalability: Efficiently handles high loads using multi-threaded storage nodes and core pinning.
• Expanded Services: Includes pub-sub message buses.

Technical Innovations: Context Switching Optimization

Momento significantly improved performance by pinning threads to specific cores and dedicating cores for network I/O. This context switching optimization resulted in over one million operations per second on a 16-core instance.

The Impact: Momento's serverless cache, powered by Ampere-based Google Tau T2A VMs, accelerates development, reduces operational overhead, and delivers a cost-effective, high-performance solution for modern cloud applications.

About Momento: Founded by Khawaja Shams and Daniela Miao (former DynamoDB team members at AWS), Momento aims to simplify commonly used application infrastructure. Their initial focus on caching, leveraging their AWS experience, has expanded to include services like pub-sub message buses. Momento's serverless cache automates the complexities of managing a key-value store, allowing developers to concentrate on building features.

Why Caching Matters: All cloud applications benefit from caching. It's a low-latency store for frequently accessed objects, improving service speed. For websites, this means faster loading times for home pages, images, and popular products. Traditional caching, however, involves managing replication, failover, backups, and upgrades – a significant operational burden.

Ampere's Role: Momento chose Ampere-powered Google T2A instances initially for price/performance benefits and efficiency. The Tau T2A VMs offer predictable high performance and linear scalability, outperforming x86 VMs by over 30%. The migration to Ampere was surprisingly smooth, with minimal adjustments required. Momento appreciates the flexibility of a mixed-mode deployment (Arm64 and x86), ensuring application portability.

Performance Focus: Tail Latencies: Momento prioritizes tail latencies, specifically the P99.9 response time (99.9% of cache calls return within this time). Their goal is a 2ms round-trip time at P99.9, recognizing that even small degradations in response time can significantly impact user experience.

Context Switching Optimization Explained: Context switching, the process of switching between tasks, introduces performance overhead. Momento minimized this by core pinning, dedicating cores for network I/O to reduce interruptions from system interrupts and processor contention.

Getting Started with Momento:

1. Sign Up: Visit Momento's website.
2. Choose an SDK: Select a curated SDK for your programming language.
3. Create a Cache: Use the console interface.
4. Store/Retrieve Data: Use the SDK's set and get functions.

Momento's Architecture: Momento's architecture separates the API gateway from data threads on storage nodes. The gateway routes requests, while each node uses multiple worker threads for cache operations. Core pinning and network I/O optimization further enhance performance.

Additional Resources: Learn more about Momento's experience with Tau T2A VMs and Ampere CPUs through the provided links.

References: The original article includes a list of references for further reading.

The above is the detailed content of Momento Migrates Object Cache as a Service to Ampere Altra. For more information, please follow other related articles on the PHP Chinese website!