Amazon CodeGuru Profiler vs Zymtrace

Amazon CodeGuru Profiler collects runtime performance data from live applications and recommends ways to improve performance and find CPU bottlenecks. It is designed for continuous profiling of production applications with minimal overhead. Interactive flame graphs show CPU and latency analysis, including which code paths use the most resources. Machine learning recommendations identify expensive methods and explain their cause, impact, and possible resolution.

The service can detect anomalies in application profiles and, when configured, send an Amazon SNS notification for a new anomaly. It supports Java, JVM languages such as Scala and Kotlin, and Python 3.6 or later. Java and other JVM languages can be profiled for CPU and heap summary; Python profiling covers CPU wall-clock time. Applications may run on EC2, ECS, EKS, Fargate, Lambda, or on premises. The agent can be enabled in JVM applications from the command line or application code and is also used for Lambda applications. An AWS account is required, with IAM permissions controlling access. The agent collects stack traces, not parameter names or values, variable values, or application data.

Zymtrace profiles CPU and GPU workloads to help teams find performance bottlenecks in AI training and inference. Its whole-system CPU profiler supports languages including Python, Java, Go, Rust, C/C++, Node.js, Ruby,.NET, PHP, Perl, Zig, and Scala. GPU tools correlate CPU and GPU execution, inspect CUDA kernels, GPU instructions, and stall reasons, and monitor measures such as utilization, memory, power, temperature, SM efficiency and occupancy, Tensor Core utilization, and data transfer rates. The GPU profiling page lists vLLM, Ollama, llama.cpp, and SGLang as supported inference engines. Zymtrace runs on Linux; the maker says eBPF dependence currently rules out Windows. All plans are self-hosted, and the maker says customer data stays within customer infrastructure. The air-gapped option performs processing and analysis locally. Instances provide a REST API, and profiling data can be exposed through MCP for AI agents. OpenTelemetry resource attributes and standard-format export are supported. Basic is free, billed Free Forever, and covers CPU profiling for up to five concurrent machines; GPU profiling is available as a trial.