Kafka Streams vs Lenses

Kafka Streams is a free client library for building applications and microservices that use data stored in Kafka clusters. It processes Kafka data with event-time handling, windowing, and real-time queries of application state. The Streams DSL provides operations such as mapping, filtering, joins, and aggregations, while the Processor API supports custom processors and state stores. Fault-tolerant local state supports stateful work such as windowed joins and aggregations, and the library offers exactly-once processing semantics. Applications can run on one machine or scale across multiple machines, and can be deployed in containers, virtual machines, on bare metal, or in cloud environments. Kafka Streams uses Kafka as its internal messaging layer and does not require a separate processing cluster. It supports Java and Scala and integrates with Kafka security features for encryption in transit, client authentication, and authorization. The software is licensed under Apache License 2.0. The Apache Software Foundation says it does not sell its software or provide formal or commercial support for its packages; project communication is available through community mailing lists.

Lenses describes its Operating Fabric as a platform for building, governing, and operating Kafka applications with engineers and AI agents. Users can discover streaming data across domains with SQL, prepare it for consumption, and deploy data streams independently. It connects to Confluent Platform, Confluent Cloud, Amazon MSK, Redpanda, and self-managed Apache Kafka, and can run in cloud, on-premises, or hybrid environments. Work interfaces include a Web App, VS Code Extension, Lenses MCP, and Lenses CLI. Lenses says OAuth 2.1 gives agents scoped, short-lived, revocable, and audited access. It also lists open-source Kafka connectors for systems including Amazon S3, Azure Event Hubs, GCP Storage, Cassandra, MongoDB, Redis, and Elasticsearch; the connectors are Apache 2.0 licensed and have enterprise support. The DevX Community Edition supports up to five free users, while SQL Studio supports up to two Kafka clusters. A trial key is available through the guided demo. Team Edition is listed from $4,000 per year and supports up to 15 users with SSO/SAML, RBAC, and Team Support.