What's New in Confluent Platform 5.5
0 likes175 views
Watch this webcast here: https://www.confluent.io/online-talks/whats-new-in-confluent-platform-55/ Join the Confluent Product Marketing team as we provide an overview of Confluent Platform 5.5, which makes Apache Kafka and event streaming more broadly accessible to developers with enhancements to data compatibility, multi-language development, and ksqlDB. Building an event-driven architecture with Apache Kafka allows you to transition from traditional silos and monolithic applications to modern microservices and event streaming applications. With these benefits has come an increased demand for Kafka developers from a wide range of industries. The Dice Tech Salary Report recently ranked Kafka as the highest-paid technological skill of 2019, a year removed from ranking it second. With Confluent Platform 5.5, we are making it even simpler for developers to connect to Kafka and start building event streaming applications, regardless of their preferred programming languages or the underlying data formats used in their applications. This session will cover the key features of this latest release, including: -Support for Protobuf and JSON schemas in Confluent Schema Registry and throughout our entire platform -Exactly once semantics for non-Java clients -Admin functions in REST Proxy (preview) -ksqlDB 0.7 and ksqlDB Flow View in Confluent Control Center
Ad
More Related Content
What's hot (20)
Similar to What's New in Confluent Platform 5.5 (20)
Ad
More from confluent (20)
Ad
Recently uploaded (20)
What's New in Confluent Platform 5.5
- 1. What’s New in Confluent Platform 5.5 April 2020 Nick Bryan, Product Marketing Manager
- 2. Confluent Platform Dynamic Performance & Elasticity Auto Data Balancer | Tiered Storage Flexible DevOps Automation Operator | Ansible GUI-driven Mgmt & Monitoring Control Center Efficient Operations at Scale Freedom of Choice Committer-driven Expertise Event Streaming Database ksqlDB Rich Pre-built Ecosystem Connectors | Hub | Schema Registry Multi-language Development Non-Java Clients | REST Proxy Global Resilience Multi-region Clusters | Replicator Data Compatibility Schema Registry | Schema Validation Enterprise-grade Security RBAC | Secrets | Audit Logs ARCHITECTOPERATORDEVELOPER Open Source | Community licensed Unrestricted Developer Productivity Production-stage Prerequisites Fully Managed Cloud SoftwareSelf-managed Software Training Partners Enterprise Support Professional Services Apache Kafka
- 3. Confluent Platform Dynamic Performance & Elasticity Auto Data Balancer | Tiered Storage Flexible DevOps Automation Operator | Ansible GUI-driven Mgmt & Monitoring Control Center Efficient Operations at Scale Freedom of Choice Committer-driven Expertise Event Streaming Database ksqlDB Rich Pre-built Ecosystem Connectors | Hub | Schema Registry Multi-language Development Non-Java Clients | REST Proxy Global Resilience Multi-region Clusters | Replicator Data Compatibility Schema Registry | Schema Validation Enterprise-grade Security RBAC | Secrets | Audit Logs ARCHITECTOPERATORDEVELOPER Open Source | Community licensed Unrestricted Developer Productivity Production-stage Prerequisites Fully Managed Cloud SoftwareSelf-managed Software Training Partners Enterprise Support Professional Services Apache Kafka
- 4. CP 5.5 makes Apache Kafka and event streaming more broadly accessible to developers Rich Pre-built Ecosystem Protobuf, JSON, and plug-in schema support for Schema Registry and throughout the platform 4 Multi-language Development Exactly-once semantics for non-Java clients Admin functions for REST Proxy (preview) Event Streaming Database ksqlDB 0.7 ksqlDB Flow View within Control Center
- 5. 5 Schema Registry expands the Kafka ecosystem with Protobuf, JSON, and plug-in schema support Schema Registry Custom Plug- Ins Supported Data Formats Rich Pre-built Ecosystem App 1 ! Schema Registry Kafka topic ! Serializer App 1 Serializer
- 6. Allow developers and businesses to adopt event streaming broadly Organizations no longer need to adjust event streaming apps to use Avro to use Schema Registry Applications with other formats also need to work with Schema Registry Plug-ins provide a way for Kafka users to address the “long tail” of data formats Protobuf and JSON are both very prevalent data formats The two data formats were the most commonly requested by customers by a significant margin Why add Protobuf, JSON, and plug-in schema support to Schema Registry? 6 Rich Pre-built Ecosystem
- 7. Kafka Connect Converters for Protobuf and JSON ksqlDB and Kafka Streams Enrich messages in either data format REST Proxy Register and retrieve schemas Control Center Create topic schemas directly in the GUI Schema Validation Broker-side enforcement of schemas 7 Protobuf and JSON schemas are also supported across all components of Confluent Platform Rich Pre-built Ecosystem
- 8. Protobuf and JSON Schema Demo
- 9. CP 5.5 makes Apache Kafka and event streaming more broadly accessible to developers Rich Pre-built Ecosystem Protobuf, JSON, and plug-in schema support for Schema Registry and throughout the platform 9 Multi-language Development Exactly-once semantics for non-Java clients Admin functions for REST Proxy (preview) Event Streaming Database ksqlDB 0.7 ksqlDB Flow View within Control Center
- 10. Confluent enhances multi-language development with exactly-once semantics for librdkafka-based clients 10 Clients with EOS 0 1 2 3 4 5 6 7 8 Producer Write idempotently Read exactly once Consumer Multi-language Development
- 11. Why add exactly-once semantics to non-Java clients? 11 Exactly-once semantics ensures critical messages are never duplicated For example, a message that could trigger a financial trade cannot be produced or consumed more than once Feature parity between the clients make event streaming accessible to all developers Organizations with many developer teams need a broad range of clients to allow Kafka to become their central nervous system Multi-language Development
- 12. REST Proxy introduces admin functions to improve Kafka connectivity (Preview State) 12 REST Proxy REST Proxy Applications Schema Registry REST / HTTP List and describe brokers Create, delete, list, and describe topics List and describe configs for topics New Admin Functions Multi-language Development
- 13. Why introduce admin functions for REST Proxy? 13 Removes need to switch over from REST Proxy to Java Admin client, CLI, or Control Center to run admin functions REST Proxy can now both perform administrative tasks and produce and consume messages Feature parity between REST Proxy and the clients provides greater flexibility and more choices to developers Many developers prefer REST because of its language-agnostic nature and simplicity Multi-language Development
- 14. CP 5.5 makes Apache Kafka and event streaming more broadly accessible to developers Rich Pre-built Ecosystem Protobuf, JSON, and plug-in schema support for Schema Registry and throughout the platform 14 Multi-language Development Exactly-once semantics for non-Java clients Admin functions for REST Proxy (preview) Event Streaming Database ksqlDB 0.7 ksqlDB Flow View within Control Center
- 15. Confluent Platform 5.5 launches with ksqlDB 0.7 to further simplify the development of event streaming applications 15 COUNT_DISTINCT Aggregate Count distinct values within a field COUNT_DISTINCT → 3 Support for more data types Record keys can now be of type String, INT, BIGINT, or DOUBLE Higher availability of pull queries1 Reroute queries to replica table partitions if the leader partition is down Pull Query 1 - Pull queries are still in preview Event Streaming Database
- 16. Why expand the functionality of ksqlDB? 16 ksqlDB is becoming the tool of choice to build event streaming applications that leverage stream processing ksqlDB continues to be adopted widely to create these modern applications Expanding the feature set further simplifies the process of building event streaming applications Adding more aggregates, support for more data types, etc. Event Streaming Database
- 17. Control Center provides greater visibility and discovery of ksqlDB applications 17 Visualize what queries, streams, and tables are being used in a ksqlDB application ksqlDB Flow View Application Overview Event Streaming Database
- 18. Control Center provides greater visibility and discovery of ksqlDB applications 18 Drill down into table or stream nodes to quickly visualize their schema and messages ksqlDB Flow View Table / Stream Node Doubleclick Event Streaming Database
- 19. Drill down into query nodes to view the code and understand how inputs are being manipulated Control Center provides greater visibility and discovery of ksqlDB applications 19 ksqlDB Flow View Query Node Doubleclick Event Streaming Database
- 20. Why add the ksqlDB Flow View to Confluent Control Center? 20 Provides developers with a simple mental model of how tables, streams, and queries are interacting Applications often have many different queries that are more easily understood visually than reviewing the editor Enables developers to quickly discover and understand a ksqlDB application that others have built ksqlDB applications are often built by many different developers and teams, so discoverability is crucial Event Streaming Database
- 21. CP 5.5 makes Apache Kafka and event streaming more broadly accessible to developers Rich Pre-built Ecosystem Protobuf, JSON, and plug-in schema support for Schema Registry and throughout the platform 21 Multi-language Development Exactly-once semantics for non-Java clients Admin functions for REST Proxy (preview) Event Streaming Database ksqlDB 0.7 ksqlDB Flow View within Control Center
- 22. Confluent Platform 5.5 launches with the latest Apache Kafka 2.5 version
- 23. Thank you! Try Confluent cnfl.io/download Confluent Blog cnfl.io/blog Community cnfl.io/meetups