DevNation Live 2020 - What's new with Apache Camel 3
1 like510 views
The document details the features and updates of Apache Camel 3, an integration framework that utilizes over 300 components for seamless integration across various platforms. It introduces Apache Camel K, a lightweight integration platform designed for Kubernetes with serverless capabilities, and the Camel Kafka Connector, enhancing connectivity with Kafka. Additional resources and projects related to Camel, including examples and demos, are also highlighted.
DevNation Live 2020 - What's new with Apache Camel 3
- 1. What's new with Apache Camel 3 Claus Ibsen Red Hat Andrea Cosentino Red Hat
- 2. About Claus Ibsen ● Senior Principal Software Engineer at Red Hat ● ASF Member & Java Champion ● Apache Camel tech lead ● Author of Camel in Action books ● Based in Denmark ● Blog: http://www.davsclaus.com ● Twitter: @davsclaus ● Github: davsclaus
- 3. About Andrea Cosentino ● Senior Software Engineer at Red Hat ● Apache Camel PMC chair ● Apache Camel tech lead ● Based in Italy ● Twitter: @oscerd2 Github: oscerd
- 4. Agenda ● What’s Camel ● Camel 3 Projects ● Camel Releases ● Camel K ● Camel Quarkus ● Camel Kafka Connector ● More Material ● Q & A
- 5. What’s Camel
- 6. What is Apache Camel The swiss knife of integration
- 7. What is Apache Camel The giant swiss knife 😅 Packed with a lot of functionality
- 8. What is Apache Camel ● Java based integration framework (library) ● Based on Integration Patterns (EIPs) ● Comes with 300+ components (connectors) ● DSL (Java or XML) to describe integration flow (routes) ● Can integrate everything ... almost everything
- 9. Runs on popular Java Runtimes
- 10. Camel Community ● The biggest and most active community for open source integration software ● 600+ unique contributors ● 3800+ pull requests (mostly from external contributors) ● 13+ years of development and one of the most active Apache projects
- 11. Camel Basics
- 12. Camel Routes from("file:data/inbox") .to("jms:queue:order"); <route> <from uri="file:data/inbox"/> <to uri="jms:queue:order"/> </route> Java DSL XML DSL
- 22. Camel 3 Projects
- 23. Apache Camel 3 - Projects Camel Swiss knife of integration
- 24. Apache Camel 3 - Projects Camel Swiss knife of integration Camel Spring Boot Camel on Spring Boot
- 25. Apache Camel 3 - Projects Camel Swiss knife of integration Camel Spring Boot Camel on Spring Boot Camel Karaf Camel on Apache Karaf / OSGi
- 26. Apache Camel 3 - Projects Camel K Camel on Kubernetes & Knative Camel Swiss knife of integration Camel Spring Boot Camel on Spring Boot Camel Karaf Camel on Apache Karaf / OSGi
- 27. Apache Camel 3 - Projects Camel Quarkus Optimized JVM & Native compiled Java (GraalVM) Camel K Camel on Kubernetes & Knative Camel Swiss knife of integration Camel Spring Boot Camel on Spring Boot Camel Karaf Camel on Apache Karaf / OSGi
- 28. Apache Camel 3 - Projects Camel Quarkus Optimized JVM & Native compiled Java (GraalVM) Camel K Camel on Kubernetes & Knative Camel Swiss knife of integration Camel Spring Boot Camel on Spring Boot Camel Karaf Camel on Apache Karaf / OSGi Camel Kafka Connector Kafka Connector with Camel
- 29. Camel Releases
- 30. Camel - LTS vs Non-LTS Releases Release Date LTS LTS EOL Java 2.25 Jan 2020 Yes Jan 2021 8 3.0 Nov 2019 No 8,11 3.1 Feb 202 No 8,11 3.2 Apr 2020 No 8,11 3.3 May 2020 No 8,11 3.4 Jun 2020 Yes Jun 2021 8,11 3.5 Aug 2020 No 11 3.6 Oct 2020 No 11 3.7 Dec 2020 Yes Dec 2021 11,14? Schedule is subject for change
- 31. Camel K
- 32. A lightweight integration platform, based on Apache Camel, born on Kubernetes, with serverless superpowers. What is Apache Camel K ?
- 33. A lightweight integration platform, based on Apache Camel, born on Kubernetes, with serverless superpowers. What is Apache Camel K ? Runs on “vanilla” Kubernetes (1) ... K 1.
- 34. A lightweight integration platform, based on Apache Camel, born on Kubernetes, with serverless superpowers. What is Apache Camel K ? Runs on “vanilla” Kubernetes (1), Openshift (2) ... K 1. K 2.
- 35. A lightweight integration platform, based on Apache Camel, born on Kubernetes, with serverless superpowers. What is Apache Camel K ? Runs on “vanilla” Kubernetes (1), Openshift (2) and gives its best on a Knative-powered cluster (3)! K 1. K 2. K 3.
- 36. How?
- 37. How? from(“telegram:bots/bot-id”) .transform()... .to(“kafka:topic”); from(“kafka:topic”) .to(“http:my-host/api/path”); 1. Create a integration file (Java, Groovy, Kotlin, JS, XML…) Camel DSL, based on EIPs...
- 38. How? from(“telegram:bots/bot-id”) .transform()... .to(“kafka:topic”); from(“kafka:topic”) .to(“http:my-host/api/path”); 1. Create a integration file (Java, Groovy, Kotlin, JS, XML…) Camel DSL, based on EIPs... $ kamel run integration.groovy 2. Run it
- 39. How? from(“telegram:bots/bot-id”) .transform()... .to(“kafka:topic”); from(“kafka:topic”) .to(“http:my-host/api/path”); 1. Create a integration file (Java, Groovy, Kotlin, JS, XML…) Camel DSL, based on EIPs... 3. Runs on Openshift or Kubernetes $ kamel run integration.groovy 2. Run it
- 40. Architecture of Camel K Dev Environment Remote Cloud kamel CLI Camel K Operator “Integration” Custom Resource Running Pod Live updates! Fast redeploy! Less than 1 second! Tailored for cloud-native development experience
- 41. Quick Camel K Demo
- 43. Camel K is not only Java
- 44. Camel Quarkus
- 46. Java Density Problem CONTAINER ORCHESTRATION Node Node Node Traditional Cloud-Native Java Stack Traditional Cloud-Native Java Stack Traditional Cloud-Native Java Stack Traditional Cloud-Native Java Stack NodeJS NodeJS NodeJS NodeJS NodeJS NodeJS NodeJS Go Go Go Go Go Go Go Go Go Go Go Go Go Go Go Go Go Go Go Go Go https://developers.redhat.com/blog/2017/03/14/java-inside-docker/
- 47. SCALE-UP SCALE-DOWN SCALE-TO- ZERO Java Fast Scaling Problem
- 48. What is Quarkus ?
- 49. What is Quarkus ? Supersonic Subatomic Java
- 50. What is Quarkus ? Supersonic Subatomic Java A Kubernetes Native Java stack tailored for GraalVM & OpenJDK HotSpot, crafted from the best of breed Java libraries and standards
- 52. Apache Camel and Quarkus runs blazingly fast with native compiled binaries. Startup is 16 msec, 42mb binary file, and 28mb RSS memory used.
- 56. What is Apache Kafka? ● Kafka is known as ○ a distributed streaming platform ○ or a pub/sub messaging broker ● It’s an ecosystem ○ Multiple components part of Apache Kafka ○ A lot of 3rd party integrations ○ One of them is Kafka Connect Streams API Producer API Consumer API 3rd party tools Mirror Maker Connect
- 57. What is Kafka Connect? ● It is a framework that helps you to integrate Kafka with other systems ○ A user can define source and sink connectors to stream data in/out of Kafka brokers ○ Connectors are plugable - you can use one of the many connectors available or write your own ● Distributed and scalable by default ● Automatic offset management ● Simple transformations ● Streaming / batch integration Kafka Connect: Source Connector Kafka Connect: Sink Connector External System External System
- 58. What is Camel Kafka Connector? ● A Kafka Connector built on top of Apache Camel ● Started as an internal proof-of-concept ○ A sub-project of the Apache Camel ○ Donated by Red Hat to the ASF on December 2019 ● Reuses in a simple way most of the Camel components as Kafka sink and sources ● Release 0.3.0 on its way ● Autogenerated documentation and connectors list: https://camel.apache.org/camel-kafka-connector/latest/connectors.html
- 59. Demo S3 to SQS ● S3 Source connector (camel-aws-s3) ● SQS Sink connector (camel-aws-sqs) ● A file loaded on a bucket -> file content in a SQS Queue To run Kafka on Kubernetes SQS
- 62. More Material
- 63. ● Event-driven serverless applications with Camel K (Luca Burgazzoli & Nicola Ferraro) DevNation Tech Talk July 9th 2020 Camel K Camel on Kubernetes & Knative
- 64. More Material ● Quick 2 min Camel K demo https://www.youtube.com/watch?v=I-g2xt-Qcb8 ● 10 min video - Run 100 Camels quickly with Came, Quarkus and GraalVM https://www.youtube.com/watch?v=4lXSf8DBQkQ ● Camel Kafka Connector blog and 25 min video https://developers.redhat.com/blog/2020/05/19/extending-kafka-connectivity-with-ap ache-camel-kafka-connectors ● Camel Examples https://github.com/apache/camel-examples ● Camel K Examples https://github.com/apache/camel-k/tree/master/examples ● Camel Kafka Connector Examples https://github.com/apache/camel-kafka-connector-examples
- 65. Any Questions ? Follow us on Twitter @davsclaus @oscerd2 @ApacheCamelhttps://github.com/apache/camel A star on github is appreciated