Scandev / SDC2013 - Spoilt for Choice: Which Integration Framework to use – Apache Camel, Spring Integration or Mule?
6 likes4,426 views
The document discusses the selection of integration frameworks, emphasizing the importance of not reinventing the integration process and recommending established frameworks such as ESB, Spring Integration, Mule, and Apache Camel. It highlights key considerations like open-source availability, architecture, testability, support, and connectivity options in choosing the right framework. The document also addresses the complexities of modern IT infrastructures and offers insights on effective application integration.
![Missing OSGi support
„OSGi
adds
another
complexity
to
building
applica9ons.
[...]
OSGi
is
a
great
specifica9on
for
middleware
vendors,
but
a
terrible
specifica9on
for
the
end
user.“
Ross
Mason,
MuleSol,
November
2010
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner](https://image.slidesharecdn.com/201302scandevintegrationframeworkskaiwaehner-130305055031-phpapp02/85/Scandev-SDC2013-Spoilt-for-Choice-Which-Integration-Framework-to-use-Apache-Camel-Spring-Integration-or-Mule-42-320.jpg)
Scandev / SDC2013 - Spoilt for Choice: Which Integration Framework to use – Apache Camel, Spring Integration or Mule?
- 1. Spoilt for Choice – Which Integration Framework to choose? Kai Wähner [email protected] @KaiWaehner www.kai-‐waehner.de 3/5/13 © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 2. Kai Wähner Main Tasks Requirements Engineering Enterprise Architecture Management Business Process Management Architecture and Development of Applications Service-oriented Architecture Integration of Legacy Applications Cloud Computing Big Data Contact Consulting Email: [email protected] Developing Blog: www.kai-waehner.de/blog Coaching Twitter: @KaiWaehner Speaking Social Networks: Xing, LinkedIn Writing © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 3. Key Messages Do not reinvent the „integration wheel“! There are some good frameworks for integration! Often, an ESB is the better choice! © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 4. Agenda • Application Integration • Integration Frameworks • Spring Integration • Mule • Apache Camel • And the Winner is ... © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 5. Agenda • Application Integration • Integration Frameworks • Spring Integration • Mule • Apache Camel • And the Winner is ... © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 6. Growing IT infrastructure everywhere! • Applications • Interfaces • Technologies • Products © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 7. Heterogeneity Host à Client / Server à SOA à Cloud à Big Data à ... © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 8. Spaghetti solutions „point-to-point hell“ © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 9. The solution: application integration All roads lead to Rome ... © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 10. Writing glue code? AmazonS3 s3 = new AmazonS3Client(new Proper>esCreden>als( S3Sample.class.getResourceAsStream("AwsCreden>als.proper>es"))); String bucketName = "my-‐first-‐s3-‐bucket-‐" + UUID.randomUUID(); String key = "MyObjectKey"; try { s3.createBucket(bucketName); s3.putObject(new PutObjectRequest(bucketName, key, createSampleFile())); S3Object object = s3.getObject(new GetObjectRequest(bucketName, key)); ObjectLis>ng objectLis>ng = s3.listObjects(new ListObjectsRequest() .withBucketName(bucketName) .withPrefix("My")); s3.deleteObject(bucketName, key); s3.deleteBucket(bucketName); } catch (AmazonServiceExcep>on ase) { // error handling... } catch (AmazonClientExcep>on ace) { // error handling... } © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 11. Wishes for integrators • Standardized Modeling • Efficient Realization • Automatic Testing © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 12. Enteprise Integration Patterns © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 13. Enterprise Integration Patterns © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 14. Enterprise Integration Patterns © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 15. Alternatives for application integration Enterprise Integra>on Suite Integration Service Bus Framework Complexity of Integration Low High Spring Integration vs. Mule vs. Apache Camel © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 16. Agenda • Application Integration • Integration Frameworks • Spring Integration • Mule • Apache Camel • And the Winner is ... © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 17. Integration Frameworks Integration vs. Mule ESB vs. implement © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 18. Comparison Criteria • Open source • Basic concepts / architecture • Testability • Commercial support • Error handling • Monitoring • Enterprise readiness • Developer-‐centric vs. designer-‐centric • Expandability • Deployment • Popularity • Tool support • Connec>vity • Domain specific language (DSL) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 19. Similarities © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 20. Connectivity Integration of different Technologies © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 21. Domain specific language „A domain-‐specific language (DSL) is a programming language or specifica9on language dedicated to a par9cular problem domain, a par9cular problem representa9on technique, and / or a par9cular solu9on technique.“ Wikipedia Internal DSL © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 22. Architecture hip://java.dzone.com/ar>cles/apache-‐camel-‐integra>on (Exemplarily: Apache Camel => Concepts are all the same, only different names) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 23. Deployment Standalone Application Server Web Container Spring Container OSGi Cloud © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 24. Enterprise readiness • Maturity • Transactions • Concurrency • Error handling • Monitoring • Testability • Tooling • Commercial Support © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 25. Licensing Integration vs. Mule ESB vs. Apache License Common Public Apache License Airibu>on License (CPAL) aien>on: more restric>ve! © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 26. Commercial support Integration vs. Mule ESB vs. © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 27. Tooling STS Integration Graph (for Spring Integration) Mule Studio (for Mule ESB) Fuse IDE (for Apache Camel) Talend ESB (for Apache Camel) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 28. Comparison Criteria • Open source • Basic concepts / architecture • Testability • Commercial support • Error handling • Monitoring • Enterprise readiness • Developer-‐centric vs. designer-‐centric • Expandability • Deployment Focus • Popularity • Tool support • Connec>vity • Domain specific language (DSL) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 29. Agenda • Application Integration • Integration Frameworks • Spring Integration • Mule • Apache Camel • And the Winner is ... © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 30. Connectivity AMQP Feed File FTP(S) GemFire HTTP TCP UDP JDBC JMS Mail MongoDB Redis RMI SFTP Stream Twitter Web Service XML XMPP ... easy to create own connectors using a template! „Some more“ © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 31. Domain specific language (Not production-ready yet) XML (Not production-ready yet) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 32. Code example (XML DSL) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 33. Code example (Scala DSL) hip://blog.springsource.org/2012/03/05/introducing-‐spring-‐integra>on-‐scala-‐dsl/ hip://blog.springsource.org/2012/03/05/introducing-‐spring-‐integra>on-‐scala-‐dsl/ © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 34. Live demo Spring Integration in Action © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 35. Tooling: STS Integration Graph © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 36. Tooling: STS Integration Graph Pro • Visual designer for Spring Integration flows • Vice versa editing (code generation vs. coding by hand) • Open source (part of Spring IDE at github) • Perfect for usage in Spring projects (which use Spring Tool Suite) • Simple Eclipse plugin – „just Spring Integration“ Contra • Simple Eclipse plugin – there are no „ESB add-ons“ • Non-intuitive usability • Unclear diagrams • Immature (e.g. missing documentation, problems with code examples) • No unified platform (integration, bpm, etc.) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 37. Agenda • Application Integration • Integration Frameworks • Spring Integration • Mule • Apache Camel • And the Winner is ... © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 38. Mule ESB © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 39. Deployment as web app or standalone hip://www.mulesol.org/documenta>on/display/MULE3USER/Embedding+Mule+in+a+Java+Applica>on+or+Webapp © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 40. Connectivity AS400 Data Queue Abdera Amazon SQS Atom Amazon S3 jBPM Base64 encoded Authorize.net CICS CTG Byte arrays Apple Push CXF CSV Bit.ly Email Encrypted CMIS FTP Hibernate HTTP/S Legs4Mule GZIP CyberSource IMAP/S Hex Strings Facebook HTML/ XHTML Flickr Java Objects HBase Servlet Magento SFTP SMTP/S SOAP JSON STDIO EDI TCP COBOL Copybook UDP XML VM Many further connectors + XMPP easy to create own connectors WebSphere MQ WSDL via Maven archetypes © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 41. Connectivity Several B2B connectors available, especially for: © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 42. Missing OSGi support „OSGi adds another complexity to building applica9ons. [...] OSGi is a great specifica9on for middleware vendors, but a terrible specifica9on for the end user.“ Ross Mason, MuleSol, November 2010 © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 43. Domain specific language XML © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 44. Code example (XML DSL – no alternative) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 45. Live demo Mule in Action © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 46. Tooling: Mule Studio © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 47. Tooling: Mule Studio Pro • Visual Designer for Mule Flows • Visual „live monitoring“ • Vice versa editing (code generation vs. coding by hand) • Intuitive GUI Contra • Proprietary • Subscription required for enterprise features (such as monitoring) • No unified platform (integration, bpm, etc.) Reminder: „Open source“ does NOT mean „for free“! © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 48. Agenda • Application Integration • Integration Frameworks • Spring Integration • Mule • Apache Camel • And the Winner is ... © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 49. Connectivity (most connectors!) LDAP XSLT TCP SQL SMTP JMS Netty Jetty RMI FTP Lucene JDBC EJB Twitter Bean-Validation MQ IRC JMX Quartz CXF RSS AMQP jclouds Atom AWS Akka HTTP File Many further components + easy to create own components MongoDB via Maven archetypes © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 50. Connectivity Many B2B connectors available (Talend ESB only), for example: © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 51. Domain specific language XML (Not production-ready yet) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 52. Code example (XML DSL) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 53. Code example (Java DSL) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 54. Community à Camel rocks! Mailing Lists? Forums? Blogs? Articles? Conference talks? ESBs? Professionals? Jobs? Knowledge? © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 55. Live demo Apache Camel in Action © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 56. Tooling: Fuse IDE © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 57. Tooling: RedHat / JBoss + FuseSource JBoss ESB, Switchyard, Fuse ESB Roadmap: hip://www.redhat.com/promo/jboss_integra>on_week/ © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 58. Tooling: Fuse IDE Pro • Visual designer for Camel routes • Visual „live monitoring“ (for debugging, browsing, tracing) • Vice versa editing (code generation vs. coding by-hand) • Intuitive GUI • Now open sourced (after acquisition of Red Hat) Contra • Unsure future ? • Subscription required for enterprise features (such as monitoring) • No unified platform (integration, bpm, etc.) Reminder: „Open source“ does NOT mean „for free“! © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 59. Tooling: Talend ESB © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 60. Tooling: Talend ESB Pro • Visual Designer for Camel routes • Visual „live monitoring“ (for debugging, browsing, tracing) • Open source • Zero Coding (you can also write custom code, of course) • Unified platform (for ESB, DI, BPM, Big Data, Data Quality, MDM) • GUI palette for Camel components (instead of writing endpoint URIs) Contra • No vice versa code editing (only code generation) • Full ESB, not just Camel tooling (may be bad in a few use cases) • Subscription required for enterprise features (such as monitoring) Reminder: „Open source“ does NOT mean „for free“! © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 61. Agenda • Application Integration • Integration Frameworks • Spring Integration • Mule • Apache Camel • And the Winner is ... © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 62. ... all three integration frameworks Integration Mule ESB © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 63. When to use which integration framework? Integration Mule ESB © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 64. When to use which integration framework? • Spring Projects • „Typical“ JVM Technologies (File, JMS, REST, SOAP, ...) • No additional Framework wanted Integration Mule ESB © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 65. When to use which integration framework? Integration • One of its B2B connectors is required (and it is not available in Camel) Mule ESB © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 66. When to use which integration framework? Integration Mule ESB • In all other cases (largest community, great DSLs, most connectors) © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 67. ... after you have learned the differences Hmm... Actually, when should I use an integra>on framework? © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 68. Alternatives for application integration Enterprise Integra>on Suite Integration Service Bus Framework Complexity of Integration Low High © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 69. When to use an integration framework? Enterprise Integra>on Suite Integration Service Bus Framework Complexity of Integration Low High INTEGRATION Connectivity Routing Transformation © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 70. When to use an Enterprise Service Bus? Enterprise Integra>on Suite Integration Service Bus Framework Complexity of Integration Low High INTEGRATION Connectivity Tooling Routing Transformation © Talend 2013 + Monitoring Support “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 71. When to use an integration suite? Enterprise Integra>on Suite Integration Service Bus Framework Complexity of Integration Low High BUSINESS PROCESS MGT. INTEGRATION BIG DATA / MDM Connectivity Tooling REGISTRY / REPOSITORY Transformation Routing © Talend 2013 + Monitoring Support + RULES ENGINE „YOU NAME IT“ “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 72. Talend Unified Platform Data Data Big Data Quality Integration MDM ESB BPM ¾ Commercial license ¾ Subscrip>on model ¾ Support included ¾ Open source license ¾ Free of charge Big Data Data Data Quality Integration MDM ESB ¾ Op>onal support ¾ Based on open source projects such as Eclipse or Apache Camel, CXF, Hadoop © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 73. ESB vendor == integration suite vendor? Proprietary Open Source © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 74. ESB vendor == integration suite vendor? ESB BPM Big Data © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 75. Custom combination of ESB, BPM, etc.? • A lot of glue code • Testing • Bugfixing • No support Some other people already had the problems you would have! © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 76. Did you get the key messages? © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 77. Key messages Do not reinvent the „integration wheel“! There are some good frameworks for integration! Often, an ESB is the better choice! © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 78. Did you get the key messages? © Talend 2013 “Spoilt for Choice – How to choose the right Integra>on Framework” by Kai Wähner
- 79. Thank you for your attention. Questions? KAI WÄHNER [email protected] www.kai-waehner.de LinkedIn / Xing @KaiWaehner