Scylla Summit 2019 Keynote - Dor Laor - Beyond Cassandra

Editor's Notes

• #3: Who knows what’s the C10K problem? You’re old! The C10k problem is the problem of optimising network sockets to handle a large number of clients at the same time The term was coined in 1999 by Dan Kegel,[3][4] https://en.wikipedia.org/wiki/C10k_problem
• #4: If you knew what C10K is, you’re old! Who uses FTP these days (it’s not a question) Originally NGINX was developed to solve this! Nice to see idevelopers redeisgn software for better performance and not another layer of indirection. Now C10K isn’t a real problem today, as you may know with Scylla, we’re bound by the number of ports.
• #5: In distributed computing, performance EQUAL cost, it’s a cost optimization. Segment defined the $10M engineering problem (I call it D10M) It affected the company’s margin and business results - when they approached VCs, the later complained about their margins. Note that 2 Years ago their problem was a $1M problem.. Segment is a good company and applied lots of good procedures. Put that in the context of your own scale and speed. https://segment.com/blog/the-10m-engineering-problem https://segment.com/blog/the-million-dollar-eng-problem/
• #6: How you get to D10M, easy, all it takes is engineers and a cloud account, engineers + cloud == fire As easy as fire spread in California. Without efficient infrastructure, you’ll be translating your technical debt to finacial debt.
• #7: Similarly, in the database world, once upon a time, there was a single mysql server.
• #8: Scale on from there
• #9: Keep on scaling - move to Nosql
• #10: Hello scalable architecture
• #11: And it grows
• #12: And scale with ease
• #13: And here you are at the D10M problem
• #15: We wanted to test our limits and see what can be achieved with Scylla, 1 million ops is not a news no more.
• #23: We empower companies to make infrastructure their competitive advantage with automated bare metal that can be deployed anywhere.
• #40: Marc Andreessen penned his famous “Why Software Is Eating the World” followed by MSFT Satya Nadella.
• #41: You can see this becomes a reality with Kylie Jenner’s 7 pp company, fulfilled by Shopify https://www.shopify.com/kylie
• #42: Recently Confluent’s Jay Kreps made another observation that all companies are software. Indeed businesses today are very different.
• #43: In the old days, in order to take a loan, you’d physically arrive to the bank, fill a form and then The manual process would kick in. The credit officer reviews the request, passes it on to the risk officier, ..Couple of days later, you’d get your approval.
• #44: Today, businesses like next insurance, Sofi, Lemonade automate everything and Can provide you an answer within minutes, some need to provide an answer in milliseconds There are no officers but services, micro services
• #45: These services run 247 and move lots of data around in a merid of microservices and databases. It’s all complex and data passes through the pipes far too many times.
• #46: We at Scylla wish to make it easy for software companies to create better software
• #47: Scylla Cloud DBaaS is a very good start. We launched it a year ago and it’s been in GA since March.
• #48: Compatibility is important as well. 2 months ago we presented project alternator. The initial release was open source. A Scylla alternative for the widely used DynamodB at 10x the speed. TODAY we announce the availability of alternator on our cloud as beta.
• #49: Uber-app like experience - one click to fantastic performance A simple 3 medium node cluster can do 120k ops. A similar DynamoDB Pricing costs $85/hour while the on demand VMs cost $7.5
• #50: We’ve made these improvements, from the cloud, through workload prioritization and Scylla Manager automatic backups But what next?
• #51: Today we announce the availability of Lightweight Transactions a long anticipated feature in Scylla. Tomorrow Kostja will present LWT. We look at LWT not as a regular feature but As a key building block ahead, such that will allow us to improve Scylla itself (tablets, schema mgmt) And also to open the door to variety of more use cases to you all
• #52: Next is Change Data Capture. We’ve given good amount of thought and design And I’m super pleased to announce the availability of CDC in OSS. Once again, we like to help build software companies and simplify your stack. CDC will allow to think about tables and streams in an interchangeable way
• #53: Last but not least, user defined functions is here. UDF opens the gate to much more. Think about ETL within the Scylla servers Themselves with the Scylla parallelism. We’re not there yet but this is where we’re going
• #54: Think avout filtering your stream of changes on the server and apply actions on it.
• #55: Not only Scylla as a database has made progress, also Scylla as a company. We closed a major round of funding. We do developers all hands in between the scylla summits.
• #56: We’re bigger and busier than ever but still put all of the emphasis in support. For example, one of our customers needed a functionality which was coded but not yet hardened. The contract was signed so we had to double down on it.
• #58: Bob my good VP of marketing indicated that I’m quoting other people and whether I like to coin something myself. No sure what’s left for me, can’t shrink these sentences even More - software is software? Doesn’t make sense. Instead, I can say much less hyperbolic claim
• #59: Scylla is damn good.. Hope you’ll enjoy the show!