Sql server machine learning
Download as PPTX, PDF1 like78 views
This document discusses machine learning capabilities in SQL Server. It notes that SQL Server 2016 and above support R and Python for machine learning directly on the database. This allows modeling without moving data and leveraging database security. Stored procedures can operationalize models. SQL Server also supports high-performance predictive scoring using the PREDICT function on trained RevoScaleR/Python models. The document outlines how data scientists can develop models and application developers can operationalize them using stored procedures. It also discusses multi-platform options for machine learning on SQL Server including Microsoft R Server and SQL Server 2019 big data cluster capabilities.
1 of 18
Download to read offline
Ad
Recommended
Cooking serverless recipes with Azure Functions and Azure Cosmos DB - NET Con...
Cooking serverless recipes with Azure Functions and Azure Cosmos DB - NET Con...Matias Quaranta The document discusses a presentation about cooking serverless recipes with Azure Functions and Azure Cosmos DB. It includes slides about Azure Cosmos DB features like multi-model database capabilities, globally distributed storage, and elastic scaling. It also covers using Azure Functions and bindings to interact with Azure Cosmos DB for input, output, and triggers. Examples are provided on GitHub for common serverless patterns using these services.
Tracking data lineage at Stitch Fix
Tracking data lineage at Stitch FixStitch Fix Algorithms Personalization allows Stitch Fix to style its clients and provide recommendations to help them find what they love. To do this, the company gathers information about a client’s preferences up front when they sign up from the service and learns more about them as they become longer-term customers. This information is important for making recommendations but also must be protected and managed with care.
The data science team at Stitch Fix is the primary owner of the recommendation systems. Backing them up is the data platform team, who maintain the data infrastructure, data warehouse, and supporting tools and services. This data warehouse has several different data sources that read and write into it. This includes a logging pipeline for events, every Spark-based ETL, and daily snapshots of structured data from Stitch Fix applications.
Neelesh Srinivas Salian explains Stitch Fix’s process to better understand the movement and evolution of data within its data warehouse, from the initial ingestion from outside sources through all of its ETLs. Neelesh also details how Stitch Fix built a service that helps the company understand the lineage information that is associated with each table in the data warehouse. This service helps the company understand the source, parentage, and journey of all data in the warehouse. Although Stitch Fix makes sure to anonymize and filter out sensitive information from this data, the company needs a more flexible long-term solution as the business expands.
GraphQL Advanced
GraphQL AdvancedLeanIX GmbH Learn how to build advanced GraphQL queries, how to work with filters and patches and how to embed GraphQL in languages like Python and Java. These slides are the second set in our webinar series on GraphQL.
Misusing MLflow To Help Deduplicate Data At Scale
Misusing MLflow To Help Deduplicate Data At ScaleDatabricks At Intuit, we have a lot of data – and a lot of duplicate data collected over decades. So we built a rule-based, self-serve tool to identify and merge duplicate records. It takes experimentation and iteration to get deduplication just right for 100s of millions of records, and spreadsheet-based tracking just wasn’t enough. We now use MLflow to automatically capture execution notes, rule settings, weights, key validation metrics, etc., all without requiring end-user action. In this talk, we’ll talk about our use case and why MLflow is useful outside its traditional ML Ops use cases.
Data analytics at a petabyte scale final
Data analytics at a petabyte scale finalOri Reshef Or Koren, Head of Data @ ironSource presents how re-designed it's big data analytics using Presto to analyze at petabyte scale,.
Building Notebook-based AI Pipelines with Elyra and Kubeflow
Building Notebook-based AI Pipelines with Elyra and KubeflowDatabricks A typical machine learning pipeline begins as a series of preprocessing steps followed by experimentation, optimization and model-tuning, and, finally deployment. Jupyter notebooks have become a hugely popular tool for data scientists and other machine learning practitioners to explore and experiment as part of this workflow, due to the flexibility and interactivity they provide. However, with notebooks it is often a challenge to move from the experimentation phase to creating a robust, modular and production-grade end-to-end AI pipeline.
Presto: Fast SQL-on-Anything (including Delta Lake, Snowflake, Elasticsearch ...
Presto: Fast SQL-on-Anything (including Delta Lake, Snowflake, Elasticsearch ...Databricks Presto, an open source distributed SQL engine, is widely recognized for its low-latency queries, high concurrency, and native ability to query multiple data sources. Proven at scale in a variety of use cases at Airbnb, Comcast, GrubHub, Facebook, FINRA, LinkedIn, Lyft, Netflix, Twitter, and Uber, in the last few years Presto experienced an unprecedented growth in popularity in both on-premises and cloud deployments over Object Stores, HDFS, NoSQL and RDBMS data stores.
Bringing a public GraphQL API from the whiteboard to production
Bringing a public GraphQL API from the whiteboard to productionyann_s This document discusses scaling a GraphQL API from beta to production at commercetools from 2015 to 2021. Key steps included protecting against complex queries, adding more data to HTTP logs, implementing metrics and slow logs, developing the API internally, automating schema generation and release notes, optimizing queries, and inspecting live servers. It emphasizes that evolving a public GraphQL API requires ongoing investment in automation, operations, improvement, and involving stakeholders.
Quix presto ide, presto summit IL
Quix presto ide, presto summit ILOri Reshef This document discusses data and analytics at Wix, including details about Presto and Quix. Wix is a large company with over 150 million users, 2600 employees, and 1000 microservices. It uses Presto for analytics with over 400,000 weekly queries across 34,000 tables and 11 catalogs. Presto runs on AWS with custom plugins and handles a variety of data sources. Quix is a self-service IDE tool developed at Wix with over 1300 employees using it to run over 8,000 daily queries across 34,000 tables in notes, notebooks, and scheduled jobs. Quix is now being developed as an open source project.
GraphQL Misconfiguration
GraphQL MisconfigurationHarshit Sengar This document discusses GraphQL misconfigurations and vulnerabilities. It introduces GraphQL and compares it to REST APIs. It then covers GraphQL terminologies, endpoints, tools, common attack vectors like introspection queries, denial of service attacks, IDOR, injections, and mutations. It concludes with recommendations for practice labs to test GraphQL vulnerabilities.
05Nov13 Webinar: Introducing Revolution R Enterprise 7 - The Big Data Big Ana...
05Nov13 Webinar: Introducing Revolution R Enterprise 7 - The Big Data Big Ana...Revolution Analytics The document announces the release of Revolution R Enterprise 7 on November 5th. Key new features in RRE 7 include support for decision forests and tree visualization, stepwise logistic and generalized linear models, integration with additional data sources like HP Vertica and Teradata Aster, a new business user interface, inside-Hadoop deployment, and in-database deployment. RRE 7 also includes performance enhancements to R and new capabilities for scalable statistical modeling, machine learning, BI integration, and multi-node package management.
Spline: Data Lineage For Spark Structured Streaming
Spline: Data Lineage For Spark Structured StreamingVaclav Kosar Data lineage tracking is one of the significant problems that companies in highly regulated industries face. These companies are forced to have a good understanding of how data flows through their systems to comply with strict regulatory frameworks. Many of these organizations also utilize big and fast data technologies such as Hadoop, Apache Spark and Kafka. Spark has become one of the most popular engines for big data computing. In recent releases, Spark also provides the Structured Streaming component, which allows for real-time analysis and processing of streamed data from many sources. Spline is a data lineage tracking and visualization tool for Apache Spark. Spline captures and stores lineage information from internal Spark execution plans in a lightweight, unobtrusive and easy to use manner.
Additionally, Spline offers a modern user interface that allows non-technical users to understand the logic of Apache Spark applications. In this presentation we cover the support of Spline for Structured Streaming and we demonstrate how data lineage can be captured for streaming applications.
Presented at Spark Summit London 2018
Apache Flink Online Training
Apache Flink Online TrainingLearntek1 http://www.learntek.org/product/apache-flink/
Apache Flink is an open source stream processing framework developed by the Apache Software Foundation. The core of Apache Flink is a distributed streaming dataflow engine written in Java and Scala. Apache Flink’s dataflow programming model provides event-at-a-time processing on both finite and infinite datasets. At a basic level, Flink programs consist of streams and transformations. Conceptually, a stream is a (potentially never-ending) flow of data records, and a transformation is an operation that takes one or more streams as input, and produces one or more output streams as a result. Programs can be written in Java, Scala, Python, and SQL and are automatically compiled and optimized into dataflow programs that are executed in a cluster or cloud environment.
http://www.learntek.org
Learntek is global online training provider on Big Data Analytics, Hadoop, Machine Learning, Deep Learning, IOT, AI, Cloud Technology, DEVOPS, Digital Marketing and other IT and Management courses. We are dedicated to designing, developing and implementing training programs for students, corporate employees and business professional.
Torkel Ödegaard (Creator of Grafana) - Grafana at #DOXLON
Torkel Ödegaard (Creator of Grafana) - Grafana at #DOXLONOutlyer Video: http://youtu.be/tgdP1juFGVU
Torkel Ödegaard (Creator of Grafana) talking about his awesome Open-Source projects for monitoring, and how Grafana can be used.
Grafana: http://grafana.org
Join DevOps Exchange London here: http://www.meetup.com/DevOps-Exchange-London/
Follow DOXLON on twitter: twitter.com/doxlon
Scaling ML-Based Threat Detection For Production Cyber Attacks
Scaling ML-Based Threat Detection For Production Cyber AttacksDatabricks The document discusses best practices for integrating machine learning models into production pipelines. It describes the full data science product lifecycle from identifying business needs to deploying models through APIs. Key aspects covered include maintainable code through functions/classes, unit testing and code reviews, using Jenkins and a tool called Apparate to schedule Spark jobs and automatically update libraries, and deploying APIs on Kubernetes through Spinnaker for continuous delivery. Lessons learned emphasize leveraging existing tools and infrastructure while addressing pain points to streamline the end-to-end process.
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...Spark Summit The document discusses the challenges faced by Shopify in using its existing data warehouse and ETL processes due to increasing data volume and complexity. It describes Shopify's attempts to use Pig and Luigi as well as Platfora to address these issues, but notes they did not meet Shopify's needs. Shopify then moved to using Spark due to its fast performance, nice development model using Python, and ability to better handle their data and query complexity. The summary provides an overview of why Shopify changed its data warehousing approach and the key technology it adopted.
Attacking GraphQL
Attacking GraphQLKavishaSheth1 This document discusses attacking GraphQL APIs. It begins with an overview of GraphQL, how it differs from REST APIs, and key GraphQL concepts like queries, mutations, and introspection. It then explains how introspection can be dangerous by revealing an API's schema. Various vulnerabilities are covered like information disclosure, IDOR, injections, and authorization bypass. Tools for analyzing GraphQL APIs are also listed. The document concludes with examples of exploiting common vulnerabilities like stored XSS, authorization bypass, and OS command injection.
Fast Data processing with RFX
Fast Data processing with RFXTrieu Nguyen This document discusses using RFX (Reactive Function X), a design pattern and collection of open source tools, to solve fast data problems. It presents an example of using RFX for web analytics to count pageviews and unique users and detect DDOS attacks. The RFX approach applies the BEAM methodology for agile data warehousing. It demonstrates RFX concepts like event data actors, agents, collectors, routers, processors, storage and reactors using a pageview analytics demo with source code on GitHub.
An Update on Scaling Data Science Applications with SparkR in 2018 with Heiko...
An Update on Scaling Data Science Applications with SparkR in 2018 with Heiko...Databricks Spark has established itself as the most popular platform for advanced scale-out analytical applications. It is deeply integrated with the Hadoop ecosystem, offers a set of powerful libraries and supports both Python and R. Because of these reasons Data Scientists have started to adopt Spark to train and deploy their models. When Spark 1.4 was released back in 2015, it included the new SparkR library: this API gave R users the exciting new option to run R code on Spark.
And while the initial promise to provide a full R environment in Spark has been kept, it takes a deeper understanding of SparkR’s inner workings to make optimal use of its capabilities. This talk will give a comprehensive update on where we stand with Data Science applications in R based on the latest Spark releases. We will share insights from both a Startup solution and a Fortune 100 company where SparkR does Machine Learning in the Cloud on a scale that would have not been feasible previously: it’s parallel execution model runs in minutes and hours whereas conventional sequential approaches would take days and months.
Suggested Topics:
• An update on the SparkR architecture in the latest Spark release: using R with SparkSQL, MLlib and Spark’s Structured Streaming
• How to handle practical challenges, e.g. running R on the cluster without a local installation, storing non-tabular results, such as Data Science models or plots, mixing Scala and R.
• Scaling Big Compute Applications with SparkR: Parallelizing SparkR applications with User-Defined Functions (UDFs) and elastic scaling of resources in the Cloud
• An Outlook on Machine Learning with SparkR and its ecosystem, frameworks and tools.
• Plus: “Do I need to learn Python?”
Apache flink
Apache flinkJanu Jahnavi https://www.learntek.org/apache-flink/
https://www.learntek.org/
Learntek is global online training provider on Big Data Analytics, Hadoop, Machine Learning, Deep Learning, IOT, AI, Cloud Technology, DEVOPS, Digital Marketing and other IT and Management courses.
GraphQL Search
GraphQL SearchArtem Shtatnov How we automatically build and maintain a search index using GraphQL. Presented at GraphQL Summit 2019.
Moving a Fraud-Fighting Random Forest from scikit-learn to Spark with MLlib, ...
Moving a Fraud-Fighting Random Forest from scikit-learn to Spark with MLlib, ...Databricks This talk describes migrating a large random forest classifier from scikit-learn to Spark's MLlib. We cut training time from 2 days to 2 hours, reduced failed runs, and track experiments better with MLflow. Kount provides certainty in digital interactions like online credit card transactions. One of our scores uses a random forest classifier with 250 trees and 100,000 nodes per tree. We used scikit-learn to train using 60 million samples that each contained over 150 features. The in-memory requirements exceeded 750 GB, took 2 days, and were not robust to disruption in our database or training execution. To migrate workflow to Spark, we built a 6-node cluster with HDFS. This provides 1.35 TB of RAM and 484 cores. Using MLlib and parallelization, the training time for our random forests are now less than 2 hours. Training data stays in our production environment, which used to require a deploy cycle to move locally-developed code onto our training server. The new implementation uses Jupyter notebooks for remote development with server-side execution. MLflow tracks all input parameters, code, and git revision number, while the performance and model itself are retained as experiment artifacts. The new workflow is robust to service disruption. Our training pipeline begins by pulling from a Vertica database. Originally, this single connection took over 8 hours to complete with any problem causing a restart. Using sqoop and multiple connections, we pull the data in 45 minutes. The old technique used volatile storage and required the data for each experiment. Now, we pull the data from Vertica one time and then reload much faster from HDFS. While a significant undertaking, moving to the Spark ecosystem converted an ad hoc and hands-on training process into a fully repeatable pipeline that meets regulatory and business goals for traceability and speed.
Speaker: Josh Johnston
Distributed Data Quality - Technical Solutions for Organizational Scaling
Distributed Data Quality - Technical Solutions for Organizational ScalingJustin Cunningham The document discusses Yelp's distributed data architecture and quality solutions for organizational scaling. It describes how Yelp connects over 500 engineers across many services through shared data stored in databases like MySQL, Cassandra and Elasticsearch. The data is ingested through Kafka and processed using tools like Flink. Schematizer provides documentation, discovery and ownership of data. It also enables data lineage tracking and auditing to ensure quality as the data is transformed and loaded into data lakes and warehouses. The goal is to provide reliable, up-to-date shared data to align teams and enable autonomy through self-service data access.
Model versioning done right: A ModelDB 2.0 Walkthrough
Model versioning done right: A ModelDB 2.0 WalkthroughManasi Vartak Slides for the Verta.ai ModelDB 2.0 webinar #1. Covers:
(1) Why model versioning
(2) ModelDB 2.0 Architecture
(3) Hands-on exercise with ModelDB
Microsoft R Server for Data Sciencea
Microsoft R Server for Data ScienceaData Science Thailand Microsoft R Server for Data Science
by Krit Kamtuo
Data Science Thailand Meetup #9
Open Source tools for Data Science
Bringing a public GraphQL API from beta to production ready
Bringing a public GraphQL API from beta to production readyyann_s GraphQL Meetup 5 Nov.
Bringing a public GraphQL API from beta to production ready
at scale
https://www.youtube.com/watch?v=Y4aP-ryulgQ
Consolidating MLOps at One of Europe’s Biggest Airports
Consolidating MLOps at One of Europe’s Biggest AirportsDatabricks At Schiphol airport we run a lot of mission critical machine learning models in production, ranging from models that predict passenger flow to computer vision models that analyze what is happening around the aircraft. Especially now in times of Covid it is paramount for us to be able to quickly iterate on these models by implementing new features, retraining them to match the new dynamics and above all to monitor them actively to see if they still fit the current state of affairs.
To achieve those needs we rely on MLFlow but have also integrated that with many of our other systems. So have we written Airflow operators for MLFlow to ease the retraining of our models, have we integrated MLFlow deeply with our CI pipelines and have we integrated it with our model monitoring tooling.
In this talk we will take you through the way we rely on MLFlow and how that enables us to release (sometimes) multiple versions of a model per week in a controlled fashion. With this set-up we are achieving the same benefits and speed as you have with a traditional software CI pipeline.
Introduction to graphQL
Introduction to graphQLMuhilvarnan V > REST & GraphQL
> GraphQL Jargons
> Demo with GitHub APIs
> Tool Chains
> Workshop - Exploring the world of Pokemons with GraphQL
youtube: https://www.youtube.com/watch?v=g0WAyOfA2Ls
Sql Server Machine Learning Services - Sql Saturday Prague 2018 #SqlSatPrague
Sql Server Machine Learning Services - Sql Saturday Prague 2018 #SqlSatPragueLuis Beltran These are the slides for my talk "Sql Server Machine Learning Services" which was presented at Sql Saturday Prague 2018 (#SqlSatPrague). I describe what is Machine Learning, then proceed to explain the importance of it in our SQL Server storage. Then of course I explain the main topic and how Python and R can be integrated in our SQL Scripts (while it is also possible to connect our Python/R scripts to an SQL Server instance).
The presentation ends with a demo. Scripts are available on my GitHub repository: https://github.com/icebeam7/SQLSaturdayPrague2018
GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...
GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...James Anderson Do you know The Cloud Girl? She makes the cloud come alive with pictures and storytelling.
The Cloud Girl, Priyanka Vergadia, Chief Content Officer @Google, joins us to tell us about Scaleable Data Analytics in Google Cloud.
Maybe, with her explanation, we'll finally understand it!
Priyanka is a technical storyteller and content creator who has created over 300 videos, articles, podcasts, courses and tutorials which help developers learn Google Cloud fundamentals, solve their business challenges and pass certifications! Checkout her content on Google Cloud Tech Youtube channel.
Priyanka enjoys drawing and painting which she tries to bring to her advocacy.
Check out her website The Cloud Girl: https://thecloudgirl.dev/ and her new book: https://www.amazon.com/Visualizing-Google-Cloud-Illustrated-References/dp/1119816327
Ad
More Related Content
What's hot (20)
Quix presto ide, presto summit IL
Quix presto ide, presto summit ILOri Reshef This document discusses data and analytics at Wix, including details about Presto and Quix. Wix is a large company with over 150 million users, 2600 employees, and 1000 microservices. It uses Presto for analytics with over 400,000 weekly queries across 34,000 tables and 11 catalogs. Presto runs on AWS with custom plugins and handles a variety of data sources. Quix is a self-service IDE tool developed at Wix with over 1300 employees using it to run over 8,000 daily queries across 34,000 tables in notes, notebooks, and scheduled jobs. Quix is now being developed as an open source project.
GraphQL Misconfiguration
GraphQL MisconfigurationHarshit Sengar This document discusses GraphQL misconfigurations and vulnerabilities. It introduces GraphQL and compares it to REST APIs. It then covers GraphQL terminologies, endpoints, tools, common attack vectors like introspection queries, denial of service attacks, IDOR, injections, and mutations. It concludes with recommendations for practice labs to test GraphQL vulnerabilities.
05Nov13 Webinar: Introducing Revolution R Enterprise 7 - The Big Data Big Ana...
05Nov13 Webinar: Introducing Revolution R Enterprise 7 - The Big Data Big Ana...Revolution Analytics The document announces the release of Revolution R Enterprise 7 on November 5th. Key new features in RRE 7 include support for decision forests and tree visualization, stepwise logistic and generalized linear models, integration with additional data sources like HP Vertica and Teradata Aster, a new business user interface, inside-Hadoop deployment, and in-database deployment. RRE 7 also includes performance enhancements to R and new capabilities for scalable statistical modeling, machine learning, BI integration, and multi-node package management.
Spline: Data Lineage For Spark Structured Streaming
Spline: Data Lineage For Spark Structured StreamingVaclav Kosar Data lineage tracking is one of the significant problems that companies in highly regulated industries face. These companies are forced to have a good understanding of how data flows through their systems to comply with strict regulatory frameworks. Many of these organizations also utilize big and fast data technologies such as Hadoop, Apache Spark and Kafka. Spark has become one of the most popular engines for big data computing. In recent releases, Spark also provides the Structured Streaming component, which allows for real-time analysis and processing of streamed data from many sources. Spline is a data lineage tracking and visualization tool for Apache Spark. Spline captures and stores lineage information from internal Spark execution plans in a lightweight, unobtrusive and easy to use manner.
Additionally, Spline offers a modern user interface that allows non-technical users to understand the logic of Apache Spark applications. In this presentation we cover the support of Spline for Structured Streaming and we demonstrate how data lineage can be captured for streaming applications.
Presented at Spark Summit London 2018
Apache Flink Online Training
Apache Flink Online TrainingLearntek1 http://www.learntek.org/product/apache-flink/
Apache Flink is an open source stream processing framework developed by the Apache Software Foundation. The core of Apache Flink is a distributed streaming dataflow engine written in Java and Scala. Apache Flink’s dataflow programming model provides event-at-a-time processing on both finite and infinite datasets. At a basic level, Flink programs consist of streams and transformations. Conceptually, a stream is a (potentially never-ending) flow of data records, and a transformation is an operation that takes one or more streams as input, and produces one or more output streams as a result. Programs can be written in Java, Scala, Python, and SQL and are automatically compiled and optimized into dataflow programs that are executed in a cluster or cloud environment.
http://www.learntek.org
Learntek is global online training provider on Big Data Analytics, Hadoop, Machine Learning, Deep Learning, IOT, AI, Cloud Technology, DEVOPS, Digital Marketing and other IT and Management courses. We are dedicated to designing, developing and implementing training programs for students, corporate employees and business professional.
Torkel Ödegaard (Creator of Grafana) - Grafana at #DOXLON
Torkel Ödegaard (Creator of Grafana) - Grafana at #DOXLONOutlyer Video: http://youtu.be/tgdP1juFGVU
Torkel Ödegaard (Creator of Grafana) talking about his awesome Open-Source projects for monitoring, and how Grafana can be used.
Grafana: http://grafana.org
Join DevOps Exchange London here: http://www.meetup.com/DevOps-Exchange-London/
Follow DOXLON on twitter: twitter.com/doxlon
Scaling ML-Based Threat Detection For Production Cyber Attacks
Scaling ML-Based Threat Detection For Production Cyber AttacksDatabricks The document discusses best practices for integrating machine learning models into production pipelines. It describes the full data science product lifecycle from identifying business needs to deploying models through APIs. Key aspects covered include maintainable code through functions/classes, unit testing and code reviews, using Jenkins and a tool called Apparate to schedule Spark jobs and automatically update libraries, and deploying APIs on Kubernetes through Spinnaker for continuous delivery. Lessons learned emphasize leveraging existing tools and infrastructure while addressing pain points to streamline the end-to-end process.
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...Spark Summit The document discusses the challenges faced by Shopify in using its existing data warehouse and ETL processes due to increasing data volume and complexity. It describes Shopify's attempts to use Pig and Luigi as well as Platfora to address these issues, but notes they did not meet Shopify's needs. Shopify then moved to using Spark due to its fast performance, nice development model using Python, and ability to better handle their data and query complexity. The summary provides an overview of why Shopify changed its data warehousing approach and the key technology it adopted.
Attacking GraphQL
Attacking GraphQLKavishaSheth1 This document discusses attacking GraphQL APIs. It begins with an overview of GraphQL, how it differs from REST APIs, and key GraphQL concepts like queries, mutations, and introspection. It then explains how introspection can be dangerous by revealing an API's schema. Various vulnerabilities are covered like information disclosure, IDOR, injections, and authorization bypass. Tools for analyzing GraphQL APIs are also listed. The document concludes with examples of exploiting common vulnerabilities like stored XSS, authorization bypass, and OS command injection.
Fast Data processing with RFX
Fast Data processing with RFXTrieu Nguyen This document discusses using RFX (Reactive Function X), a design pattern and collection of open source tools, to solve fast data problems. It presents an example of using RFX for web analytics to count pageviews and unique users and detect DDOS attacks. The RFX approach applies the BEAM methodology for agile data warehousing. It demonstrates RFX concepts like event data actors, agents, collectors, routers, processors, storage and reactors using a pageview analytics demo with source code on GitHub.
An Update on Scaling Data Science Applications with SparkR in 2018 with Heiko...
An Update on Scaling Data Science Applications with SparkR in 2018 with Heiko...Databricks Spark has established itself as the most popular platform for advanced scale-out analytical applications. It is deeply integrated with the Hadoop ecosystem, offers a set of powerful libraries and supports both Python and R. Because of these reasons Data Scientists have started to adopt Spark to train and deploy their models. When Spark 1.4 was released back in 2015, it included the new SparkR library: this API gave R users the exciting new option to run R code on Spark.
And while the initial promise to provide a full R environment in Spark has been kept, it takes a deeper understanding of SparkR’s inner workings to make optimal use of its capabilities. This talk will give a comprehensive update on where we stand with Data Science applications in R based on the latest Spark releases. We will share insights from both a Startup solution and a Fortune 100 company where SparkR does Machine Learning in the Cloud on a scale that would have not been feasible previously: it’s parallel execution model runs in minutes and hours whereas conventional sequential approaches would take days and months.
Suggested Topics:
• An update on the SparkR architecture in the latest Spark release: using R with SparkSQL, MLlib and Spark’s Structured Streaming
• How to handle practical challenges, e.g. running R on the cluster without a local installation, storing non-tabular results, such as Data Science models or plots, mixing Scala and R.
• Scaling Big Compute Applications with SparkR: Parallelizing SparkR applications with User-Defined Functions (UDFs) and elastic scaling of resources in the Cloud
• An Outlook on Machine Learning with SparkR and its ecosystem, frameworks and tools.
• Plus: “Do I need to learn Python?”
Apache flink
Apache flinkJanu Jahnavi https://www.learntek.org/apache-flink/
https://www.learntek.org/
Learntek is global online training provider on Big Data Analytics, Hadoop, Machine Learning, Deep Learning, IOT, AI, Cloud Technology, DEVOPS, Digital Marketing and other IT and Management courses.
GraphQL Search
GraphQL SearchArtem Shtatnov How we automatically build and maintain a search index using GraphQL. Presented at GraphQL Summit 2019.
Moving a Fraud-Fighting Random Forest from scikit-learn to Spark with MLlib, ...
Moving a Fraud-Fighting Random Forest from scikit-learn to Spark with MLlib, ...Databricks This talk describes migrating a large random forest classifier from scikit-learn to Spark's MLlib. We cut training time from 2 days to 2 hours, reduced failed runs, and track experiments better with MLflow. Kount provides certainty in digital interactions like online credit card transactions. One of our scores uses a random forest classifier with 250 trees and 100,000 nodes per tree. We used scikit-learn to train using 60 million samples that each contained over 150 features. The in-memory requirements exceeded 750 GB, took 2 days, and were not robust to disruption in our database or training execution. To migrate workflow to Spark, we built a 6-node cluster with HDFS. This provides 1.35 TB of RAM and 484 cores. Using MLlib and parallelization, the training time for our random forests are now less than 2 hours. Training data stays in our production environment, which used to require a deploy cycle to move locally-developed code onto our training server. The new implementation uses Jupyter notebooks for remote development with server-side execution. MLflow tracks all input parameters, code, and git revision number, while the performance and model itself are retained as experiment artifacts. The new workflow is robust to service disruption. Our training pipeline begins by pulling from a Vertica database. Originally, this single connection took over 8 hours to complete with any problem causing a restart. Using sqoop and multiple connections, we pull the data in 45 minutes. The old technique used volatile storage and required the data for each experiment. Now, we pull the data from Vertica one time and then reload much faster from HDFS. While a significant undertaking, moving to the Spark ecosystem converted an ad hoc and hands-on training process into a fully repeatable pipeline that meets regulatory and business goals for traceability and speed.
Speaker: Josh Johnston
Distributed Data Quality - Technical Solutions for Organizational Scaling
Distributed Data Quality - Technical Solutions for Organizational ScalingJustin Cunningham The document discusses Yelp's distributed data architecture and quality solutions for organizational scaling. It describes how Yelp connects over 500 engineers across many services through shared data stored in databases like MySQL, Cassandra and Elasticsearch. The data is ingested through Kafka and processed using tools like Flink. Schematizer provides documentation, discovery and ownership of data. It also enables data lineage tracking and auditing to ensure quality as the data is transformed and loaded into data lakes and warehouses. The goal is to provide reliable, up-to-date shared data to align teams and enable autonomy through self-service data access.
Model versioning done right: A ModelDB 2.0 Walkthrough
Model versioning done right: A ModelDB 2.0 WalkthroughManasi Vartak Slides for the Verta.ai ModelDB 2.0 webinar #1. Covers:
(1) Why model versioning
(2) ModelDB 2.0 Architecture
(3) Hands-on exercise with ModelDB
Microsoft R Server for Data Sciencea
Microsoft R Server for Data ScienceaData Science Thailand Microsoft R Server for Data Science
by Krit Kamtuo
Data Science Thailand Meetup #9
Open Source tools for Data Science
Bringing a public GraphQL API from beta to production ready
Bringing a public GraphQL API from beta to production readyyann_s GraphQL Meetup 5 Nov.
Bringing a public GraphQL API from beta to production ready
at scale
https://www.youtube.com/watch?v=Y4aP-ryulgQ
Consolidating MLOps at One of Europe’s Biggest Airports
Consolidating MLOps at One of Europe’s Biggest AirportsDatabricks At Schiphol airport we run a lot of mission critical machine learning models in production, ranging from models that predict passenger flow to computer vision models that analyze what is happening around the aircraft. Especially now in times of Covid it is paramount for us to be able to quickly iterate on these models by implementing new features, retraining them to match the new dynamics and above all to monitor them actively to see if they still fit the current state of affairs.
To achieve those needs we rely on MLFlow but have also integrated that with many of our other systems. So have we written Airflow operators for MLFlow to ease the retraining of our models, have we integrated MLFlow deeply with our CI pipelines and have we integrated it with our model monitoring tooling.
In this talk we will take you through the way we rely on MLFlow and how that enables us to release (sometimes) multiple versions of a model per week in a controlled fashion. With this set-up we are achieving the same benefits and speed as you have with a traditional software CI pipeline.
Introduction to graphQL
Introduction to graphQLMuhilvarnan V > REST & GraphQL
> GraphQL Jargons
> Demo with GitHub APIs
> Tool Chains
> Workshop - Exploring the world of Pokemons with GraphQL
youtube: https://www.youtube.com/watch?v=g0WAyOfA2Ls
05Nov13 Webinar: Introducing Revolution R Enterprise 7 - The Big Data Big Ana...
05Nov13 Webinar: Introducing Revolution R Enterprise 7 - The Big Data Big Ana...Revolution Analytics
Similar to Sql server machine learning (20)
Sql Server Machine Learning Services - Sql Saturday Prague 2018 #SqlSatPrague
Sql Server Machine Learning Services - Sql Saturday Prague 2018 #SqlSatPragueLuis Beltran These are the slides for my talk "Sql Server Machine Learning Services" which was presented at Sql Saturday Prague 2018 (#SqlSatPrague). I describe what is Machine Learning, then proceed to explain the importance of it in our SQL Server storage. Then of course I explain the main topic and how Python and R can be integrated in our SQL Scripts (while it is also possible to connect our Python/R scripts to an SQL Server instance).
The presentation ends with a demo. Scripts are available on my GitHub repository: https://github.com/icebeam7/SQLSaturdayPrague2018
GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...
GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...James Anderson Do you know The Cloud Girl? She makes the cloud come alive with pictures and storytelling.
The Cloud Girl, Priyanka Vergadia, Chief Content Officer @Google, joins us to tell us about Scaleable Data Analytics in Google Cloud.
Maybe, with her explanation, we'll finally understand it!
Priyanka is a technical storyteller and content creator who has created over 300 videos, articles, podcasts, courses and tutorials which help developers learn Google Cloud fundamentals, solve their business challenges and pass certifications! Checkout her content on Google Cloud Tech Youtube channel.
Priyanka enjoys drawing and painting which she tries to bring to her advocacy.
Check out her website The Cloud Girl: https://thecloudgirl.dev/ and her new book: https://www.amazon.com/Visualizing-Google-Cloud-Illustrated-References/dp/1119816327
Data analytics master class: predict hotel revenue
Data analytics master class: predict hotel revenueKris Peeters We predict future revenues in hotels by solving the data science puzzle end-to-end: from infrastructure in the cloud and security, to data ingestion, data cleaning, feature building and model training and model scoring.
The video of this talk is here: https://www.facebook.com/datamindedbe/posts/1385820021562117
DataMass Summit - Machine Learning for Big Data in SQL Server
DataMass Summit - Machine Learning for Big Data in SQL ServerŁukasz Grala Sesja pokazująca zarówno Machine Learning Server (czyli algorytmy uczenia maszynowego w językach R i Python), ale także możliwość korzystania z danych JSON w SQL Server, czy też łączenia się do danych znajdujących się na HDFS, HADOOP, czy Spark poprzez Polybase w SQL Server, by te dane wykorzystywać do analizy, predykcji poprzez modele w językach R lub Python.
Advanced analytics with R and SQL
Advanced analytics with R and SQLMSDEVMTL This document provides an overview of advanced analytics using R and SQL. It discusses how R is used widely for analytics and is growing in popularity. Microsoft R Open and Microsoft R Server are introduced as tools for scalable enterprise analytics that integrate with SQL Server. Key capabilities covered include running R scripts directly in the database using SQL Server 2016 extensions, calling stored procedures from applications that execute R code, and bringing compute to data with in-database analytics for performance and scale. Demos and sample programs are referenced to illustrate capabilities of Open Source R and Microsoft R tools.
MySQL Day Paris 2018 - What’s New in MySQL 8.0 ?
MySQL Day Paris 2018 - What’s New in MySQL 8.0 ?Olivier DASINI MySQL 8.0 introduces several new features for developers including a document store for working with JSON documents, over 20 new JSON functions, UTF-8 as the default character set, common table expressions (CTEs) for hierarchical data traversal, window functions for analytics, and new options like SKIP LOCKED and NOWAIT for better handling of locked rows. The MySQL Shell provides a way to prototype applications using the new X DevAPI and import JSON data. Many new features in MySQL 8.0 were added to boost developer and data analyst productivity.
Spark + AI Summit 2020 イベント概要
Spark + AI Summit 2020 イベント概要Paulo Gutierrez Spark + AI Summit 2020 had over 35,000 attendees from 125 countries. The majority of participants were data engineers and data scientists. Apache Spark is now widely used with Python and SQL. Spark 3.0 includes improvements like adaptive query execution that accelerate queries by 2-18x. Delta Engine is a new high performance query engine for data lakes built on Spark 3.0.
Sql server 2019 new features
Sql server 2019 new featuresGeorge Walters This presentation shows new features in SQL 2019, and a recap of features from SQL 2000 through 2017 as well. You would be wise to hear someone from Microsoft deliver this material.
Machine learning services with SQL Server 2017
Machine learning services with SQL Server 2017Mark Tabladillo SQL Server 2017 introduces Machine Learning Services with two independent technologies: R and Python. The purpose of this presentation is 1) to describe major features of this technology for technology managers; 2) to outline use cases for architects; and 3) to provide demos for developers and data scientists.
Developing with SQL Server Analysis Services 201310
Developing with SQL Server Analysis Services 201310Mark Tabladillo SQL Server Analysis Services (SSAS) allows for integrating cubes, tabular model databases, and data mining with your developed applications and services. This talk provides a developer’s framework for understanding SSAS and its core ADOMD .NET and AMO classes. These development options will be demonstrated through application demos. This session is great for developers already working with SQL Server, who want to take their development skills to the next level.
Discovery Day 2019 Sofia - What is new in SQL Server 2019
Discovery Day 2019 Sofia - What is new in SQL Server 2019Ivan Donev This document summarizes new features in SQL Server 2019 including:
- Support for big data analytics using SQL Server, Spark, and data lakes for high volume data storage and access.
- Enhanced data virtualization capabilities to combine data from multiple sources.
- An integrated AI platform to ingest, prepare, train, store, and operationalize machine learning models.
- Improved security, performance, and high availability features like Always Encrypted with secure enclaves and accelerated database recovery.
- Continued improvements based on community feedback.
Running Apache Spark Jobs Using Kubernetes
Running Apache Spark Jobs Using KubernetesDatabricks Apache Spark has introduced a powerful engine for distributed data processing, providing unmatched capabilities to handle petabytes of data across multiple servers. Its capabilities and performance unseated other technologies in the Hadoop world, but while Spark provides a lot of power, it also comes with a high maintenance cost, which is why we now see innovations to simplify the Spark infrastructure.
Moving advanced analytics to your sql server databases
Moving advanced analytics to your sql server databasesEnrico van de Laar This document discusses moving advanced analytics capabilities into SQL Server databases. It describes how traditionally analytics involved extracting data from databases, performing modeling and scoring elsewhere, and sending results back. However, this can be slow for large datasets and require data movement. The document outlines how SQL Server 2016 and 2017 enable "in-database analytics" by bringing models to the data instead. It provides an overview of different methods for building and exploiting in-database models like sp_execute_external_script, sp_rxPredict, and PREDICT. It also demonstrates how to connect a SQL Server database to predictive models hosted on Azure Machine Learning for rapid, in-database scoring.
ITCamp 2018 - Andrea Martorana Tusa - Failure prediction for manufacturing in...
ITCamp 2018 - Andrea Martorana Tusa - Failure prediction for manufacturing in...ITCamp Working in manufacturing industry means that you must deal with product failures. As a BI and/or Data Scientist developer, your task is not only monitor and report product’s health state during its lifecycle, but also predict the likelihood of a fail in the production phase or when product has been delivered to the customer.
Machine Learning techniques can help us to accomplish this task. Starting from past failure data, we can build up a predictive model to forecast the likelihood for a product to fail or giving an estimate on its duration. And now it is possible to develop an end-to-end solution in SQL Server, because of the introduction of advanced analytics tools like R since release 2016.
In this session, we start from the real case of a manufacturing company to create some predictive models: a) Regression model, to predict how many months a product will last once it is delivered to the customer; Time to Failure (TTF); b) Classification models, to predict if a product will fail within a given time frame. (Binary or multi-class classification problem.(
The solution is built using SQL Server 2016, R and R services. On top of that, some reports are created to deliver the outcome to the stakeholders.
What's new in SQL Server 2016
What's new in SQL Server 2016James Serra The document summarizes new features in SQL Server 2016 SP1, organized into three categories: performance enhancements, security improvements, and hybrid data capabilities. It highlights key features such as in-memory technologies for faster queries, always encrypted for data security, and PolyBase for querying relational and non-relational data. New editions like Express and Standard provide more built-in capabilities. The document also reviews SQL Server 2016 SP1 features by edition, showing advanced features are now more accessible across more editions.
Visualizing Big Data in Realtime
Visualizing Big Data in RealtimeDataWorks Summit This document provides an overview of Apache Apex and real-time data visualization. Apache Apex is a platform for developing scalable streaming applications that can process billions of events per second with millisecond latency. It uses YARN for resource management and includes connectors, compute operators, and integrations. The document discusses using Apache Apex to build real-time dashboards and widgets using the App Data Framework, which exposes application data sources via topics. It also covers exporting and packaging dashboards to include in Apache Apex application packages.
Presto talk @ Global AI conference 2018 Boston
Presto talk @ Global AI conference 2018 Bostonkbajda Presented at Global AI Conference in Boston 2018:
http://www.globalbigdataconference.com/boston/global-artificial-intelligence-conference-106/speaker-details/kamil-bajda-pawlikowski-62952.html
Presto, an open source distributed SQL engine, is widely recognized for its low-latency queries, high concurrency, and native ability to query multiple data sources. Proven at scale in a variety of use cases at Facebook, Airbnb, Netflix, Uber, Twitter, LinkedIn, Bloomberg, and FINRA, Presto experienced an unprecedented growth in popularity in both on-premises and cloud deployments in the last few years. Presto is really a SQL-on-Anything engine in a single query can access data from Hadoop, S3-compatible object stores, RDBMS, NoSQL and custom data stores. This talk will cover some of the best use cases for Presto, recent advancements in the project such as Cost-Based Optimizer and Geospatial functions as well as discuss the roadmap going forward.
Machine Learning Models in Production
Machine Learning Models in ProductionDataWorks Summit Data Scientists and Machine Learning practitioners, nowadays, seem to be churning out models by the dozen and they continuously experiment to find ways to improve their accuracies. They also use a variety of ML and DL frameworks & languages , and a typical organization may find that this results in a heterogenous, complicated bunch of assets that require different types of runtimes, resources and sometimes even specialized compute to operate efficiently.
But what does it mean for an enterprise to actually take these models to "production" ? How does an organization scale inference engines out & make them available for real-time applications without significant latencies ? There needs to be different techniques for batch (offline) inferences and instant, online scoring. Data needs to be accessed from various sources and cleansing, transformations of data needs to be enabled prior to any predictions. In many cases, there maybe no substitute for customized data handling with scripting either.
Enterprises also require additional auditing and authorizations built in, approval processes and still support a "continuous delivery" paradigm whereby a data scientist can enable insights faster. Not all models are created equal, nor are consumers of a model - so enterprises require both metering and allocation of compute resources for SLAs.
In this session, we will take a look at how machine learning is operationalized in IBM Data Science Experience (DSX), a Kubernetes based offering for the Private Cloud and optimized for the HortonWorks Hadoop Data Platform. DSX essentially brings in typical software engineering development practices to Data Science, organizing the dev->test->production for machine learning assets in much the same way as typical software deployments. We will also see what it means to deploy, monitor accuracies and even rollback models & custom scorers as well as how API based techniques enable consuming business processes and applications to remain relatively stable amidst all the chaos.
Speaker
Piotr Mierzejewski, Program Director Development IBM DSX Local, IBM
The Roadmap for SQL Server 2019
The Roadmap for SQL Server 2019Amit Banerjee A preview into SQL Server 2019 from Bob, Asad and my presentation at PASS Summit 2018 (Nov '18). We provided insights into what our public preview builds for SQL Server 2019 had in November.
NoSQL and MySQL: News about JSON
NoSQL and MySQL: News about JSONMario Beck MySQL 5.7 is GA. Here is the news about our NoSQL features in MySQL and MySQL Cluster, with a lot of emphasize on the new JSON features that make MySQL suitable as a document store.
Ad
More from Maximiliano Accotto (20)
SQL Server 2019 Big Data Cluster
SQL Server 2019 Big Data ClusterMaximiliano Accotto Here are a few questions I have after the material covered so far:
1. What is the difference between the compute pool and app pool in a SQL Server 2019 big data cluster?
2. How does Polybase work differently in a SQL Server 2019 big data cluster compared to a traditional Polybase setup?
3. What components make up the storage pool in a SQL Server 2019 big data cluster?
Modernizando plataforma de bi
Modernizando plataforma de biMaximiliano Accotto TriggerDB Consulting SRL is an Argentina-based company founded by Maximiliano Accotto, an expert in Microsoft SQL Server and BI. They provide consulting, support, and training services for technologies like SQL Server, analytics, and PowerBI. Their 15+ years of experience and over 150 clients in the region have made them a leader in SQL Server, analytics, and PowerBI consulting services.
Microsoft machine learning
Microsoft machine learningMaximiliano Accotto Presentación en el netconf uy edición 2018 sobre las distintas opciones de hacer ML con soluciones Microsoft
Machine Learning en SQL Server
Machine Learning en SQL ServerMaximiliano Accotto Este documento describe cómo SQL Server permite el machine learning mediante la integración de R y Python. SQL Server 2016 y versiones posteriores admiten scripts de R y Python ejecutados mediante la función sp_execute_external_script. Esto permite el desarrollo, entrenamiento y operacionalización de modelos directamente en la base de datos sin mover datos. SQL Server 2017 también incluye soporte para predicciones en tiempo real mediante la función PREDICT.
Solucion de BI en Azure
Solucion de BI en AzureMaximiliano Accotto Material de la charla que presente en el azure bootcamp buenos aires 2018 sobre un overview de una solución de BI en azure
Seguridad en sql server 2016 y 2017
Seguridad en sql server 2016 y 2017Maximiliano Accotto This document provides an overview and summary of security features in SQL Server 2014/2016 and 2017, including row-level security, dynamic data masking, always encrypted, and backup encryption. It describes the benefits of each feature, such as providing fine-grained access control, regulatory compliance, sensitive data protection, and increasing security of backups. Code examples are given for row-level security and backup encryption. The document aims to educate readers on maximizing data security using these SQL Server capabilities.
Seguridad en sql server 2016 y 2017
Seguridad en sql server 2016 y 2017Maximiliano Accotto This document provides an overview and summary of security features in SQL Server 2014/2016 and 2017, including row-level security, dynamic data masking, always encrypted, and backup encryption. It describes the benefits of each feature, such as providing fine-grained access control, regulatory compliance, sensitive data protection, and increasing security of backups. Examples and concepts are provided for row-level security and key provisioning for always encrypted. The document is authored by Maximiliano Accotto, a data platform MVP since 2005.
Sql 2016 2017 full
Sql 2016 2017 fullMaximiliano Accotto SQL Server 2017 provides more flexibility by allowing users to run it on Linux, Docker, and Windows. It features support for graph queries, machine learning with R and Python, and adaptive query processing. SQL Server 2017 also provides enhanced security, performance, and analytics capabilities including in-database machine learning and data insights from diverse sources. It allows businesses to deploy, manage and analyze their data on the platform of their choice.
SQL on linux
SQL on linuxMaximiliano Accotto SQL Server 2017 on Linux – Azure bootcamp 2017 provides an overview of SQL Server on Linux including:
- The scope of SQL Server features available on Linux initially and what is planned. Key features include the database engine, high availability, and security.
- The architecture of SQL Server on Linux, which uses a Platform Abstraction Layer to provide a consistent interface across platforms. Core components run directly on the OS while others use the abstraction layer.
- Steps to install and configure SQL Server on Linux distributions like SUSE Linux Enterprise Server, configure settings using mssql-conf, and use SQL Server tools on Linux.
Sql 2017 net raf
Sql 2017 net rafMaximiliano Accotto SQL Server 2017 provides flexibility to deploy on Linux, Windows, and Docker containers. It features advanced machine learning with R and Python, graph query support to analyze complex relationships, and adaptive query processing for optimized performance. Security is also improved with features like Always Encrypted and Dynamic Data Masking.
Net conf uy 2017 sql 2017
Net conf uy 2017 sql 2017Maximiliano Accotto This document summarizes a presentation about SQL Server 2017. It discusses new features of SQL Server 2017 including support for Linux, Docker, and machine learning with R and Python. It highlights how SQL Server 2017 can combine transaction processing, data warehousing, and analytics workloads. The document also summarizes SQL Server's enhanced support for diverse data types and sources, improved performance, security features, and flexibility in deployment options.
Machine Learning en SQL Server
Machine Learning en SQL ServerMaximiliano Accotto Este documento describe las capacidades de machine learning en SQL Server 2016 y 2017. Explica que SQL Server permite ejecutar scripts de R y Python directamente en la base de datos para realizar análisis de machine learning. Esto elimina la necesidad de mover datos y aprovecha la seguridad, rendimiento y escalabilidad de SQL Server. También presenta las funciones PREDICT y SP_EXECUTE_EXTERNAL_SCRIPT que permiten realizar predicciones en tiempo real y ejecutar scripts de R/Python respectivamente.
SQL on Azure
SQL on AzureMaximiliano Accotto - Fully managed SQL database service hosted on Microsoft Azure that provides predictable performance and pricing with 99.99% availability.
- Offers elastic database pools and data protection services like geo-replication and point-in-time restore.
- Compatible with SQL Server 2014 databases and comes in multiple service tiers based on resources like CPU cores and IOPS.
Bootcamp 2017 - SQL Server on Linux
Bootcamp 2017 - SQL Server on LinuxMaximiliano Accotto SQL Server 2017 on Linux
- SQL Server 2017 will run natively on Linux
- It provides the same features and capabilities as SQL Server on Windows
- It supports the same editions as Windows and can be licensed with the same license
- It has the same database engine and core services as Windows
- Some advanced features like PolyBase and Stretch Database are not yet supported on Linux
- It uses a new platform abstraction layer to run on Linux
SQL Linux - Instalación 
SQL Linux - Instalación Maximiliano Accotto TriggerDB es una consultora líder en Argentina especializada en consultoría, soporte y capacitación avanzada de SQL Server. Con más de 15 años de experiencia trabajando con clientes en proyectos diversos y críticos, TriggerDB ofrece servicios de consultoría, capacitación y coaching para acelerar implementaciones y mejorar el conocimiento sobre SQL Server y Business Intelligence.
Feliz 2016 ppt
Feliz 2016 pptMaximiliano Accotto El equipo de TriggerDB desea muchas felicidades a Maxi Accotto y le envía un saludo a través de su sitio web http://www.triggerdb.com.
Sql 2016
Sql 2016Maximiliano Accotto This document summarizes new features in SQL Server 2016 CTP including improved performance, in-memory OLTP for more applications, native JSON support, always encrypted for data security, PolyBase for querying relational and non-relational data, built-in advanced analytics, stretch databases to Microsoft Azure, and consistency between on-premises and cloud deployments. Key enhancements are around in-memory processing, security, availability, analytics, and hybrid cloud solutions.
TriggerDB Brochure
TriggerDB BrochureMaximiliano Accotto TriggerDB es una consultora líder en Argentina especializada en consultoría y capacitación avanzada sobre Microsoft SQL Server y Business Intelligence. Con más de 15 años de experiencia y 100 clientes, ofrecen servicios como consultoría, mentoring, capacitaciones y auditorías para ayudar a empresas a optimizar SQL Server y tomar mejores decisiones con BI. Su fundador es un reconocido experto Microsoft MVP en SQL Server.
Ad
Recently uploaded (20)
Linux Support for SMARC: How Toradex Empowers Embedded Developers
Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex Toradex brings robust Linux support to SMARC (Smart Mobility Architecture), ensuring high performance and long-term reliability for embedded applications. Here’s how:
• Optimized Torizon OS & Yocto Support – Toradex provides Torizon OS, a Debian-based easy-to-use platform, and Yocto BSPs for customized Linux images on SMARC modules.
• Seamless Integration with i.MX 8M Plus and i.MX 95 – Toradex SMARC solutions leverage NXP’s i.MX 8 M Plus and i.MX 95 SoCs, delivering power efficiency and AI-ready performance.
• Secure and Reliable – With Secure Boot, over-the-air (OTA) updates, and LTS kernel support, Toradex ensures industrial-grade security and longevity.
• Containerized Workflows for AI & IoT – Support for Docker, ROS, and real-time Linux enables scalable AI, ML, and IoT applications.
• Strong Ecosystem & Developer Support – Toradex offers comprehensive documentation, developer tools, and dedicated support, accelerating time-to-market.
With Toradex’s Linux support for SMARC, developers get a scalable, secure, and high-performance solution for industrial, medical, and AI-driven applications.
Do you have a specific project or application in mind where you're considering SMARC? We can help with Free Compatibility Check and help you with quick time-to-market
For more information: https://www.toradex.com/computer-on-modules/smarc-arm-family
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In Francechb3 The latest updates on Manifest's pre-seed stage progress.
How analogue intelligence complements AI
How analogue intelligence complements AIPaul Rowe
Artificial Intelligence is providing benefits in many areas of work within the heritage sector, from image analysis, to ideas generation, and new research tools. However, it is more critical than ever for people, with analogue intelligence, to ensure the integrity and ethical use of AI. Including real people can improve the use of AI by identifying potential biases, cross-checking results, refining workflows, and providing contextual relevance to AI-driven results.
News about the impact of AI often paints a rosy picture. In practice, there are many potential pitfalls. This presentation discusses these issues and looks at the role of analogue intelligence and analogue interfaces in providing the best results to our audiences. How do we deal with factually incorrect results? How do we get content generated that better reflects the diversity of our communities? What roles are there for physical, in-person experiences in the digital world?
Role of Data Annotation Services in AI-Powered Manufacturing
Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo From predictive maintenance to robotic automation, AI is driving the future of manufacturing. But without high-quality annotated data, even the smartest models fall short.
Discover how data annotation services are powering accuracy, safety, and efficiency in AI-driven manufacturing systems.
Precision in data labeling = Precision on the production floor.
Rusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1 Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark?
At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍
Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀
Procurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptxJon Hansen Procurement Insights integrated Historic Procurement Industry Archives, serves as a powerful complement — not a competitor — to other procurement industry firms. It fills critical gaps in depth, agility, and contextual insight that most traditional analyst and association models overlook.
Learn more about this value- driven proprietary service offering here.
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Artificial intelligence is changing how businesses operate. Companies are using AI agents to automate tasks, reduce time spent on repetitive work, and focus more on high-value activities. Noah Loul, an AI strategist and entrepreneur, has helped dozens of companies streamline their operations using smart automation. He believes AI agents aren't just tools—they're workers that take on repeatable tasks so your human team can focus on what matters. If you want to reduce time waste and increase output, AI agents are the next move.
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Most consumers believe they’re making informed decisions about their personal data—adjusting privacy settings, blocking trackers, and opting out where they can. However, our new research reveals that while awareness is high, taking meaningful action is still lacking. On the corporate side, many organizations report strong policies for managing third-party data and consumer consent yet fall short when it comes to consistency, accountability and transparency.
This session will explore the research findings from TrustArc’s Privacy Pulse Survey, examining consumer attitudes toward personal data collection and practical suggestions for corporate practices around purchasing third-party data.
Attendees will learn:
- Consumer awareness around data brokers and what consumers are doing to limit data collection
- How businesses assess third-party vendors and their consent management operations
- Where business preparedness needs improvement
- What these trends mean for the future of privacy governance and public trust
This discussion is essential for privacy, risk, and compliance professionals who want to ground their strategies in current data and prepare for what’s next in the privacy landscape.
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025
https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/
Is AI just another technology, or does it fundamentally change the way we live and think?
Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater.
At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts.
At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganArthur Morgan This is a Quick Research Guide (QRG).
QRGs include the following:
- A brief, high-level overview of the QRG topic.
- A milestone timeline for the QRG topic.
- Links to various free online resource materials to provide a deeper dive into the QRG topic.
- Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic.
QRGs planned for the series:
- Artificial Intelligence QRG
- Quantum Computing QRG
- Big Data Analytics QRG
- Spacecraft Guidance, Navigation & Control QRG (coming 2026)
- UK Home Computing & The Birth of ARM QRG (coming 2027)
Any questions or comments?
- Please contact Arthur Morgan at [email protected].
100% human made.
TrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business ConsultingTrs Labs Hybrid Growth Mandate Model with TrsLabs
Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant.
An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices.
Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company
Talk to us & Unlock the competitive advantage
Build Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For DevsBrian McKeiver May 2nd, 2025 talk at StirTrek 2025 Conference.
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots.
📕 Here's what you can expect:
- Modeling: Build end-to-end processes using BPMN.
- Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes.
- Operating: Control process instances with rewind, replay, pause, and stop functions.
- Monitoring: Use dashboards and embedded analytics for real-time insights into process instances.
This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes.
👨🏫 Speaker:
Andrei Vintila, Principal Product Manager @UiPath
This session streamed live on April 29, 2025, 16:00 CET.
Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.
HCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser Environmentspanagenda Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-and-managing-multiuser-environments/
HCL Nomad Web is heralded as the next generation of the HCL Notes client, offering numerous advantages such as eliminating the need for packaging, distribution, and installation. Nomad Web client upgrades will be installed “automatically” in the background. This significantly reduces the administrative footprint compared to traditional HCL Notes clients. However, troubleshooting issues in Nomad Web present unique challenges compared to the Notes client.
Join Christoph and Marc as they demonstrate how to simplify the troubleshooting process in HCL Nomad Web, ensuring a smoother and more efficient user experience.
In this webinar, we will explore effective strategies for diagnosing and resolving common problems in HCL Nomad Web, including
- Accessing the console
- Locating and interpreting log files
- Accessing the data folder within the browser’s cache (using OPFS)
- Understand the difference between single- and multi-user scenarios
- Utilizing Client Clocking
2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo Cloudflare Q4 Financial Results Presentation
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan This is a Quick Research Guide (QRG).
QRGs include the following:
- A brief, high-level overview of the QRG topic.
- A milestone timeline for the QRG topic.
- Links to various free online resource materials to provide a deeper dive into the QRG topic.
- Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic.
QRGs planned for the series:
- Artificial Intelligence QRG
- Quantum Computing QRG
- Big Data Analytics QRG
- Spacecraft Guidance, Navigation & Control QRG (coming 2026)
- UK Home Computing & The Birth of ARM QRG (coming 2027)
Any questions or comments?
- Please contact Arthur Morgan at [email protected].
100% human made.
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell With expertise in data architecture, performance tracking, and revenue forecasting, Andrew Marnell plays a vital role in aligning business strategies with data insights. Andrew Marnell’s ability to lead cross-functional teams ensures businesses achieve sustainable growth and operational excellence.
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat The MCP (Model Context Protocol) is a framework designed to manage context and interaction within complex systems. This SlideShare presentation will provide a detailed overview of the MCP Model, its applications, and how it plays a crucial role in improving communication and decision-making in distributed systems. We will explore the key concepts behind the protocol, including the importance of context, data management, and how this model enhances system adaptability and responsiveness. Ideal for software developers, system architects, and IT professionals, this presentation will offer valuable insights into how the MCP Model can streamline workflows, improve efficiency, and create more intuitive systems for a wide range of use cases.
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsInData Labs At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including:
-Artificial Intelligence Market Overview
-Strategies for AI Adoption in 2025
-Anticipated drivers of AI adoption and transformative technologies
-Benefits of AI and Big data for your business
-Tips on how to prepare your business for innovation
-AI and data privacy: Strategies for securing data privacy in AI models, etc.
Download your free copy nowand implement the key findings to improve your business.
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat
Sql server machine learning
- 1. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Server Machine Learning Maximiliano Accotto (MVP Data Platform) Owner TriggerDB Consulting SRL www.triggerdb.com
- 2. October 4th, 5th & 6th 2018.NET Conf AR v2018 Regular Database + App Intelligence Database + App Llevar la inteligencia a donde están los datos Application + Intelligence Database Application Intelligence + Database VS
- 3. October 4th, 5th & 6th 2018.NET Conf AR v2018 ¿Porque ML en SQL Server? Eliminar el movimiento de datos Aprovechar la seguridad de la base de datos Ejecutar los calculos de ML en la base de datos Operación ML scripts y modelos Usar store Procedures de T-SQL Manejar los modelos en el SQL Server Performance y escalabilidad Enterprise Escalar con R y Python analytics usando multi-threading y parallel processing. SQL Server security, compliance, resource governance, query performance, always on secondaries Data Scientist Interacts directly with data SQL Developer/ DBA Manage data and analytics together SQL Transformations 010010 100100 010101 Relational data Analytics library R integration 010010 100100 010101 010010 100100 010101 Python integration
- 4. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Machine Learning Services • SQL Server 2016 • R support (3.2.2 version) • Microsoft R Server • SQL Server 2017 • Scoring native en TSQL usando PREDICT function • EXTERNAL LIBRARY DDL para el manejo de paquetes R • Ejecución en batch para la entrada de datos • Soporte para R (3.3.3 version) • Soporte para Python (Anaconda 3.5.2)
- 5. October 4th, 5th & 6th 2018.NET Conf AR v2018 Any R/Python IDE Data Scientist Workstation Script Results Execution 1 3 Data Scientists - Exploración de Datos y Desarrollo de Modelos SQL Server 2 R/Python Runtime Machine Learning Services train <- RxSqlServerData(query, connectionString, computeContext) rxLogit(formula, train)
- 6. October 4th, 5th & 6th 2018.NET Conf AR v2018 Application exec sp_execute_external_script @language = ‘Python’ , @script = -- Python code -- The stored procedure contains R or Python code and executes in-database Application Developer - Operacionalización de modelos Stored Proc call Results 1 3 Execution SQL Server 2 R/Python Runtime Machine Learning Services
- 7. October 4th, 5th & 6th 2018.NET Conf AR v2018 Trabajo del DBA: Habilitar ML en SQL Server Enable External scripts – Exec sp_configure ‘external scripts enabled’, 1 – RCONFIGURE SQL Server 2016 O superior
- 8. October 4th, 5th & 6th 2018.NET Conf AR v2018 sp_execute_external_script
- 9. October 4th, 5th & 6th 2018.NET Conf AR v2018 Tipos de salida 1. Dataset • Standard resultset of rows and columns • Data types will vary 2. Plot • Static images • Binary 3. Model • Trained models such as linear regression, naïve bayes, etc. • Binary
- 10. October 4th, 5th & 6th 2018.NET Conf AR v2018 Realtime Predictions usando Scoring nativo • PREDICT function • No depende de R o Python runtime • Habilitado on SQL Server tanto en Windows como Linux • Uso • Single or small number of rows scoring • Highly concurrent scoring scenarios • Predict during INSERT, UPDATE, MERGE statements • Requirements • Models built using RevoScaleR or revoscalepy • rxLinMod, rxLogit, rxBTrees, rxDTree, rxDForest • Serialized using rxSerializeModel (R) or rx_serialize_model (Python)
- 11. October 4th, 5th & 6th 2018.NET Conf AR v2018 PREDICT syntax
- 12. October 4th, 5th & 6th 2018.NET Conf AR v2018 1,000,000 predictions per second https://blogs.technet.microsoft.com/dataplatforminsider/2016/10/11/1000000-predictions-per-second/
- 13. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Machine Learning Server • Soporte Multi-plataforma • Windows, Linux, Hadoop, SQL Server • Microsoft R Server • RevoScaleR, MicrosoftML, olapR, sqlrutils packages • Uso de Web services para operar. • Microsoft Machine Learning Server • Soporte de R & Python • revoscalepy, microsoftml python libraries • rxExecBy
- 14. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Machine Learning Server • Setup one-box configuration > az ml admin boostrap • Jupyter notebook deploy, and consume
- 15. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Machine Learning Server – Multi Server Configuration
- 16. October 4th, 5th & 6th 2018.NET Conf AR v2018 SQL Server 2019 y ML (big data Cluster)
- 17. October 4th, 5th & 6th 2018.NET Conf AR v2018 Demos
- 18. October 4th, 5th & 6th 2018.NET Conf AR v2018 Muchas gracias http://blog.triggerdb.com/maxi maxiaccotto [email protected] Maximiliano Accotto