Splunk at opa

Mar 19, 2012Download as PPTX, PDF0 likes366 views

National Public Radio (NPR) provides audio and video content across multiple platforms. The document discusses setting up tracking of audio and video downloads and streams to analyze user behavior and engagement. It also presents examples of queries to the tracking data to monitor key metrics like podcast downloads, platform usage, and social media engagement.

National Public Radio NPR

24/7

Sondra Russell, Senior Digital Analyst
srussell@npr.org

Audio and Video Tracking: The Basic Setup

MP3 Downloads ProgramID
(?P<ProgramID>[^/]*)(?=/ Podcast Download
On Demand Flash ) sourcetype = 08/08/2011=>31800
download AND 08/09/2011=>29655
Live Streams UserAgent status < 300 AND 08/10/2011=>29903
(?P<UserAgent>[^"]*)(?="
Method=Get | 08/11/2011=>53443
)
transaction 08/12/2011=>32593
AppVersion IPAddress UserAgent 08/13/2011=>88654
“*(? =/)” maxspan=120…
08/14/2011=>11231

1
Ingest 2 Extract 3
Define 4
Create
Raw Data Fields Transactions Summary
Indexes

Sondra Russell, Senior Digital Analyst
srussell@npr.org

“How Has my Podcast Been Doing?”

> index=“summary” search_name=“si_download_programID” ProgramName=“Planet Money”

Pulls from the summary index Pulls from lookup table mapping programID
to programName

Sondra Russell, Senior Digital Analyst
srussell@npr.org

“How Are People Accessing Our Show?”

> * | eval Platform = mvfilter(match(eventtype,"plat*")) | timechart span=1w count by Platform

Filters data for specific event types plat_iphone_browser
UserAgent="*iPhone*" AND
UserAgent!="*NPRRadio*" AND
UserAgent!="*iPod*“ AND sc!=18

Sondra Russell, Senior Digital Analyst
srussell@npr.org

The SoundExchange Problem

> transaction IPAddress startswith="play" endswith="stop" | concurrency duration=duration | eval key=1 |
lookup songs key | stats first(song) as song max(concurrency) as concurrency by id | stats
sum(concurrency) by song

Sondra Russell, Senior Digital Analyst
srussell@npr.org

“What Percentage of our Users Have Upgraded?”
> * | rex field=_raw "Darwin/(?<Version>[0-9.]*)"“ | top Version

Uses regex to extract element from "NPRMusic/2.7 CFNetwork/459 Darwin/10.0.0d3"
raw data

Sondra Russell, Senior Digital Analyst
srussell@npr.org

“Splunk + API Logging = Major Win for the API”

Sondra Russell, Senior Digital Analyst
srussell@npr.org

“Which Stories are Getting Tweeted the Most?”

> index=“twitter” | stats count by story_url timestamp="2011-07-
18T15:40:34Z", author="drpdtapp (Dr. P. D
Tapp)",
tweet="Tinnitus: Why Won't My Ears Stop
Creates reports from a custom log Ringing?”,
story_url="http://www.npr.org/2011/07/18/
138163304/tinnitus-why-wont-my-ears-stop-
ringing?sc=tw",

Sondra Russell, Senior Digital Analyst
srussell@npr.org

Splunk for Web Intelligence? Why not! This session provides a plain-english tour that shows how NPR uses Splunk to track audio and video traffic across our web sites and digital apps (Android, iPhone, etc.). Then Intuit will share how they capture greater insight into visitor sessions and answer questions traditional web analytics tools can’t provide. Intuit will cover a variety of use cases, taking each from the raw data through Splunk “under-the-hood” to the strategic questions and answers.

SplunkLive! Denver - Nov 2012 - Cricket CommunicationsSplunk

This document discusses Cricket Communication's use of Splunk software to gain operational insights from big data. It summarizes how Cricket uses Splunk across various departments to monitor services like MUVE music and gain business intelligence. Key benefits highlighted include visibility into customer experience, troubleshooting issues, and analyzing metrics to improve services and plan more efficiently. The last section notes how Splunk usage at Cricket has grown significantly since implementing it.

Strata Presentation: One Billion Objects in 2GB: Big Data Analytics on Small ...randyguck

Slides from my Strata+Hadoop 2015 Conference session titled: One Billion Objects in 2GB: Big Data Analytics on Small Clusters with Doradus OLAP. This talk describes the Doradus OLAP query/storage engine, which is an open source module that runs on top of the Cassandra NoSQL DB. Among the benefits of this service is fast data loading, a rich query language with full text and graph query features, and very dense data storage. See the Notes section for details on each slide.

Dataservices: Processing (Big) Data the Microservice WayQAware GmbH

Apache Big Data 2017, Miami (Florida/USA): Talk by Josef Adersberger (@adersberger, CTO at QAware) Abstract: We see a big data processing pattern emerging using the Microservice approach to build an integrated, flexible, and distributed system of data processing tasks. We call this the Dataservice pattern. In this presentation we'll introduce into Dataservices: their basic concepts, the technology typically in use (like Kubernetes, Kafka, Cassandra and Spring) and some architectures from real-life.

Lessons Learned Running InfluxDB Cloud and Other Cloud Services at Scale by T...InfluxData

iguazio - nuclio Meetup Nov 30thiguazio

Reactive Stream Processing Using DDS and RxSumant Tambe

In this presentation you will see why Reactive Extensions (Rx) is a powerful technology for asynchronous stream processing. RTI Data Distribution Service (DDS) will be used as the source of data and as a communication channel for asynchronous data streams. On top of DDS, we'll use Rx to subscribe, observe, project, filter, aggregate, merge, zip, and correlate one or more data streams (Observables). The live demo will be very visual as bouncing shapes of different colors will be transformed in front of you using C# lambdas, Rx.NET, and Visual Studio. You will also learn about the new Rx4DDS.NET library that integrates RTI DDS with Rx.NET. Rx and DDS are a great match because both are reactive. Rx is based on the subject-observer pattern, which is quite analogous to the publish-subscribe pattern of DDS. When used together they support distributed dataflows seamlessly. If time permits, we will touch upon advanced Rx concepts such as stream of streams (IGroupedObservable) and how it captures DDS "keyed topics". The DDS applications using Rx4DDS.NET dramatically simplify concurrency to the extent that it can be simply configured.

Lessons Learned: Running InfluxDB Cloud and Other Cloud Services at Scale | T...InfluxData

Hadoop & Hive Change the Data Warehousing Game ForeverDataWorks Summit

This document discusses how Hadoop and Hive can change data warehousing by allowing organizations to store large amounts of structured and semi-structured data in its native format, and perform interactive queries directly against that data using tools like Impala and Hive without needing to first extract, transform and load the data into data marts. It provides examples of how Klout and an online gaming company used Hadoop and Hive for analytics and compares performance of Impala versus traditional data warehouse databases.

Running High-Speed Serverless with nuclioiguazio

This document provides an overview and introduction to Nuclio, an open source serverless platform. Some key points: - Nuclio is described as a new real-time serverless platform that is comprehensive, open, super fast, and can run anywhere. It provides high performance for serverless functions. - It supports a variety of programming languages and event sources. Functions can be easily deployed and auto-scaled. - Nuclio is presented as a solution for complex serverless applications through its data integration capabilities and high performance. Examples of real-time applications using Nuclio are described like fleet management, surveillance, and more.

112 portfpres.pdfsash236

Active Data: Managing Data-Life Cycle on Heterogeneous Systems and Infrastruc...Gilles Fedak

Active Data : Managing Data-Life Cycle on Heterogeneous Systems and Infrastructures The Big Data challenge consists in managing, storing, analyzing and visualizing these huge and ever growing data sets to extract sense and knowledge. As the volume of data grows exponentially, the management of these data becomes more complex in proportion. A key point is to handle the complexity of the 'Data Life Cycle', i.e. the various operations performed on data: transfer, archiving, replication, deletion, etc. Indeed, data-intensive applications span over a large variety of devices and e-infrastructures which implies that many systems are involved in data management and processing. ''Active Data'' is new approach to automate and improve the expressiveness of data management applications. It consists of * a 'formal model' for Data Life Cycle, based on Petri Net, that allows to describe and expose data life cycle across heterogeneous systems and infrastructures. * a 'programming model' allows code execution at each stage of the data life cycle: routines provided by programmers are executed when a set of events (creation, replication, transfer, deletion) happen to any data.

Getting Started with SplunkSplunk

Advanced kapacitorInfluxData

Scim overviewMorteza Ansari

dlux - Splunk Technical OverviewDavid Lutz

This document provides an overview and agenda for a Splunk lunch and learn session. It discusses what Splunk is, its key capabilities including searching, alerting, and reporting on machine data, and its universal indexing approach. The document also outlines deployment options and includes a demonstration. It explains how Splunk eliminates finger pointing across IT silos by enabling users to search and investigate issues more quickly. It also discusses how Splunk supports proactive monitoring, operational visibility, and real-time business insights.

Adam Fuchs' Accumulo Talk at NoSQL Now! 2013Sqrrl

This document discusses Sqrrl Enterprise and Apache Accumulo, a secure and scalable real-time analysis framework. Accumulo is an open source, distributed key-value store that provides robust security and performance. Sqrrl Enterprise builds on Accumulo to provide additional capabilities like custom indexing, iterators, and security extensions. The document outlines Accumulo's architecture, security model, table designs, and benchmarks demonstrating its high performance and scalability for real-time analysis of large datasets.

Rich relational data from thin air john stinsonJohn Stinson

Semantic Technologies to Support the User-Centric Analysis of Activity Data Mathieu d'Aquin

The document discusses using semantic technologies to analyze user-centric activity data from logs in a consolidated and interpretable way. It describes challenges with heterogeneous, raw, large log data and proposes using ontologies and semantic representations to integrate and interpret activity data from multiple sources for individual user analysis and support. A technical infrastructure is proposed using a semantic triple store, scheduler, parsers and renderers to extract and consolidate log data into RDF traces for unified querying and user-centric activity analysis.

Instrumentation with SplunkDatavail

The document discusses using Splunk to instrument Oracle Applications. Splunk is presented as a solution to federate telemetry and log data from different systems in various locations to help troubleshoot issues that may have root causes buried in difficult to find locations. The key components of Splunk - forwarders, indexers, and search heads - are described. Features like interactive searching, field extractions, data classification, and charts are highlighted. A use case is provided for monitoring garbage collection using a script to parse jstat output and index it in Splunk. Steps for implementing such a script are outlined.

Analytics with SparkProbst Ludwine

The document discusses analytics for sensor data from the Internet of Things. It provides examples of using sensor data from aircraft and connected cars for applications like optimizing flight performance, detecting anomalies, and monitoring vehicle location and driving habits. It then describes collecting accelerometer data from mobile devices, analyzing the data with Apache Spark and MLlib to identify physical activities, and storing the data in Cassandra. Algorithms like decision trees, random forests, and logistic regression are used to build predictive models to classify activities in real-time.

Cassandra & puppet, scaling data at $15 per monthdaveconnors

D3 data, user, interactionDummas

D3 is a JavaScript library for visualizing data using web standards like HTML, SVG, and CSS. It allows data to drive the creation of documents based on the data. D3 selections and data binding are used to join data to elements in the document. A complete example is shown binding an array of numbers to circles, setting attributes and styles. Interactions like mouseovers can be added with event handlers. D3 supports additional capabilities like math functions, SVG shapes, geographic projections, and more.

MongoDB for AnalyticsMongoDB

1) MongoDB is used to collect analytics data from GitHub pages in real-time with over 10-15 million page views per day stored across 13 servers. 2) Data is stored in a denormalized manner across multiple collections to optimize for space, RAM, and read performance while live querying is supported. 3) As data volume grows over time, the data will need to be partitioned either by time frame, functionality, or individual servers to support the increased load.

nuclio Overview October 2017iguazio

beyond tellerrand: Mobile Apps with JavaScript – There's More Than WebHeiko Behrens

abstract from http://2011.beyondtellerrand.com Modern web technologies and responsive design aim at a platform independent code base while promising first-class experience on any mobile device. Even though purely web-based approaches can achieve stunning results, they (still) cannot compete with their native counterpart regarding platform features and integration. In this talk, I will show you how we can use JavaScript to produce mobile apps that include features such as native UI, push notifications, sensors, and paid distribution. You can expect lots of live demos when I will compare the strengths and weaknesses of various frameworks.

SplunkLive! - Getting started with SplunkSplunk

This document provides an overview and introduction to Splunk, an enterprise software platform for searching, monitoring, and analyzing machine-generated big data, such as logs, metrics, and events. The agenda covers what Splunk is, how to get started with Splunk including installing and licensing, basic search functionality, creating alerts and dashboards, deployment and integration options to scale Splunk across multiple sites and systems, and resources for support and the Splunk community. Key capabilities highlighted include searching and analyzing structured and unstructured machine data, indexing petabytes of data per day, role-based access controls, high availability, and integrating with third-party systems.

Users as Datapdingles

The document discusses how users can be viewed as data and how all types of data, including users, code, builds, logs, and more can be treated similarly. It notes that viewing everything as data involves representing it in its most essential form using simple abstractions like maps and sequences. Treating data as data and allowing it to outlive individual applications is advocated. Examples are given of how user data from different sources can be aggregated and queried using event processing techniques.

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Hybrid Growth Mandate Model with TrsLabs Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant. An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices. Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company Talk to us & Unlock the competitive advantage

HCL Nomad Web – Best Practices and Managing Multiuser Environmentspanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-and-managing-multiuser-environments/ HCL Nomad Web is heralded as the next generation of the HCL Notes client, offering numerous advantages such as eliminating the need for packaging, distribution, and installation. Nomad Web client upgrades will be installed “automatically” in the background. This significantly reduces the administrative footprint compared to traditional HCL Notes clients. However, troubleshooting issues in Nomad Web present unique challenges compared to the Notes client. Join Christoph and Marc as they demonstrate how to simplify the troubleshooting process in HCL Nomad Web, ensuring a smoother and more efficient user experience. In this webinar, we will explore effective strategies for diagnosing and resolving common problems in HCL Nomad Web, including - Accessing the console - Locating and interpreting log files - Accessing the data folder within the browser’s cache (using OPFS) - Understand the difference between single- and multi-user scenarios - Utilizing Client Clocking

More Related Content

Similar to Splunk at opa (20)

Hadoop & Hive Change the Data Warehousing Game ForeverDataWorks Summit

Running High-Speed Serverless with nuclioiguazio

112 portfpres.pdfsash236

Active Data: Managing Data-Life Cycle on Heterogeneous Systems and Infrastruc...Gilles Fedak

Getting Started with SplunkSplunk

Advanced kapacitorInfluxData

Scim overviewMorteza Ansari

dlux - Splunk Technical OverviewDavid Lutz

Adam Fuchs' Accumulo Talk at NoSQL Now! 2013Sqrrl

Rich relational data from thin air john stinsonJohn Stinson

Semantic Technologies to Support the User-Centric Analysis of Activity Data Mathieu d'Aquin

Instrumentation with SplunkDatavail

Analytics with SparkProbst Ludwine

Cassandra & puppet, scaling data at $15 per monthdaveconnors

D3 data, user, interactionDummas

MongoDB for AnalyticsMongoDB

nuclio Overview October 2017iguazio

beyond tellerrand: Mobile Apps with JavaScript – There's More Than WebHeiko Behrens

SplunkLive! - Getting started with SplunkSplunk

Users as Datapdingles

Hadoop & Hive Change the Data Warehousing Game ForeverDataWorks Summit

Running High-Speed Serverless with nuclioiguazio

112 portfpres.pdfsash236

Active Data: Managing Data-Life Cycle on Heterogeneous Systems and Infrastruc...Gilles Fedak

Getting Started with SplunkSplunk

Advanced kapacitorInfluxData

Scim overviewMorteza Ansari

dlux - Splunk Technical OverviewDavid Lutz

Adam Fuchs' Accumulo Talk at NoSQL Now! 2013Sqrrl

Rich relational data from thin air john stinsonJohn Stinson

Semantic Technologies to Support the User-Centric Analysis of Activity Data Mathieu d'Aquin

Instrumentation with SplunkDatavail

Analytics with SparkProbst Ludwine

Cassandra & puppet, scaling data at $15 per monthdaveconnors

D3 data, user, interactionDummas

MongoDB for AnalyticsMongoDB

nuclio Overview October 2017iguazio

beyond tellerrand: Mobile Apps with JavaScript – There's More Than WebHeiko Behrens

SplunkLive! - Getting started with SplunkSplunk

Users as Datapdingles

Recently uploaded (20)

TrsLabs - Fintech Product & Business ConsultingTrs Labs

HCL Nomad Web – Best Practices and Managing Multiuser Environmentspanagenda

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex

Toradex brings robust Linux support to SMARC (Smart Mobility Architecture), ensuring high performance and long-term reliability for embedded applications. Here’s how: • Optimized Torizon OS & Yocto Support – Toradex provides Torizon OS, a Debian-based easy-to-use platform, and Yocto BSPs for customized Linux images on SMARC modules. • Seamless Integration with i.MX 8M Plus and i.MX 95 – Toradex SMARC solutions leverage NXP’s i.MX 8 M Plus and i.MX 95 SoCs, delivering power efficiency and AI-ready performance. • Secure and Reliable – With Secure Boot, over-the-air (OTA) updates, and LTS kernel support, Toradex ensures industrial-grade security and longevity. • Containerized Workflows for AI & IoT – Support for Docker, ROS, and real-time Linux enables scalable AI, ML, and IoT applications. • Strong Ecosystem & Developer Support – Toradex offers comprehensive documentation, developer tools, and dedicated support, accelerating time-to-market. With Toradex’s Linux support for SMARC, developers get a scalable, secure, and high-performance solution for industrial, medical, and AI-driven applications. Do you have a specific project or application in mind where you're considering SMARC? We can help with Free Compatibility Check and help you with quick time-to-market For more information: https://www.toradex.com/computer-on-modules/smarc-arm-family

Manifest Pre-Seed Update | A Humanoid OEM Deeptech In Francechb3

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Want to learn practical tips for designing systems that can scale efficiently without compromising speed? Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development. As you explore key principles of designing low-latency systems with Rust, you will learn how to: - Create and compile a real-world app with Rust - Connect the application to ScyllaDB (NoSQL data store) - Negotiate tradeoffs related to data modeling and querying - Manage and monitor the database for consistently low latencies

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/ HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar. Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten. In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich - Zugriff auf die Konsole - Auffinden und Interpretieren von Protokolldateien - Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS) - Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien - Nutzung der Client Clocking-Funktion

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Building 10x Organizations with Modern Productivity Metrics 10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’ Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them. But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

Splunk Security Update | Public Sector Summit Germany 2025Splunk

AI and Data Privacy in 2025: Global TrendsInData Labs

In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy. This infographic contains: -AI and data privacy: Key findings -Statistics on AI data privacy in the today’s world -Tips on how to overcome data privacy challenges -Benefits of AI data security investments. Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john