Automating and Scheduling Data Usage and Reporting

Apr 12, 2019Download as pptx, pdf

0 likes1,380 views

When customers ask for regular reports of data usage and workloads, how do you respond? FME (Safe Software) is the "Go To" tool for automating and scheduling the count and difference of data, generating reports and creating a deliverable. This presentation will show how an automated process was created in a short time to provide a hands-off solution that meets the customers weekly needs using FME desktop and server.

Automating and
scheduling data
usage and
reporting
Austin Hildreth
Department Washington State Revenue

PRESENTATION AGENDA
1
2
3
4
Business Need
Tools for Solution
Build Solution
Production and Output
5 Benefits and Lessons Learned

What was needed?
● Manager needs insight to progress and
workload.
● Weekly updates to enterprise data.
● Multiple spatial data sets.
● Time/resources to build reports.
● XX hours to create custom report.

Safe Software
• Desktop 2018
• Server 2018
Microsoft
• Management Studio 2014
• Server 2012
ESRI
• Desktop 10.6.1
• AGS 10.6.1
• Portal 10.6.1
Tools

Conceptual Workflow
1. Clip the current data to a snapshot from previous weeks data.
2. Write Added and Deleted data to a table.
3. Run workspace for new snapshot.
4. Run workspace for email notification.

Benefits
- Transparency of
process.
- Ease of access and
sharing.
- Resources can do other
work.
- 2 weeks to implement.

Lessons Learned
- Custom Transformers.
- Leverage all the tools
of FME server.
- Let FME do the work.

The Town of East Gwillimbury is experiencing dramatic urban growth that will persist over the next few years. The Town wanted to visualize, monitor and report on the status of new development thereby assisting staff to effectively manage workflows: Commence road patrols for maintenance, snow removal, garbage collection, fire break allocations and monitoring. In an effort to effectively service the growth that is occurring and plan for the future, staff need data to make intelligence-based decisions and create effective workflows. The result is a web-based enterprise solution powered by FME and Esri servers that provides corporate-wide visualization and quantitative information on current development status: 1) Web map app available on all devices with LDAP authentication. 2) Email notifications for permitting by status change and data quality control monitoring. 3) Automated spreadsheet report tracking percentage complete milestones. 4) Update Dashboard report for improved decisions making and workflow activities. 5) New water meter installation tracking – improves asset management and enables financial

Keeping a Common Address Database “Common” Using FMESafe Software

The City of Hamilton has undertaken an initiative to establish a single authoritative (“Common”) property address and street centreline database. All city wide systems and services requiring address data or address validation are able to access this common database as a trusted source for addresses and street centrelines. A single authoritative database works in principle where systems and users are able to access the database directly. In many cases, address and street data must be transferred to other systems that cannot directly access the address database due to limitations of security access, limitations of ability to consume data services or require special reformatting of address data to meet the their respective systems data formats. This presentation will outline the City’s business needs for utilizing address and street data and our experiences of how FME was used to meet these needs.

Using FME to Transform Survey 123 DataSafe Software

Esri's Survey 123 is a great tool for field data collection, but does not provide an efficient platform for ongoing maintenance with the collected data. This presentation will demonstrate a business process workflow that invokes two different FME workspaces: one for transformation from ArcGIS Online into both Excel and an Esri file geodatabase. In these repositories, the data is QC'd using a second FME workspace that is invoked in a cyclical process cycle until 100% data acceptance is achieved. The resulting transformation provides data repositories in Excel for reporting with Power BI, and ArcGIS Pro for re-publishing in a clean state back to ArcGIS Online.

Improve Operational Efficiency in AEC with Data IntegrationSafe Software

With the fast-rising adoption of digital technologies, architecture, engineering, and construction (AEC) companies have started to leverage data to achieve operational ease by integrating data across systems, streamlining project workflows, and making data accessible. Join us as we walk through the AEC project lifecycle and explore how FME can help you increase operational efficiency at each stage of the project. Through customer stories and live demos, we will explore tips for overcoming common data challenges using FME including: - Creating data transformation workflows, such as CAD to GIS, point clouds to 3D models, and integrating data for facilities management. - Automating data integration workflows without any coding. We will run a Q&A session at the end to answer any questions you might have. Make sure to tune in!

The Masked Revit User: Exploring Limitless PossibilitiesSafe Software

This document summarizes a presentation about using Revit data with FME software. It introduces the presenters, which include the co-founder of Safe Software and a senior technical support specialist. It then provides an overview of the agenda, which will cover exporting Revit data to Excel, detecting changes in Revit, creating web maps and reports from Revit, exporting to IMDF format, and augmented reality. The presentation aims to help attendees maximize the value of their Revit data by using FME to connect, transform, and automate Revit workflows.

Integrating Utility Data into a SCADA DashboardSafe Software

5 Ways to Improve Your LiDAR WorkflowsSafe Software

This document discusses 5 ways to improve LiDAR workflows using FME software. It begins with an overview of LiDAR and point clouds before addressing each of the 5 ways: 1) simplifying point cloud transformations with FME transformers, 2) preparing data, 3) automating surface model creation, 4) visualizing solutions through 3D city modeling, and 5) expanding tools with FME Hub and third party tools like LAStools. The presentation concludes by emphasizing how FME can help simplify and scale LiDAR workflows.

Processing Building Plans Faster and More Thoroughly using FME ServerSafe Software

Many large organizations expend significant financial and human resources managing facilities. To help with this effort, organizations have implemented Integrated Workplace Management Systems (IWMS). These systems are data intensive and rely on accurate, timely, high quality data. The US Federal Government’s management model challenges this approach because facilities are owned by one large federal agency and managed and/or used by others. This means data is constantly flowing from one agency to another. For larger federal agencies, managing this data flow is a challenge in and of itself. To address the problem, Avineon is assisting a very large, nationwide federal agency to ingest, standardize, QC, and validate source AutoCAD plans using FME Server, saving federal workers countless hours while improving overall data quality. This presentation will showcase the development, implementation, and use of FME Server to help streamline this entire process.

Using FME to Transform and Integrate Optical Connection Data Between SystemsSafe Software

Data Scenarios 2020: 6 Amazing TransformationsSafe Software

FME, The Tool to Use When Standing Up a New Fiber UtilitySafe Software

We will cover the use of FME technology to interface with survey data in judging pre-enrollment of prospective fiber utility clients, logging and acknowledging enrollment and translation to marketing efforts for a complete picture of take rate. We will also show how we use FME to translate data to our very complex fiber map schema for use in inspection, construction of the utility, as-built's and final homes passed records of clients after they take service. Overall, FME has been integral in standing up our new utility from start-up to construction, as-built changes all the way to billing our customers. We have multiple FME workbenches as well as FME server processes to show.

Extend the Value of Your BIM (& Revit) Data with FME: Part 2Safe Software

The document summarizes a webinar that demonstrated using FME software to extract and transform building information modeling (BIM) data from Revit for various uses. It introduced the presenters and prerequisites, and outlined an agenda including producing enriched floor plans from Revit, georeferencing Revit data using Google Earth, calculating material takeoffs, and converting Revit to ArcGIS Indoors. Live demos then showed each of these processes and transformations of BIM data using FME. Resources for additional FME and BIM tutorials and information on licensing options were provided at the end.

Survey Data ManagementSafe Software

Survey Data Management was a new concept to Devon Energy. Melanie Duncan and Mike Sughru took an enterprise approach to solving the company’s problem of non-standardized data being submitted to Devon Energy and processed manually. Through their initiative; they now accept survey jobs that fully meet their standards, and reject survey jobs that do not meet their standards in an automated process with FME. They have also integrated their process with a web map that triggers table and spatial changes by communicating with FME server. Reducing and automating the process time it takes per job with FME has enabled them to accept more spatially aware data for the company to leverage and expose the data in an enterprise fashion to allow faster business decisions to be made.

Synchronizing Data Between Smallworld and Azure Cosmos DBSafe Software

Connecting Systems Across The EnterpriseSafe Software

Tips & Tricks for Using FME for Business IntelligenceSafe Software

Business intelligence platforms like Tableau, Qlik and Power BI enable users to visually identify patterns in their data. When the data to be analyzed is in disparate formats and structures it requires some blending and/or remodelling prior to being loaded into the BI system. Although this may be done manually, this carries a risk of introducing error, and can also be tedious. This webinar will demonstrate the ways FME can be used to prepare data automatically to save time and errors.

Application Integration for Smart CitiesSafe Software

Smart Cities want to provide a better quality of life for citizens. To accomplish this, their staff need to be enabled to focus on innovation rather than repetitive enterprise integration tasks. Whether you work for a city or support local government clients, this webinar will provide an overview of why application integration is valuable, and set you on the path to success. We’ll start by exploring how FME, the data integration platform with the best support for spatial data, enables your data to flow freely between the applications you’ve chosen. You’ll see examples including Cityworks and Esri, and discover tips & tricks for leveraging your applications’ APIs. Whether you’re creating work orders, enabling citizens to report potholes, or delivering open data, information needs to flow automatically. This webinar will help you get started.

Using Non-Spatial Dashboard to Update Spatial FeaturesSafe Software

This presentation covers the usage of a user update able non-spatial dashboard that is accessed through a FME translation to generate spatial features. The features are accessed through a JSON data streaming service on FME server. The presentation will show FME users how to access the data streaming service, generate spatial features based on the parameters, and display those spatial features on the WEBGL virtual globe, Cesium.

Visualizing Data in a Web Browser with Cesium ion & FMESafe Software

Building Your First Digital File Submission Safe Software

Creating a digital file submission using FME can allow you to automate routine tasks that may otherwise take you hours, if not days, to complete. During this webinar, our team of Support Specialists will show you how to add time back in your day and money back in your pocket using this automation tactic. They’ll take you through how to get started with your first digital file submission and give you an inside glimpse into what happens to the file after it has been built into an automation. They’ll also share a real life story of what a local government team made possible with their own digital submission plan using FME and some tips and tricks you can use along the way. Don’t miss out on the chance to learn how you can save your city time and money. We hope to see you there!

From Outdoor to Indoor: 3D and Venue Mapping – FME Summer CampSafe Software

Indoor mapping is an exciting new opportunity for business, but it does not come without challenges. With complex data conversion, the merging of spatial and tabular data, and the added difficulty of changing venues, it can turn any venue into a Mess Hall. By adding new Readers and Writers to FME 2018–including IMDF–we're making it easy for you to validate, update, automate, and analyze indoor mapping data.

Web Mapping 101: What Is It and Making It Work For YouSafe Software

Web mapping is the process of using the internet to visualize, analyze, and share your geospatial data through a map. Web maps are an important tool for many organizations as they provide the ability to distribute critical information to anyone, anywhere, and at any time. Web maps provide endless potential for visualizing valuable data that may otherwise go unused. But, not everyone knows how to get started with creating one. In this webinar, we’ll cover: - An overview of web mapping and how it works - How OpenLayers and Leaflet work with web mapping - How to use web mapping tools, including Esri Leaflet and Mapbox with the HTMLReportGenerator - How to create vector tilesets in FME to make web mapping easier than ever Join our team of Support Specialists to learn how to get started using FME to create a web map of your own to visualize and share your data. Stop wasting the value of your geospatial data by letting it sit unused. You’ll leave this webinar with the tools to get you started with creating a web map of your own so you can present your data in a way thats easy to understand and share with others.

Data Integration + Location Intelligence = Better DecisionsSafe Software

Using FME to Deliver Map-Based Geological Data for Oil & Gas CompaniesSafe Software

How to Begin Making “Data-Driven Decisions" Using Data IntegrationSafe Software

If you’re in the corporate world, chances are you’ve heard this phrase in the last year: “we need to make data-driven decisions.” It’s a simple phrase but often complicated to implement as it involves identifying KPIs, collecting the measurable data, analyzing the data for facts, and turning the insights into actions that will grow your business. So how exactly do you start the process of “data-driven decisions” when there is data everywhere – data of all different kinds and in all different locations? The task can sound downright daunting or even impossible. Our ability to freely share and use data is too often plagued with interoperability challenges. Data integration is the key to alleviating this problem. Put simply, data integration helps different systems and formats work together. The ultimate goal is to generate valuable and usable information to help solve problems and gain new insights, a.k.a. data-driven decisions! In this webinar, learn how data integration can be used in any and all industries. And see how the workflows increase communication between departments, provide better customer service, streamline operations, improve decision making, and overall increase productivity.

All your BIM are belong to us - Revit and FME for Enterprise Data ManagementSafe Software

Aggregation and standardization of financial transactions from multiple marke...Safe Software

This document discusses MapSherpa's process for aggregating and standardizing financial transactions from multiple marketplaces into a single database. MapSherpa sells print maps through various channels, including their own platform, Amazon, and MapTrove. They needed a way to collect sales data from these disparate sources and calculate additional costs like printing, shipping, and royalties in a standardized format. The solution involves using FME to extract and transform data from CouchDB, CSV files, Amazon MWS API, and Google Sheets into normalized tables in PostgreSQL. Reports are then generated from these tables in Google Data Studio for accounting and business decisions.

Leveraging Autodesk Products with FME: AutoCAD to GIS is Only the BeginningSafe Software

201601007 Limelight - Hui Qin TeohHui Qin Teoh, PMP®

The LIMELIGHT project aimed to improve efficiency in Huawei's Project Management Office (PMO) space by automating report generation and distributing workload. It developed automated reports in Excel, assigned one resource to run reports instead of each manager, and established data governance. This reduced time spent on reports by 49% (156 hours/month) and other cost savings. Benefits included improved productivity, motivation, delivery numbers, and customer experience through decreased waiting times. The project was completed on October 7, 2016 and its processes may be expanded to other teams.

Eric Drucker Resume 07-2016 - ITEric Drucker

More Related Content

What's hot (20)