Using ArcGIS Server in EC2
Download as PPTX, PDF1 like1,358 views
The document discusses setting up ArcGIS Server on Amazon EC2, detailing instance options, pricing, and deployment considerations. It provides technical insights into data services, performance optimization, and the importance of planning for deployment. Key points include costs for different instance types and lessons learned from the setup process.
Using ArcGIS Server in EC2
- 1. Choices http://www.flickr.com/photos/paulsynnott/3392386740 ArcGIS Server Dave Bouwman [email protected] Twitter: @dbouwman In Amazon EC2
- 3. http://www.flickr.com/photos/joriel/4959821795 F# Ruby Haskel Javascript Objective C Java bashPython PHP Scala PowerBuilder C++ smalltalk Flex / ActionScript ASP.NET MVC
- 4. +
- 7. Enuf! Deploys meh codez nao! http://www.flickr.com/photos/kwl/4116389731
- 8. ArcGIS Server v10 (pre-release) .NET v4 ForestHealth.us
- 17. ArcGIS Server in EC2 http://www.flickr.com/photos/paulsynnott/3391584753
- 25. ArcGIS Server SQL Server / ArcSDE Web Server
- 26. Pricing
- 27. $0.48 * 24h * 30d = $345.60 Large Instance 7.5 GB memory 4 EC2 Compute Units (2 virtual cores with 2 EC2 Compute Units each) 850 GB instance storage 64-bit platform I/O Performance: High API name: m1.large Production
- 28. $0.12 * 8h * 20d = $19.20 Small Instance 1.7 GB memory 1 EC2 Compute Unit (1 virtual core with 1 EC2 Compute Unit) 160 GB instance storage 32-bit platform I/O Performance: Moderate API name: m1.small $0.12 * 24h * 30d = $86.40 dev / demo
- 31. RDP
- 32. Now what? Move The app! http://www.flickr.com/photos/taniaedu/1554390505
- 33. ArcGISOnline Tile Service ArcGIS Feature Service Data Service (ASP.NET MVC)
- 34. Application
- 37. http://www.flickr.com/photos/mikumin/4160710773 No SQL + ArcSDE? Wha?!
- 38. Vector Data
- 41. Performance
- 42. ArcGIS Server
- 43. Douglas-Peucker
- 45. %
- 46. %
- 48. Spatial Views
- 50. Definition Query: Year = 2009 and StateFips = 08 and DCA = 11009
- 51. VIEW
- 54. ~240ms: query, render and transfer
- 57. Tabular data SQL Express
- 62. Use Desktop on EC2
- 63. Test REST API remotely
- 65. hours
- 67. Lessons Learned:
- 69. Inexpensive to get started
- 71. Re-Cap*
- 75. Pack up the data http://www.flickr.com/photos/mujitra/2192326482
Editor's Notes
- #3: It’s a great time to be a Geodeveloper
- #5: Move from an idea
- #6: To a working application very quickly
- #7: And so we are seeing a change in project timelines. Specifically, in larger orgnaiztions,
- #8: And so this can be somewhat frustrating.
- #9: This is exactly where we were this spring. We had created a suite of application for the US Forest Service, and wanted to launch the Public facing application.
- #18: Since there was no option to run ArcGIS Server pre-release on USDA servers, we talked with Esri and were able to join the EC2 beta program.
- #19: Of course today, it’s a little easier – if you have an EDN license, you can use ArcGIS Server on EC2 for development and testing.
- #21: First off, there is no free lunch here, so grab your credit card…
- #22: Create an Amazon Web Services account,
- #23: Once you’ve got your AWS account, the next step is to get in touch with Esri and ask for “Amys”
- #24: Once you’ve got an account, you need access to the Amazon Machine Images. These are pre-configured machines just waiting to be called into action. Sitting on a shelf if you will. http://www.flickr.com/photos/yakinik/4625973891
- #26: In our office, we have 3 physical servers involved…
- #27: But when we move to the cloud, we need to think about what this is gonna cost on a montly basis…
- #28: A Larger Instance for Production will run ~350/mo But if that’s too rich for your blood,
- #29: You can run a small instance for dev/demo Work hours only ~20/mo
- #30: Given that we were doing a proof of concept for our client, AND we were beta testing, we opted to go cheap, and run everything in a single large instance With that behind us it was time to fire things up, which is super easy… Launch Instance… get a coffee, and…
- #31: Esri has come convenient video walk-thrus for this, so we’ll skip this part. Suffice to say it takes about 10 minutes.
- #32: And then you can RDP to the server.
- #33: http://www.flickr.com/photos/taniaedu/1554390505
- #34: Our application talks to 3 types of services – a tile service hosted by Esri, a Feature service for the interative state/county boundaries and a custom data service running in ASP.NET MVC.
- #35: Since everything was service based and configurable, the no changes were required to the application tier. In fact, the first thing we did was push the application across and validate that it still worked – only hitch was that it was still hitting our servers for data! ;-)
- #36: Our original data storage design was another story. Since the plan was to deploy this at a USDA data center, keeping both the spatial and tabular data in the same database is easiest. Simple enough in SQL Server…
- #37: It’s just a little “messy” shall we say.
- #38: But we don’t have ArcSDE, and more specifically we don’t even have the option ArcSDE on SQL Server over in EC2. So time to rip things apart.
- #41: Ok, whew! Using ArcCatalog, this is about a 30 second operation, which is good because that leaves us a little time to talk about
- #42: Performance! Specifically how we can get our app to be faster.
- #43: ArcGIS Server does a lot of different “things” on the back end, but if you boil it down it serves two things: Images and Json
- #44: Essentially “generalization” is the process of removing nodes from a line, while still retaining the character of it’s shape. Most commonly done using the Douglas Peucker algorithm but
- #45: Also done via a simple tool in ArcGIS. Ok Why?
- #46: Data on the wire as Json. This essentailly made it possible to have deal with the boundary layers as features. Otherwise it was taking more than a minute to load and parse just the States!
- #47: But that’s not the only benefit – by having fewer line segments, we see substantial decreases in rendering time for images
- #48: Back to our tale… http://www.flickr.com/photos/craigmdennis/3557378176
- #50: Since the counties effectively don’t change, but the additional pest records are added annually, the best option is to set this up as a spatial view in ArcSDE,
- #51: and have the application set definition queries to just show specific data… But, we don’t have ArcSDE… so we bit the bullet and de-normalize the data.
- #53: Again, using ArcCatalog. All well and good but now we have a feature class with more than 100,000 features in it.
- #56: Custom data service running in ASP.NET MVC.
- #57: This is the tabular data that was stored along side the spatial data. Since we are storing this in SQL Express in EC2, we need to
- #58: e wanted to keep the database as small as possible so we “extracted” the tabular data into it’s own SQL database.
- #59: So at this point we’ve changed up our data so we have a File Geodatabase, and a SQL database. We zipped these files up and we’re ready to roll.
- #60: http://www.flickr.com/photos/mujitra/2134721435
- #63: Once we have the files up on the server, I just used ArcCatalog to publish the map services
- #67: Your instance is alive! But before you can play with it there are a few more things to do… http://www.flickr.com/photos/49488791@N03/4538548843
- #69: It’s very easy to get started – between the documentation provided by Esri and Amazon (which you have to read!) it’s very straight forward
- #71: If you are building a new application, deciding on the cloud deployment environment early will help avoid the data juggling we had to go through. Specifically – File Geodatabase is your Friend.
- #72: Assuming you have an EDN license ;-)
- #73: First, get approval to spend some money… and setup an Amazon AWS account http://www.flickr.com/photos/mujitra/2527174367
- #74: Pick the size and types of instances you want http://www.flickr.com/photos/yakinik/4625973891
- #75: Light it up and do some house keeping
- #76: Pack up your data and application code… http://www.flickr.com/photos/mujitra/2192326482
- #77: Re-Deploy map services
- #78: And bask in the glow of cloud awesomeness! http://www.flickr.com/photos/seannaber/4043266651