AWS Auditing Security Checklist PDF
AWS Auditing Security Checklist PDF
October 2015
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Notices
This document is provided for informational purposes only. It represents AWSs
current product offerings and practices as of the date of issue of this document,
which are subject to change without notice. Customers are responsible for
making their own independent assessment of the information in this document
and any use of AWSs products or services, each of which is provided as is
without warranty of any kind, whether express or implied. This document does
not create any warranties, representations, contractual commitments, conditions
or assurances from AWS, its affiliates, suppliers or licensors. The responsibilities
and liabilities of AWS to its customers are controlled by AWS agreements, and
this document is not part of, nor does it modify, any agreement between AWS
and its customers.
Page 2 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Contents
Abstract 4
Introduction 5
Approaches for using AWS Audit Guides 6
Examiners 6
AWS Provided Evidence 6
Auditing Use of AWS Concepts 8
Identifying assets in AWS 9
AWS Account Identifiers 9
1. Governance 10
2. Network Configuration and Management 14
3. Asset Configuration and Management 15
4. Logical Access Control 17
5. Data Encryption 19
6. Security Logging and Monitoring 20
7. Security Incident Response 21
8. Disaster Recovery 22
9. Inherited Controls 23
Appendix A: References and Further Reading 25
Appendix B: Glossary of Terms 26
Appendix C: API Calls 27
Page 3 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Abstract
Security at AWS is job zero. All AWS customers benefit from a data center and
network architecture built to satisfy the needs of the most security-sensitive
organizations. In order to satisfy these needs, AWS compliance enables
customers to understand the robust controls in place at AWS to maintain security
and data protection in the cloud.
AWS manages the underlying infrastructure, and you manage the security of
anything you deploy in AWS. AWS as a modern platform allows you to formalize
the design of security, as well as audit controls, through reliable, automated and
verifiable technical and operational processes built into every AWS customer
account. The cloud simplifies system use for administrators and those running
IT, and makes your AWS environment much simpler to audit sample testing, as
AWS can shift audits towards a 100% verification verses traditional sample
testing.
Page 4 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Introduction
As more and more customers deploy workloads into the cloud, auditors
increasingly need not only to understand how the cloud works, but additionally
how to leverage the power of cloud computing to their advantage when conducting
audits. The AWS cloud enables auditors to shift from percentage-based sample
testing toward a comprehensive real-time audit view, which enables 100%
auditability of the customer environment, as well as real-time risk management.
The AWS management console, along with the Command Line Interface (CLI),
can produce powerful results for auditors across multiple regulatory, standards
and industry authorities. This is due to AWS supporting a multitude of security
configurations to establish security, compliance by design, and real-time audit
capabilities through the use of:
Page 5 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Page 6 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
For more information about the security regulations and standards with which
AWS complies, see the AWS Compliance webpage.
Page 7 of 28
Auditing Use of AWS Concepts
The following concepts should be considered during a security audit of an
organizations systems and data on AWS:
Security measures that the cloud service provider (AWS) implements and
operates "security of the cloud"
While AWS manages security of the cloud, security in the cloud is the
responsibility of the customer. Customers retain control of what security they
choose to implement to protect their own content, platform, applications,
systems and networks, no differently than they would for applications in an on-
site datacenter.
Additional detail can be found at the AWS Security Center, at AWS Compliance,
and in the publically available AWS whitepapers found at: AWS Whitepapers
Identifying assets in AWS
A customers AWS assets can be instances, data stores, applications, and the
data itself. Auditing the use of AWS generally starts with asset identification.
Assets on a public cloud infrastructure are not categorically different than in-
house environments, and in some situations can be less complex to inventory
because AWS provides visibility into the assets under management.
Each certification means that an auditor has verified that specific security
controls are in place and operating as intended.
Amazon Web Services OCIE Cybersecurity Audit Guide September 2015
1. Governance
Definition: Governance provides assurance that customer direction and intent
are reflected in the security posture of the customer. This is achieved by utilizing
a structured approach to implementing an information security program. For the
purposes of this audit plan, it means understanding which AWS services have
been purchased, what kinds of systems and information you plan to use with the
AWS service, and what policies, procedures, and plans apply to these services.
Major audit focus: Understand what AWS services and resources are being
used and ensure your security or risk management program has taken into
account the use of the public cloud environment.
Audit approach: As part of this audit, determine who within your organization
is an AWS account and resource owner, as well as the AWS services and
resources they are using. Verify policies, plans, and procedures include cloud
concepts, and that cloud is included in the scope of the customers audit program.
Governance Checklist
Checklist Item
Understand use of AWS within your organization. Approaches might include:
Note: Some individuals within your organization may have signed up for an AWS account
under their personal accounts, as such, consider asking if this is the case when polling or
interviewing your IT and development teams.
Identify assets. Each AWS account has a contact email address associated with it and
can be used to identify account owners. It is important to understand that this e-mail
address may be from a public e-mail service provider, depending on what the user
specified when registering.
A formal meeting can be conducted with each AWS account or asset owner to
Page 10 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Checklist Item
understand what is being deployed on AWS, how it is managed, and how it has been
integrated with your organizations security policies, procedures, and standards.
Note: The AWS Account owner may be someone in the finance or procurement
department, but the individual who implements the organizations use of the AWS
resources may reside in the IT department. You may need to interview both.
Define your AWS boundaries for review. The review should have a defined scope.
Understand your organizations core business processes and their alignment with IT, in
its non-cloud form as well as current or future cloud implementations.
Obtain a description of the AWS services being used and/or being considered for use.
After identifying the types of AWS services in use or under consideration, determine
the services and business solutions to be included in the review.
Obtain and review any previous audit reports with remediation plans.
Identify open issues in previous audit reports and assess updates to the documents
with respect to these issues.
Assess policies. Assess and review your organizations security, privacy, and data
classification policies to determine which policies apply to the AWS service environment.
Verify if a formal policy and/or process exists around the acquisition of AWS services
to determine how purchase of AWS services is authorized.
Identify risks. Determine whether a risk assessment for the applicable assets has been
performed.
Review risks. Obtain a copy of any risk assessment reports and determine if they reflect
the current environment and accurately describe the residual risk environment.
Review risks documentation. After each element of your review, review risk
treatment plans and timelines/milestones against your risk management policies and
Page 11 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Checklist Item
procedures.
Documentation and Inventory. Verify your AWS network is fully documented and
all AWS critical systems are included in their inventory documentation, with limited
access to this documentation.
Review AWS Config for AWS resource inventory and configuration history of
resources (Example API Call, 1).
Ensure that resources are appropriately tagged and associated with application data.
Review all connectivity between your network and the AWS Platform by reviewing
the following:
VPN connections where the customers on-premise Public IPs are mapped to
customer gateways in any VPCs owned by the Customer.
(Example API Call, 2 & 3). Direct Connect Private Connections, which may be
mapped to 1 or more VPCs owned by the customer. (Example API Call, 4)
AWS assets should be identified and have protection objectives associated with them,
depending on their risk profiles.
Incorporate use of AWS into risk assessment. Conduct and/or incorporate AWS
service elements into your organizational risk assessment processes. Key risks could
include:
Identify the business risk associated with your use of AWS and identify business
owners and key stakeholders.
Verify that the business risks are aligned, rated, or classified within your use of AWS
services and your organizational security criteria for protecting confidentiality,
Page 12 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Checklist Item
integrity, and availability.
Review previous audits related to AWS services (SOC, PCI, NIST 800-53 related
audits, etc.).
Determine if the risks identified previously have been appropriately addressed.
Evaluate the overall risk factor for performing your AWS review.
Based on the risk assessment, identify changes to your audit scope.
Discuss the risks with IT management, and adjust the risk assessment.
IT Security Program and Policy. Verify that the customer includes AWS services in
its security policies and procedures, including AWS account level best practices as
highlighted within the AWS service Trusted Advisor which provides best practice and
guidance across 4 topics Security, Cost, Performance and Fault Tolerance.
Review your information security policies and ensure that it includes AWS services.
Confirm you have has assigned an employee(s) as authority for the use and security
of AWS services and there are defined roles for those noted key roles, including a
Chief Information Security Officer.
Note: any published cybersecurity risk management process standards you have used to
model information security architecture and processes.
Ensure you maintain documentation to support the audits conducted for AWS
services, including its review of AWS third-party certifications.
Verify internal training records include AWS security, such as Amazon IAM usage,
Amazon EC2 Security Groups, and remote access to Amazon EC2 instances.
Note: any insurance specifically related to the customers use of AWS services and any
claims related to losses and expenses attributed to cybersecurity events as a result.
Service Provider Oversight. Verify the contract with AWS includes a requirement to
implement and maintain privacy and security safeguards for cybersecurity requirements.
Page 13 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Network Controls. Identify how network segmentation is applied within the AWS
environment.
Review AWS Security Group implementation, AWS Direct Connect and Amazon
VPN configuration for proper implementation of network segmentation and ACL
and firewall setting or AWS services (Example API Call, 5 - 8).
Verify you have a procedure for granting remote, Internet or VPN access to
employees for AWS Console access and remote access to Amazon EC2 networks and
systems.
Page 14 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Checklist Item
isolation is in place between VPCs
Subnet isolation is in place between business environment and
environments used for test and development.
By reviewing NACLs associated to Subnets in which Business and
Test/Development environments are located to ensure network isolation is
in place.
Amazon EC2 instance isolation is in place between business environment
and environments used for test and development.
By reviewing Security Groups associated to 1 or more Instances which are
associated with Business, Test or Development environments to ensure
network isolation is in place between Amazon EC2 instances
Review DDoS layered defense solution running which operates directly on AWS
reviewing components which are leveraged as part of a DDoS solution such as:
Amazon CloudFront configuration
Amazon S3 configuration
Amazon Route 53
ELB configuration
Note: The above services do not use Customer owned Public IP
addresses and offer DoS AWS inherited DoS mitigation features.
Usage of Amazon EC2 for Proxy or WAF
Further guidance can be found within the AWS Best Practices for DDoS
Resiliency Whitepaper
Page 15 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Major audit focus: Manage your operating system and application security
vulnerabilities to protect the security, stability, and integrity of the asset.
Review your Identity Access Management system (which may be used to allow
authenticated access to the applications hosted on top of AWS services).
Change Management Controls. Ensure use of AWS services follows the same change
control processes as internal series.
Verify AWS services are included within an internal patch management process.
Review documented process for configuration and patching of Amazon EC2
instances:
Amazon Machine Images (AMIs) (Example API Call, 9 - 10)
Operating systems
Applications
Review API calls for in-scope services for delete calls to ensure IT assets have been
properly disposed of.
Page 16 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Major audit focus: This portion of the audit focuses on identifying how users
and permissions are set up for the services in AWS. It is also important to ensure
you are securely managing the credentials associated with all AWS accounts.
Audit approach: Validate permissions for AWS assets are being managed in
accordance with organizational policies, procedures, and processes. Note: AWS
Trusted Advisor can be leveraged to validate and verify IAM Users, Groups, and
Role configurations.
Page 17 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Checklist Item
federated authentication, which leverages the open standard Security
Assertion Markup Language (SAML) 2.0.
List of AWS Accounts, Roles, Groups and Users, Policies and policy
attachments to users, groups, and roles (Example API Call, 11).
Direct Connect (cross connect and private interfaces) between firm and
AWS.
Defined Security Groups, Network Access Control Lists and Routing tables
in order to control access between AWS and the network.
Personnel Control. Ensure restriction of users to those AWS services strictly for their
business function (Example API Call, 12).
Review the type of access control in place as it relates to AWS services.
AWS access control at an AWS level using IAM with Tagging to control
management of Amazon EC2 instances (start/stop/terminate) within
networks
Customer Access Control using IAM (LDAP solution) to manage access
to resources which exist in networks at the Operating System / Application
layers
Page 18 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Checklist Item
Network Access control using AWS Security Groups (SGs) , Network
Access Control Lists (NACLs), Routing Tables, VPN Connections, VPC
Peering to control network access to resources within customer owned
VPCs.
5. Data Encryption
Definition: Data stored in AWS is secure by default; only AWS owners have
access to the AWS resources they create. However, customers who have sensitive
data may require additional protection by encrypting the data when it is stored
on AWS. Only the Amazon S3 service currently provides an automated, server-
side encryption function in addition to allowing customers to encrypt on the
customer side before the data is stored. For other AWS data storage options, the
customer must perform encryption of the data.
Major audit focus: Data at rest should be encrypted in the same way as on-
premise data is protected. Also, many security policies consider the Internet an
insecure communications medium and would require the encryption of data in
transit. Improper protection of data could create a security exposure.
Audit approach: Understand where the data resides, and validate the methods
used to protect the data at rest and in transit (also referred to as data in flight).
Note: AWS Trusted Advisor can be leveraged to validate and verify permissions
and access to data assets.
Page 19 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Checklist Item
Encryption for S3 which could be used to assist with data at rest encryption
(Example API Call, 13-15).
Major audit focus: Systems must be logged and monitored, just as they are for
on-premise systems. If AWS systems are not included in the overall company
security plan, critical systems may be omitted from scope for monitoring efforts.
Audit approach: Validate that audit logging is being performed on the guest
OS and critical applications installed on Amazon EC2 instances and that
implementation is in alignment with your policies and procedures, especially as it
relates to the storage, protection, and analysis of the logs.
Page 20 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Checklist Item
Confirm aggregation and correlation of event data from multiple sources using
AWS services such as:
VPC Flow logs to identify accepted/rejected network packets entering
VPC.
AWS CloudTrail to identify authenticated and unauthenticated API
calls to AWS services
ELB Logging Load balancer logging.
AWS CloudFront Logging Logging of CDN distributions.
Page 21 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
8. Disaster Recovery
Definition: AWS provides a highly available infrastructure that allows
customers to architect resilient applications and quickly respond to major
incidents or disaster scenarios. However, customers must ensure that they
configure systems that require high availability or quick recovery times to take
advantage of the multiple Regions and Availability Zones that AWS offers.
Page 22 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Business Continuity Plan (BCP). Ensure there is a comprehensive BCP, for AWS
services utilized, that addresses mitigation of the effects of a cybersecurity incident
and/or recover from such an incident.
Within the Plan, ensure that AWS is included in the emergency preparedness and
crisis management elements, senior manager oversight responsibilities, and the
testing plan.
Backup and Storage Controls. Review the customers periodic test of their backup
system for AWS services (Example API Call, 17-18).
1. Review inventory of data backed up to AWS services as off-site backup.
9. Inherited Controls
Definition: Amazon has many years of experience in designing, constructing,
and operating large-scale datacenters. This experience has been applied to the
AWS platform and infrastructure. AWS datacenters are housed in nondescript
facilities. Physical access is strictly controlled both at the perimeter and at
building ingress points by professional security staff utilizing video surveillance,
intrusion detection systems, and other electronic means. Authorized staff must
pass two-factor authentication a minimum of two times to access datacenter
floors. All visitors and contractors are required to present identification and are
signed in and continually escorted by authorized staff.
Page 23 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Audit approach: Understand how you can request and evaluate third-party
attestations and certifications in order to gain reasonable assurance of the design
and operating effectiveness of control objectives and controls.
Physical Security & Environmental Controls. Review the AWS provided evidence
for details on where information on intrusion detection processes can be reviewed that
are managed by AWS for physical security controls.
Conclusion
There are many third-party tools that can assist you with your assessment. Since
AWS customers have full control of their operating systems, network settings,
and traffic routing, a majority of tools used in-house can be used to assess and
audit the assets in AWS.
A useful tool provided by AWS is the AWS Trusted Advisor tool. AWS Trusted
Advisor draws upon best practices learned from AWS aggregated operational
history of serving hundreds of thousands of AWS customers. The AWS Trusted
Advisor performs several fundamental checks of your AWS environment and
makes recommendations when opportunities exist to save money, improve
system performance, or close security gaps.
This tool may be leveraged to perform some of the audit checklist items to
enhance and support your organizations auditing and assessment processes.
Page 24 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Page 25 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
EC2: Amazon Elastic Compute Cloud (Amazon EC2) is a web service that
provides resizable compute capacity in the cloud. It is designed to make web-
scale cloud computing easier for developers.
IAM: AWS Identity and Access Management (IAM) enables a customer to create
multiple Users and manage the permissions for each of these Users within their
AWS Account.
Object: The fundamental entities stored in Amazon S3. Objects consist of object
data and metadata. The data portion is opaque to Amazon S3. The metadata is a
set of name-value pairs that describe the object. These include some default
metadata such as the date last modified and standard HTTP metadata such as
Content-Type. The developer can also specify custom metadata at the time the
Object is stored.
Service: Software or computing ability provided across a network (e.g., EC2, S3,
VPC, etc.).
Page 26 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Page 27 of 28
Amazon Web Services Introduction to Auditing the Use of AWS October 2015
Page 28 of 28