0% found this document useful (0 votes)
37 views

2024 - FCJ - Week 1 - Addons

Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
37 views

2024 - FCJ - Week 1 - Addons

Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 146

Introduction to AWS

Week 1 – Module 1

Hung Nguyen Gia


Solutions Architect Lead
Champion Authorized Instructor

© Amazon Web Services, Inc. or its Affiliates.


Agenda – Module 1

§ Introduction to AWS
§ AWS Global Infrastructure
§ Cost Management
§ Cost Optimization
§ Kahoot Game
§ Labs

© Amazon Web Services, Inc. or its Affiliates.


Introduction to AWS

© Amazon Web Services, Inc. or its Affiliates.


What is AWS ?
AWS provides a highly reliable, scalable, low-cost infrastructure platform
in the cloud that powers millions of businesses in over 190 countries
around the world.

Benefits
§ Optimize Cost
§ Secure
§ Fast Innovation Pace
§ Operational Excellence
§ Global Reach

© Amazon Web Services, Inc. or its Affiliates.


Why customers choose AWS
EXPERIENCE GLOBAL REACH SECURITY INNOVATION

17 years 32 Regions 300+ 200+


helping millions spanning 102 security features service offerings
of customers Availability Zones and over
130 Direct Connect locations

AWS INFRASTRUCTURE TCO ECOSYSTEM

3.6x+ 111+ 4500


energy efficient than the price reductions software listings from
median of surveyed U.S. since 2006 1,400 ISVs
enterprise data centers

Source: AWS Approved Public Stats


© Amazon Web Services, Inc. or its Affiliates.
Pricing Philosophy

High volume / low margin businesses are in our core DNA

Trade CapEX for Our economies of Pricing model Save more money as
variable expense scale provide us choice to support you grow bigger
with lower costs variable and stable
workloads

On-demand
Tiered pricing
85 price Reserved Instances
Pay for what
reductions Volume discounts
you use
since 2006 Savings Plans
Custom pricing
Spot

© Amazon Web Services, Inc. or its Affiliates.


AWS security, identity, and compliance solutions

Identity and access Detective Infrastructure Data Incident


Compliance
management controls protection protection response
AWS Identity and AWS Security Hub AWS Firewall Amazon Macie Amazon Detective AWS Artifact
Access Management Manager
(IAM) Amazon AWS Key Amazon AWS Audit
GuardDuty AWS Network Management EventBridge Manager
AWS IAM Identity Firewall Service (KMS)
Center Amazon Security AWS Backup
Lake AWS Shield AWS CloudHSM
AWS Organizations AWS Security Hub
Amazon Inspector AWS WAF AWS Certificate
AWS Directory Service Manager AWS Elastic
Amazon Amazon VPC Disaster Recovery
Amazon Cognito CloudWatch AWS Private CA
AWS PrivateLink
AWS Resource Access AWS Config AWS Secrets
Manager AWS Systems Manager
AWS CloudTrail Manager 7
Amazon Verified AWS VPN
Permissions VPC Flow Logs AWS Verified
Access Server-Side
AWS IoT Encryption
Device Defender
© Amazon Web Services, Inc. or its Affiliates.
Amazon Bedrock empowers innovation
T H E E A S I E S T WAY T O B U I L D A N D S C A L E G E N E R AT I V E A I A P P L I C AT I O N S W I T H F M S

Access a range of leading FMs through a single API

Privately customize FMs with your own data

Enable data security and compliance

Build agents that execute complex business tasks by dynamically invoking APIs

Extend the power of FMs with your data using retrieval augmented generation (RAG)

Get the best price performance without managing infrastructure

© Amazon Web Services, Inc. or its Affiliates.


How Amazon Bedrock works

Choose from Customize with Connect data Enable task


Amazon Bedrock
leading FMs your data* sources execution
The easiest way to build
and scale generative AI Access a range of top Privately fine-tune Connect FMs with your Configure agents to
applications with FMs FMs using a single API FMs with your data data sources for RAG dynamically invoke APIs

* Your data is not used for service improvements and is not shared with third-party model providers.

© Amazon Web Services, Inc. or its Affiliates.


Experience with Operational Reliability
Our goal is to make our operational performance indistinguishable from
perfect. We are driven to remove any all causes of failure.

§ We have spent over a decade building the world’s most reliable, secure, scalable, and cost-
effective infrastructure.

§ Service SLAs between 99.9% and 100% availability. Amazon S3 is designed for
99.999999999% durability.

§ Availability Zones exist on isolated fault lines, flood plains, and electrical grids to
substantially reduce the chance of simultaneous failure.

§ The AWS Service Health Dashboard provides 24/7 visibility in the real-time operational
status of all services around the globe.
https://status.aws.amazon.com/
© Amazon Web Services, Inc. or its Affiliates.
Customer obsessed

90%
of roadmap originates with customer requests

“Performance, reliability, and responsiveness are fundamental


to our customer experience, and T3 instances help us to deliver on
that customer promise while also controlling our costs.”
—Heroku
© Amazon Web Services, Inc. or its Affiliates.
AWS Recognized as
a Cloud Leader for the
12nd Consecutive Year

Gartner, Magic Quadrant for Cloud Infrastructure & Platform Services, Raj Bala, Bob Gill, Dennis Smith, David Wright, Kevin Ji, 1 September 2020. Gartner does not endorse any vendor,
product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings. Gartner research publications consist of the
opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including
any warranties of merchantability or fitness for a particular purpose. The Gartner logo is a trademark and service mark of Gartner, Inc., and/or its affiliates, and is used herein with
permission. All rights reserved.

© Amazon Web Services, Inc. or its Affiliates.


AWS Infrastructure

© Amazon Web Services, Inc. or its Affiliates.


Questions to consider when
evaluating cloud vendors

GLOBAL SECURITY INNOVATION COST


INFRASTRUCTURE
How many third-party Is the vendor investing for What is the philosophy of
What is the underlying attestations and security the long term and have the company when it comes
architecture and design of features do the vendors demonstrated capability to cost? Is it economies of
this to enable High have? with reference customers scale driven for long term or
Availability and taking advantage of is it undercutting the market
synchronous replication? Do they have innovative services? or credits for the short term?
international customers
that can attest to this? Have you evaluated price to
features across vendors?

© Amazon Web Services, Inc. or its Affiliates.


AWS Global Infrastructure

KEY

Region

Local Zone

Direct Connect

Edge location

Multiple edge locations

Regional Edge caches

© Amazon Web Services, Inc. or its Affiliates.


The most secure,
extensive, and reliable
Global Cloud Infrastructure
Infrastructure allows you to run workload

You have the same access and


capabilities no matter where you are

200+ fully featured services from


data centers globally

© Amazon Web Services, Inc. or its Affiliates.


Understanding the AWS Global Infrastructure
REGION AVAILABILITY ZONE LOCAL ZONES POINTS OF PRESENCE
(AZ)
A physical location where we AWS Local Zones place Reduce latency by delivering
cluster data centers. Each One or more discrete data compute, storage, database, data through 550+ globally
Region consists of a minimum centers with redundant power, and other AWS services closer dispersed Points of Presence
of three isolated, and networking, and connectivity to end-users so you can run (PoPs) with automated
physically separate AZ’s. in an AWS Region. latency-sensitive applications network mapping and
and meet data residency intelligent routing using
requirements in more Amazon CloudFront.
locations

WAVELENGTH ZONES DIRECT CONNECT OUTPOSTS


LOCATIONS
AWS infrastructure AWS Outposts are a family of
deployments that embed AWS The Direct Connect service fully managed solutions
services within establishes a private, physical delivering AWS infrastructure
telecommunications providers’ network connection between and services to virtually any
data centers at the edge of the AWS and your data center or on-premises or edge location
5G network. office environment – for a truly consistent
bypassing the public internet. hybrid experience.

© Amazon Web Services, Inc. or its Affiliates.


AWS Region design
AWS Regions are comprised of multiple AZs for high availability,
high scalability, and high fault tolerance. Applications and data are
replicated in real time and consistent in the different AZs.

REGION AVAILABILITY ZONE


(AZ)

1 2

N N

1 2 1 2 Data centers

© Amazon Web Services, Inc. or its Affiliates.


Regional Expansion
32 total regions with 4 coming soon

2006-2011 2012-2017 2018-2023 COMING SOON

8 New Regions 10 New Regions 14 New Regions 4 New Regions


N. AMERICA EUROPE N. AMERICA ASIA PACIFIC N. AMERICA ASIA PACIFIC N. AMERICA
GovCloud US-West Ireland Canada Central Mumbai GovCloud US-East Hong Kong Canada West
Northern Virginia Ohio Seoul Hyderabad
Northern California ASIA PACIFIC *Beijing EUROPE Jakarta ASIA PACIFIC
Oregon Singapore EUROPE *Ningxia Milan Osaka Malaysia
Tokyo Frankfurt Spain Thailand
S. AMERICA London AUSTRALIA & Stockholm AFRICA
São Paulo Paris NEW ZEALAND Zurich Cape Town AUSTRALIA &
Sydney NEW ZEALAND
MIDDLE EAST AUSTRALIA & Auckland
Tel Aviv NEW ZEALAND
Bahrain Melbourne
UAE

© Amazon Web Services, Inc. or its Affiliates.


Availability Zones
§ A region is comprised of multiple Availability Zones (typically 3)
§ An Availability Zone (AZ) is one or more discrete data centers with redundant power,
networking, and connectivity in an AWS Region
§ High throughput, low latency (<10mS) network between Availability Zones
§ All traffic between AZ’s is encrypted
§ Physical Separation < 100km
Region us-east-1 (N.Virginia)

Availability Zone Availability Zone Availability Zone

us-east-1a us-east-1b us-east-1c

© Amazon Web Services, Inc. or its Affiliates.


AWS Global Infrastructure Regions & AZs
EUROPE
N AMERICA
Frankfurt 3 Stockholm 3 ASIA PACIFIC
Canada Central 3 Oregon 4
Ireland 3 Zurich 3 *Beijing 3 Osaka 3
GovCloud US-East 3 Canada West
London 3 *Ningxia 3 Seoul 4
GovCloud US-West 3
Milan 3 Hong Kong 3 Singapore 3
Northern California 3
Paris 3 Hyderabad 3 Tokyo 4
Northern Virginia 6
Spain 3 Jakarta 3 Malaysia
Ohio 3

Mumbai 3 Thailand
MIDDLE EAST
AFRICA
Bahrain 3
Cape Town 3
Tel Aviv 3

S AMERICA UAE 3

São Paulo 3 AUSTRALIA


& NEW ZEALAND

Melbourne 3

Sydney 3

Auckland

Available Region Announced # Availability Zone


Availability zones design for resiliency

REGION 100K+ servers at scale


ISOLATED PARTITION

N Fully isolated with one or more datacenters


Distance ensures
high availability
POWER
1 2
Highly available, fault tolerant, and scalable
Low latency
ensures real-time
data replication DISTANCE

Physically separated by a meaningful distance –


N N
all within 60 miles (100km) of each other

1 2 1 2 INTERCONNECTION

Datacenters connected via fully redundant and


AVAILABILITY
ZONE (AZ)
isolated metro fiber

© Amazon Web Services, Inc. or its Affiliates.


AWS network design

At least 2 redundant transit centers Highly peered & connected

Availability zones

Intra-AZ connections Inter-AZ connections Transit center connections


© Amazon Web Services, Inc. or its Affiliates.
Intra & inter-AZ connectivity

§ Dark fiber “spans”


§ Optimized for low-latency & physical diversity

§ Amazon controlled infrastructure

§ Geospatial coordinates

§ Dense wavelength division multiplexing (DWDM)

© Amazon Web Services, Inc. or its Affiliates.


AWS Global Infrastructure Local Zones
N AMERICA EUROPE
ASIA PACIFIC
Atlanta Los Angeles (2) Seattle Copenhagen Lisbon
Boston Miami Toronto Hamburg Munich Bangkok
Chicago Minneapolis Vancouver Helsinki Oslo Delhi
Dallas New York City Warsaw Prague Kolkata
Denver Philadelphia Amsterdam Vienna Manila
Houston Phoenix Athens Taipei
Kansas City Portland Berlin Bengaluru
Las Vegas Querétaro Brussels Chennai
Hanoi

MIDDLE EAST
AFRICA
Muscat
Lagos
Johannesburg
S AMERICA Nairobi

Buenos Aires AUSTRALIA


Lima & NEW ZEALAND
Santiago
Bogotà Auckland
Rio de Janeiro Perth
Brisbane

Available Local Zone Announced Local Zone


AWS CloudFront Global Edge Network

GLOBAL NETWORK
Redundant 400 GbE network and
private capacity between all regions
except for the AWS China*

DIRECT CONNECT
Connect to every AWS Region from over KEY
125 AWS Direct Connect PoPs worldwide
(excluding AWS China Regions*) Edge location

Multiple edge locations


EDGE NETWORKING
Regional Edge caches
490+ PoPs in 48 countries and 90+ cities,
with direct peering to all major ISPs
Cost Management

© Amazon Web Services, Inc. or its Affiliates.


AWS Cost Management

Tools People

Cost Explorer AWS Account Team

Budgets AWS Concierge


Cost and Usage Report

© Amazon Web Services, Inc. or its Affiliates.


AWS Cost Explorer
View top cost trends and group and filter data to establish a uniform view
of your cost and usage

Features
Filter and group your data

Save your progress

Set time interval and granularity

Forecast future costs and usage

Build custom applications


© Amazon Web Services, Inc. or its Affiliates.
AWS Cloud Cost Management Portfolio

Plan Run See Save

Plan & Evaluate Manage & Control Organize & Report Optimize & Save
AWS Budgets AWS IAM AWS Cost Explorer Savings Plans
AWS Cost Allocation Billing Console AWS Cost & Usage Reports Reserved Instances
AWS Anomaly Detection AWS Cost Categories Right Sizing
Tags AWS Credits Modernize Instance
AWS Organizations AWS Free Tier

© Amazon Web Services, Inc. or its Affiliates.


Looking for billing data & cost management tools?
AW S B I L L I N G C O N S O L E

© Amazon Web Services, Inc. or its Affiliates.


Looking for billing data & cost management tools?
AW S C O S T M A N A G E M E N T C O N S O L E

© Amazon Web Services, Inc. or its Affiliates.


New
AWS Billing and Cost
Management console

© Amazon Web Services, Inc. or its Affiliates.


AWS Billing and Cost Management console New

New navigation Faster decision-making


with summary and
spending monitor

Identify Address urgent items


opportunities detected from cost
from MoM monitors and
Cost breakdown Recommend actions

Improve cost Maximize savings


allocation with with Savings
Cost allocation opportunities
coverage

© Amazon Web Services, Inc. or its Affiliates.


Organized getting started experience

Organized by
specific jobs to
be done (JTBD)

© Amazon Web Services, Inc. or its Affiliates.


AWS Cost Explorer | High-Level Overview
2

1
3
1.Data granularity
5

4 2.Report management
3.Chart type
4.Filtering
5.Grouping
6 6.Download CSV
7.Advanced options

36

© Amazon Web Services, Inc. or its Affiliates.


Understand your usage with filters

Filter by Amazon EC2 instance type Filter by Amazon S3 usage type

© Amazon Web Services, Inc. or its Affiliates.


View MoM cost trends

What about
YoY analysis?

Can I analyze data at


the resource level?

© Amazon Web Services, Inc. or its Affiliates.


New
Enhanced breadth and depth of data
AW S C O S T E X P L O R E R

Longer
look-back
period Usage estimate
for opt-in
Granular features
resource data
for all services

© Amazon Web Services, Inc. or its Affiliates.


New
YoY trend analysis – up to 3 years

Before: couldn’t conduct YoY analysis After: 3-year look-back

© Amazon Web Services, Inc. or its Affiliates.


Resource-level cost analysis New

Before: Lambda usage After: Resource – Lambda function


© Amazon Web Services, Inc. or its Affiliates.
AWS Cost Explorer | Reports

Cost and Usage Reports


• AWS Marketplace
• Daily costs
• Monthly costs by linked account
• Monthly costs by service
• Monthly EC2 running hours costs and usage

Savings Plans / Reserved Instance Reports


• SP/RI utilization reports
• SP/RI coverage reports

© Amazon Web Services, Inc. or its Affiliates.


AWS Budgets
AWS Budgets gives you the ability to set custom budgets that alert you when your
cost or usage exceed (or are forecasted to exceed) your budgets amount. You can
also set RI Utilization alerts.

Benefits

Ø Custom budgets that meet your needs

Ø Stay informed with alerts and reports

Ø Granular budget time periods

43

© Amazon Web Services, Inc. or its Affiliates.


AWS Budgets | Configuration

44

© Amazon Web Services, Inc. or its Affiliates.


AWS Budgets | Alerting

45

© Amazon Web Services, Inc. or its Affiliates.


AWS Cost and Usage Reports (CUR)
A CSV report with the most comprehensive AWS cost and usage information available to
customers

Features

Ø Detailed and granular view of cost and


usage

Ø Delivered multiple times a day

Ø Build custom queries and reports


46

© Amazon Web Services, Inc. or its Affiliates.


AWS Cost and Usage Reports (CUR)

A CSV Report with the most comprehensive AWS cost and usage information
available to customers

1. AWS delivers report to S3 2. Ingest into database 3. Conduct detailed analyses

© Amazon Web Services, Inc. or its Affiliates.


AWS Cost and Usage Reports (CUR)
1. Open Cost and Usage Reports through
Billing console

2. Set up Amazon S3 Bucket for CUR


delivery

3. Download your report from the Amazon


S3 console, query the report using
Amazon Athena, or upload the report
into Amazon Redshift or Amazon
QuickSight

4. Leverage Amazon Athena to analyze the


data from your AWS Cost and Usage
Reports (AWS CUR) in Amazon S3 using 48

standard SQL

© Amazon Web Services, Inc. or its Affiliates.


What’s currently missing with CUR?

Large data
processing costs and
time due to file size
Customers could
not control the Inclusive of sensitive cost
export data information; e.g., account
schema IDs or discounts

© Amazon Web Services, Inc. or its Affiliates.


Data Exports New

Compatible with your existing


data pipelines
Easily control the data
contained in your CUR exports
using SQL
Consistent data schemas to
facilitate data ingestion

© Amazon Web Services, Inc. or its Affiliates.


Data export customization

Time
granularity

Column
selection

Option 1: SQL queries Delivery


option

Export
storage
settings

© Amazon Web Services, Inc. or its Affiliates.


Option 2: In console
Cost and Usage Report 2.0 (CUR 2.0)

Features Legacy CUR CUR 2.0

Data schema Dynamic Fixed

Column organization
for Resource Tags, Cost Categories, Nested columns with
Separate columns
Product, and Discount key-value pairs

Account names
Additional data available
columns

Backward compatible
© Amazon Web Services, Inc. or its Affiliates.
Cost and usage dashboards
New
powered by Amazon QuickSight

Quick deployment
Securely sharing cost and
usage reports
Integrate with
third-party datasets

© Amazon Web Services, Inc. or its Affiliates.


How do you
launch it?
QuickSight
account Content
settings

Delivery
options
Storage
options
Service
access

© Amazon Web Services, Inc. or its Affiliates.


Cost and usage dashboard

© Amazon Web Services, Inc. or its Affiliates.


AWS Credits

AWS credits are applied to bills to help cover costs that are associated with eligible
services. Credits are applied until they are exhausted or they expire.

Ø Applying AWS credits

Ø Applying AWS credits across single & multiple accounts

Ø Sharing AWS credits

© Amazon Web Services, Inc. or its Affiliates.


Best Practices on AWS Cost Management

Cost Allocation tags


§ Use tagging to identify resources

Cost Visibility
§ Dashboard to track AWS Costs

Automation
§ Automate cost controls using Budgets

Simplified Billing
§ Use multiple AWS accounts to allocate costs by product or service.
57

© Amazon Web Services, Inc. or its Affiliates.


Tags

Key (Attribute):
1 to 128 Unicode characters

Value (Detail/Description):
0 to 256 Unicode characters

Tags per resource:


Up to 50 user-created tags

58

© Amazon Web Services, Inc. or its Affiliates.


Tag Key Examples

Cost Business Dept./ Product /


Center Unit Group Application

Support
Owner Endpoint
Contact

Shutdown
Environ. Backup Tier
Time
59

© Amazon Web Services, Inc. or its Affiliates.


Visibility

Ø Cost Explorer Report


Ø Consolidated billing with AWS Organizations
Ø Amazon Redshift
Ø Amazon QuickSight
Ø Amazon Athena + QuickSight
Ø DIY – Custom Databases and BI tools

60

© Amazon Web Services, Inc. or its Affiliates.


Cost allocation drives accountability & optimization
Cost optimization: Connecting cloud activity with cloud
spend results in greater focus on reducing cloud spend

“Respondents with higher


levels of cost allocation apply
nearly 2X the number of cloud
cost-optimization strategies
to reduce cloud spend.” *

Cost allocation: Mapping cloud spend to your internal organization

© Amazon Web Services, Inc. or its Affiliates. *The Hackett Group, April 2022, Cloud Financial Management Maximizes Business Value on Amazon Web Services
Cost allocation options

Tag-based Application
Tag timelines
(cost allocation tags) tagging
Cost allocation

Rules-based Usage-type
Splitting charges
(cost categories) dimension

© Amazon Web Services, Inc. or its Affiliates.


Tag timelines

Last updated date


Last used month

© Amazon Web Services, Inc. or its Affiliates.


Cost categories
Cost category name:
Account Environment

Service Grouping rule 1:


Environment: Production
Account = “Prod”

70%

Region

Split charge rule 1:


Grouping rule 2: split (other) =>
Environment:
Account = “Dev”, “Test”, 70% production
Non-production
Tags “UAT” 30% non-production

30%

Charge type

Region = US-East-1 Environment: Other

Usage type

Dimensions Cost category grouping rules Cost category values Split charge rules

© Amazon Web Services, Inc. or its Affiliates.


New
Application cost management

Set up application definitions in AWS


Service Catalog AppRegistry

Analyze application cost trends in Cost


Explorer with a unique application tag
(awsApplication)

© Amazon Web Services, Inc. or its Affiliates.


Improved cost visibility of containerized applications with Split
Cost Allocation Data (SCAD)

View cost and usage for


container-level resources
based on resource
consumption
Leverage cost allocation tags
or cost categories to
consolidate cost and usage for
applications
Allocate costs for
containerized applications to
business units or teams
© Amazon Web Services, Inc. or its Affiliates.
Automation

Monitor costs Send notification Take action

AWS Budgets Amazon Simple Notification Service AWS Lambda


(SNS)

67

© Amazon Web Services, Inc. or its Affiliates.


AWS Pricing Calculator

https://calculator.aws/

© Amazon Web Services, Inc. or its Affiliates.


Cost Optimization

© Amazon Web Services, Inc. or its Affiliates.


The Five Pillars of Cost Optimization

Right-size your Increase elasticity Pick the right pricing Optimize storage
resources model

Measure, monitor and


improve

© Amazon Web Services, Inc. or its Affiliates.


Laying the Foundation: Setting Up Your Environment for Cost Optimization
Pillar 1:
Rightsizing
Cheapest Instance / Best Performance
Monitor Usage

© Amazon Web Services, Inc. or its Affiliates.


AWS Well-Architected Framework

Operational excellence

Security
Design principles
Reliability

Cost optimization

Performance efficiency

Sustainability Best practices

© Amazon Web Services, Inc. or its Affiliates.


Cost Optimization design principles

Adopt a consumption model

Analyze and attribute expenditure

AWS Well-Architected Stop spending money on


undifferentiated heavy lifting

Measure overall efficiency

Implement Cloud Financial Management

© Amazon Web Services, Inc. or its Affiliates.


Cost-effective resources

Evaluate cost when selecting services

Select the best pricing model

Plan for data transfer

Select the correct resource type, size, and number

© Amazon Web Services, Inc. or its Affiliates.


Rightsizing with AWS Compute Optimizer
https://aws.amazon.com/compute-optimizer/getting-started/

Make the right choice

Applies insights Saves time

Ensure you are consistently making the right choice


Continually scan your resource usage

© Amazon Web Services, Inc. or its Affiliates.


Rightsizing with AWS Compute Optimizer
https://aws.amazon.com/compute-optimizer/getting-started/

m5.4xlarge
$0.768 per hr m5.large
$0.096 per hr

1. Migrate/provision & 2. Check (CPU, RAM, 3. Rightsize


Run network, disc)

87.5%
Saving

4. Review Performance 5. Save!

© Amazon Web Services, Inc. or its Affiliates. Right Sizing: Provisioning Instances to Match Workloads
Pillar 2:
Increase Elasticity
Autoscaling

© Amazon Web Services, Inc. or its Affiliates.


Traditional approaches to capacity management

Build to peak load Build to average load

© Amazon Web Services, Inc. or its Affiliates.


Lower over-provisioning via elasticity

Auto Scaling allows you to:


• React dynamically to changes in
load
• Schedule regular workloads
• Optimise your instance usage
• Reduce over-provisioning
• Complimentary service!

AWS Well-Architected Framework Concepts: Elasticity


© Amazon Web Services, Inc. or its Affiliates.
Pillar 3:
Leveraging the Right
Pricing Model
Reserved Instances / Savings Plans
EC2 Spot
On-Demand

© Amazon Web Services, Inc. or its Affiliates.


What are Reserved Instances (RI) and Savings Plans (SP)?

• Billing Subscription (“discount coupon”


applied hourly)
Discount
• 1yr or 3yr term commitment to pay
coupon for all hours for a reduced price

• Doesn’t reserve actual capacity (except for


RIs with Zonal scope)

Up to 75%
Selecting the Best Pricing Model
Savings
© Amazon Web Services, Inc. or its Affiliates.
Savings Plans

Savings Plans offer a flexible pricing model and lower


prices compared to On-Demand pricing, in exchange for a
specific usage commitment (measured in $/hour) for a one
or three-year period.

Ø Compute Savings Plans – Amazon EC2, AWS Lambda, AWS Fargate

Ø EC2 Instance Savings Plans – EC2 usage

Ø SageMaker Savings Plans - SageMaker usage


82

© Amazon Web Services, Inc. or its Affiliates.


EC2 Spot provides incredible savings for the right workloads

Spot can be used for


• Stateless
• Fault-tolerant
• Big data
• Containers
Up to 90% • CI/CD

Savings •

Web servers
High Performance Compute
• Dev/Test
• See https://amzn.to/2wKNIT1

© Amazon Web Services, Inc. or its Affiliates.


Pillar 4:
Leveraging the Right
Storage Class
Elastic Block Storage
Simple Storage Service

© Amazon Web Services, Inc. or its Affiliates.


Amazon Storage Classes / Platforms
• Server/Instance Storage • Distributed • Object Storage
• Local Filesystems Filesystem • Backup Target –
• Network Volumes (EBS) Snapshots,…

Amazon Elastic Block EC2 Instance Store Amazon Elastic File Amazon Simple Storage Amazon S3 Glacier
Store System Service
Block File Object

Data Transfer

How do you select your storage solution?

AWS Direct Connect AWS Storage Gateway AWS Snowball


© Amazon Web Services, Inc. or its Affiliates.
Reduce storage costs up to 69% by migrating on-premises
workloads to AWS Storage

On-premises Storage

AWS Storage

Scan to download
analyst report
© Amazon Web Services, Inc. or its Affiliates.
Traditional storage AWS storage

1 PB raw storage

800 TB available*
(After RAID, formatting, file system)

600 TB allocated
(Anticipated growth during useful life)

400 TB actual data usage


Post
deduplication

On-premises storage * Depending on RAID type it could take


up to 50% of raw capacity
© Amazon Web Services, Inc. or its Affiliates.
Cost savings improve through optimizations

Typical TCO comparison

P o s t-m
ig r a tio
n c o st
sa v in g
s
True TCO
comparison

On- Lift & shift Instance Improved Measure, EC2 Storage Serverless Managed True AWS
premises right-sizing elasticity monitor, optimized optimization architecture Services optimized
improve

© Amazon Web Services, Inc. or its Affiliates.


Choosing the right storage for your workload
Data protection Data at work
Data storage ANALYTICS

BLOCK OBJECT FILE


AWS
BACKUP

MACHINE
LEARNING

AWS ELASTIC AMAZON AMAZON S3 AMAZON FSX AMAZON


DISASTER EBS & S3 GLACIER FAMILY EFS VISUALIZATION
RECOVERY

AMAZON FILE
AMAZON EBS CACHE
SNAPSHOTS

AWS TRANSFER AWS SNOW AWS STORAGE AWS


FAMILY FAMILY GATEWAY DATASYNC
STREAMING

© Amazon Web Services, Inc. or its Affiliates.


Data in motion
Amazon EBS
S T R A I G H T F O R WA R D , H I G H - P E R F O R M A N C E B L O C K S T O R A G E AT V I R T U A L LY A N Y S C A L E

Performance for any workload Ease of use High reliability


• Up to 256,000 IOPS/volume Add and remove capacity, • High availability
• 350,000 IOPS/instance or change volume types with • Up to 99.999% durability
Amazon EBS Elastic Volumes
• As low as sub-millisecond latency • Crash consistent snapshots

Virtually unlimited scale Secure Cost effective


Use a single gigabyte or less, Encrypt new volumes and Pay as little as $0.015 per
or scale up to petabytes of data data for a region by default GB-month for highly cost-
with a single setting effective block storage

© Amazon Web Services, Inc. or its Affiliates.


Amazon EBS Volume Types
D I F F E R E N T VO LU M E T Y P ES FO R O P T I M A L P R I C E A N D P E R FO R M A N C E

SSD HDD
2

gp2 gp3 io1 io2/io2 Block Express st1 sc1


General- Provisioned Throughput- Cold
purpose SSD IOPS SSD optimized HDD HDD

© Amazon Web Services, Inc. or its Affiliates.


Migrate non-disruptively* from gp2 to gp3 volume type

Performance

up to 250 MB/s throughput up to 1000 MB/s throughput • Higher throughput per volume
• Flexibility to scale IOPS and
3000 IOPS (burst) baseline performance 3000 IOPS (no burst) baseline performance
capacity independently
3 IOPS/GB scaled performance Independently scale IOPS and throughput

Cost

$0.08/GB-month of provisioned storage • Up to 20% lower cost for same


performance & capacity than gp2
$0.10/GB-month of provisioned storage 3000 IOPS free and $0.005/provisioned
IOPS-month over 3000 IOPS

125 MB/s free and $0.04/provisioned


MB/s-month over 125 MB/s
© Amazon Web Services, Inc. or its Affiliates.
Elastic volumes: Modify EBS volumes with no downtime

D Y N A M I C A L LY C H A N G E V O L U M E F E AT U R E S A N D D ATA P L A C E M100x
E N more
T T durability,
O S U P10x PORT GROWTH AND
Approx. 50% cheaper
COST CONTROL more scale performance
than gp2. HDD suited
Increase
Increasevolume
volumesize
size and lower cost at higher
IOPs compared to io1
to sequential
workloads

Provision minimum required capacity


• ProvisionProvisioned
Amazon EBS IOPSfor
SSDminimumThroughput Optimized
required size HDD as
and expand
(io2) (st1)
needed
• Maintenance is easy without application pause/restart
General Purpose SSD Cold HDD
Optimize data placement
(gp3) based on workload
(sc1) requirements
SSD volume HDD volume

• Migrate data non-disruptively across EBS volume types to align with


changing application performance
Defaultrequirements
for Approx. 75%
balanced cheaper than gp3
workloads

Increase/decrease
Increase/decrease
provisioned
provisionedIOPS
IOPS

© Amazon Web Services, Inc. or its Affiliates.


Save up to 75% for long-term snapshots storage
Standard snapshots Snapshots Archive
• Incremental point-in-time backups • Full, point-in-time backups
• Only changed blocks stored • All blocks of a snapshot are stored
• Use cases: • Use cases:
• Backup and recovery for EBS volumes • Long-term retention for infrequently accessed backups
• App refresh across accounts & Regions using AMIs • Monthly, quarterly, or yearly backups for compliance
• Disaster recovery and ransomware protection across • End-of-project copies
accounts and Regions • Restore time: in hours (24-72 hours for largest
• Restore time: in seconds snapshots)
• Price1: $0.05/GB-mo • Price1: $0.0125/GB-mo, 3c/GB retrieval charge, 90-day
• Price: All Commercial, AWS GovCloud (US), MVP, China minimum retention period
• Regions: All Commercial, AWS GovCloud (US), China

Managed via API, CLI


1 IAD pricing, refer to regional pricing
© Amazon Web Services, Inc. or its Affiliates.
Storage efficiency best practices – EBS

• Start with gp2 volumes that increase in performance as they increase in size
• Migrate to gp3, providing 20% lower price per GB

• Change volume type, storage, and performance of EBS volumes at any time
• Optimize costs efficiently as needed for workloads, without worrying about
overprovisioning performance when not needed

• EBS snapshots are incremental, point-in-time copies of block storage data,


making them cost effective and ideal for frequent backups
• Save up to 75% by using Amazon EBS Snapshots Archive for long-term
retention

© Amazon Web Services, Inc. or its Affiliates.


Supporting virtually

Amazon FSx Amazon FSx


Amazon FSx for NetApp for OpenZFS Amazon FSx
for Windows ONTAP for Lustre
Amazon EFS File Server Amazon File
Cache

AWS file storage


© Amazon Web Services, Inc. or its Affiliates.
Lifecycle management
Data deduplication
cold files to lower cost
1010

and compression
010110
100100
001001
110010
Infrequent Access storage
classes to save up to
on redundant data by
storing duplicated portions
of your dataset only once
File storage

Elastic capacity
pool tiering Cost-efficient fully
managed storage
from SSD storage to capacity Improve time optimization and
pool storage based on your by
access patterns replacing self-managed
© Amazon Web Services, Inc. or its Affiliates. storage
Amazon EFS
Amazon FSx for scales
Windows File Server elastically to 100s of TiB and
saves on storage costs
Global legal services
company reduced
costs and saved on
storage capacity used
File storage

Amazon FSx for


NetApp ONTAP Amazon FSx for
OpenZFS
Global engineering provider
reduces storage costs AI leader accelerates
by and increases model training and lowers
operational costs by
productivity by
© Amazon Web Services, Inc. or its Affiliates.
Amazon EFS: Automatic cost optimization
U S I N G A M A Z O N E F S S T O R A G E C L A S S E S A N D I N T E L L I G E N T- T I E R I N G

EFS Standard EFS Standard-IA EFS One Zone EFS One Zone-IA

Actively accessed data Infrequently accessed data Frequently accessed data Rarely accessed data
requiring high availability requiring high availability within a single Availability within a single Availability
and durability and durability Zone Zone

EFS Intelligent-Tiering EFS Intelligent-Tiering

$0.08/GB-month* $0.043/GB-month*
Effective storage cost Effective storage cost
© Amazon Web Services, Inc. or its Affiliates. *Pricing in the US East (N. Virginia) Region. Assumes 80% of the files are infrequently accessed.
Available now
Amazon EFS Archive
LOWEST COST STORAGE FOR FILE DATA ON AWS

Amazon EFS Amazon EFS Amazon EFS


Standard Infrequent Access Archive

+30 days +90 days

© Amazon Web Services, Inc. or its Affiliates.


Available now
Amazon EFS Archive
LOWEST COST STORAGE FOR FILE DATA ON AWS

Amazon EFS Amazon EFS Amazon EFS


Standard Infrequent Access Archive

+30 days +90 days

© Amazon Web Services, Inc. or its Affiliates.


Amazon FSx: Rightsize throughput capacity tiering
PAY O N LY F O R T H E R E S O U R C E S Y O U C O N S U M E

Amazon FSx for Windows File Server Amazon FSx for NetApp ONTAP

SSD
• Sub-ms latencies
SSD • Optimized for active data
• More IOPS per dollar ~20% of data
• More throughput per gigabyte
• Lower latencies ONTAP’s built-in, automatic tiering
SSD
• Optimized for file workloads
• Intelligent and bidirectional
HDD • Per-volume policy
• Increased density
• Low cost per gigabyte Capacity pool
HDD • Reduce the effective throughput • Fully elastic (automatically
per gigabyte IOPS per dollar grows/shrinks)
• Cost-optimized for infrequently
~80% of data
accessed data
© Amazon Web Services, Inc. or its Affiliates.
Storage class choice matters at scale

S3 Intelligent- S3 Standard S3 Standard-IA S3 One Zone-IA S3 Glacier S3 Glacier S3 Glacier


Tiering Instant Retrieval Flexible Retrieval Deep Archive

Changing Frequently Infrequently Infrequently Rarely Archive data Long-term


access patterns accessed data accessed data accessed data; accessed data archive data
can be recreated

© Amazon Web Services, Inc. or its Affiliates.


Select the right storage class for your workload

Access frequency Retention period Retrieval time

© Amazon Web Services, Inc. or its Affiliates.


Patterns of cost optimization

1
Data with unknown or changing access patterns

© Amazon Web Services, Inc. or its Affiliates.


Amazon S3 Intelligent-Tiering for unknown access patterns

Frequent Infrequent Archive Instant Archive Deep Archive


Access tier Access tier Access tier Access tier Access tier

Milliseconds access (automatic) Minutes to hours (optional)

© Amazon Web Services, Inc. or its Affiliates.


in cost savings

© Amazon Web Services, Inc. or its Affiliates.


Patterns of cost optimization

Data with unknown or changing access patterns

2
Data with known or predictable access patterns

© Amazon Web Services, Inc. or its Affiliates.


Lifecycle data with predictable access patterns

S3 Standard S3 Standard-IA S3 Glacier S3 Glacier S3 Glacier


Instant Retrieval Flexible Retrieval Deep Archive

Milliseconds access Minutes to hours

© Amazon Web Services, Inc. or its Affiliates.


S3 Lifecycle filters and actions

• Use filters for more granular S3 Lifecycle


configurations
• Filter by prefix or tag
• Filter by object size

• Use S3 Lifecycle policies to


• Manage how many noncurrent versions to keep
• Expire incomplete multi-part uploads
• Expire delete markers

© Amazon Web Services, Inc. or its Affiliates.


Relationship between object size and cost

Request costs (per GB)

Object sizes

© Amazon Web Services, Inc. or its Affiliates.


S3 insights portfolio Amazon
CloudWatch metrics
for Amazon S3

Amazon S3 Storage Lens Monitoring and alarms

Amazon S3 Inventory

Object-level metadata

Organization-wide visibility into pre- Amazon S3 server


aggregated usage & activity metrics access logs

Free and paid versions available

Detailed request
logging
© Amazon Web Services, Inc. or its Affiliates.
Object-level analysis: Amazon Athena and Amazon S3
Inventory
What access tier of S3 Intelligent-Tiering are
my objects in?
SELECT intelligent_tiering_tier,count (*) FROM
s3_bucket_inventory GROUP BY intelligent_tiering_tier;

What is the size distribution of my objects?


Inventory Amazon SELECT size, count(*) FROM s3_bucket_inventory GROUP BY size;';

report Athena

Use SQL query on your Which objects are not encrypted?


S3 Inventory list SELECT key FROM s3_bucket_inventory where
encryption_status = ‘NOT-SSE’;

© Amazon Web Services, Inc. or its Affiliates.


S3 Storage Lens
P R O V I D E S O R G A N I Z AT I O N - W I D E V I S I B I L I T Y I N T O S T O R A G E U S A G E A N D A C T I V I T Y

COST VISIBILITY “Is my data in the optimal S3 storage class?”

DATA PROTECTION “How do I prevent accidental deletes and overwrites?”

ACCESS CONTROL “Can bucket access for my workloads be improved?”

PERFORMANCE “Am I seeing a rise in 403 authorization errors?”

© Amazon Web Services, Inc. or its Affiliates.


Drill-down dimensions
Organization
Drill down from org or account level
to more granular details Account
Use prefix-level details to run storage
allocations in data lakes Region

Storage class

Bucket

Advanced
metrics
/…/… Prefix

© Amazon Web Services, Inc. or its Affiliates.


Storage Lens groups: Customizable aggregation levels for S3
Storage Lens
GA NOW

Object tags Object size File extensions Prefixes


Perform Analyze bucket Identify the types Analyze shared
department or size distribution to of data stored in multi-tenant
application-level optimize S3 your buckets buckets like data
cost allocation Lifecycle costs lakes

© Amazon Web Services, Inc. or its Affiliates.


Discover infrequently accessed data

© Amazon Web Services, Inc. or its Affiliates.


Automated visibility with Amazon CloudWatch

API Customer
applications

S3 Storage Lens Amazon


Amazon CloudWatch AP
I
S3

Integrated Centralized
console experience AWS monitoring
• Alarms Analytics & observability
• Anomaly detection ISVs

© Amazon Web Services, Inc. or its Affiliates.


Storage efficiency best practices – Amazon S3

• Consider access frequency, retention requirements, retrieval performance,


Choose the right storage classes and object size

• The best choice when access patterns are UNKNOWN


Use S3 Intelligent-Tiering • The right choice for most workloads

• If your access patterns are KNOWN, you can save more than with S3 Intelligent-Tiering
Use S3 Lifecycle • Use filters for more granular control over transitions and deletions
• Expire incomplete MPUs, non-current versions, and delete markers
configurations and filters

Make objects larger, if possible • Pay attention to object size to avoid large transition and request charges

• Organization-wide visibility into usage and activity


Use S3 Storage Lens for • Aggregate metrics at the org, account, region, storage class, bucket, prefix,
visibility and analysis • Aggregate metrics by tag, object size, file extension

© Amazon Web Services, Inc. or its Affiliates.


Pillar 5:
Measure, monitor and
improve

© Amazon Web Services, Inc. or its Affiliates.


Summary of Mechanisms for Optimisation

Define, agree, and enforce Define metrics, set


cost allocation tagging targets, and review

Enable teams to Assign optimization


architect for cost responsibility
© Amazon Web Services, Inc. or its Affiliates. Cloud Enablement Engine: A Practical Guide
Traditional technology consumption

Technology
teams Request Procurement
Model
Engineers as requesters

Procurement as approvers
Rack and Approve
stack and track Step function spend and capacity forecasting

Long procurement cycles


Operations Supply Chain
High cost of failure
Procure

© Amazon Web Services, Inc. or its Affiliates.


Cloud technology consumption

Deploy Operate
Model
Engineers and finance team acting as one
Technology Finance
teams organization
Match capacity with demand

Procurement is instant

Low cost of failure


Optimize

© Amazon Web Services, Inc. or its Affiliates.


Adapting traditional processes to be cloud ready

Forecasting Control Traceability Oversight

Mapping to AWS Consolidated billing Clean account structure Cost-aware architecture

Dynamic, rolling forecast Governance and agility Meaningful cost reporting Match demand with supply

Cross-functional alignment Simplified procure-to-pay Ready for chargeback Various purchase options
and showback

© Amazon Web Services, Inc. or its Affiliates.


Why cloud financial governance?
S A F E G U A R D I N G Y O U F R O M A N Y T H I N G T H AT C A N G O W R O N G F R O M G O I N G W R O N G

Eliminate shadow IT spend

Standardize how cloud resources are procured


and deployed
FinOps

Establish fiscally responsible cloud usage at scale

© Amazon Web Services, Inc. or its Affiliates.


FinOps phases

Rates
& Usage

© Amazon Web Services, Inc. or its Affiliates. FinOps Framework by FinOps Foundation
What is GitOps?

GitOps is an approach where infrastructure is defined as code (IaC) alongside


application code, versioned in a git repository, and then provisioned following
the same merge request process as application software code

Infrastructure Git CI/CD


as code versioning and pull for automated
hosted just like requests workflows build, test,
+ +
software code and deploy

© Amazon Web Services, Inc. or its Affiliates.


What is infrastructure as code?

© Amazon Web Services, Inc. or its Affiliates.


Infrastructure as code

Cost – $100

resource "aws_db_instance" "db" {


allocated_storage = 10
...
}

resource "aws_ecs_service" "ecs" {


name = "ecsApp"
desired_count = 5 Web servers Database
...
}

129

© Amazon Web Services, Inc. or its Affiliates.


Environments as code
Cost?

DNS CDN

DNS CDN
Load balancer Static files
module "app" "prod": {
loadbalancer: { DNS CDN
server: {...} Load balancer Static files
},
Web servers Database
cdn: {...},
database: {...},
Load balancer Static files Production
dns: {...}
static: {...} Web servers Database
}
Test
Web servers Database

Dev 130

© Amazon Web Services, Inc. or its Affiliates.


Classic GitOps

FinOps

Engineer

1 2 3 4 5 6
Code Commit Execute CI/CD Resources New costs are Costs allocated
git push/PR test and plan provisioned reflected in AWS to teams;
deployment through IaC Cost
budgets
Explorer/AWS
tools adjusted
CUR

© Amazon Web Services, Inc. or its Affiliates.


GitOps with proactive controls

FinOps

Engineer

1 2 3 4 5 6 7
Code Commit Execute CI/CD Evaluate Resources New costs are Costs allocated
git push/PR test and approve costs provisioned reflected in AWS to teams;
deployment changes through IaC Cost Explorer
budgets
/AWS CUR
tools adjusted

© Amazon Web Services, Inc. or its Affiliates.


Solution architecture

GitHub

© Amazon Web Services, Inc. or its Affiliates.


AWS Billing Conductor and billing groups
Account A payer
Bill Pays

Bill Bill Bill

Billing group 2

Billing group 1 Billing group 3

© Amazon Web Services, Inc. or its Affiliates.


Customer creation journey
P R O F O R M A B I L L I N G R E S O U R C E S R E L AT I O N S H I P M A P

Account 1 Pricing rules

Billing group Pricing plan


Account 2 Pricing rules

Account 3 Custom line items (monthly) Pricing rules

© Amazon Web Services, Inc. or its Affiliates.


Empower end users to analyze cost independently

Pro forma cost view


in Cost Explorer
Cross-account
visibility without granting
management account access
Forecast future spend and
save reports for easy
reference

© Amazon Web Services, Inc. or its Affiliates.


What good looks like

Accountability

Efficiency

Visibility
© Amazon Web Services, Inc. or its Affiliates.
Establishing KPIs

Establishing goals
Publishing KPIs Update and improve
for CFM

ü Establish clear KPIs ü Create dashboards ü Create automated


to show progress dashboards to assist
ü Ensure KPIs match against KPIs in regular reviews
to overall goals
ü Publish KPIs for ü Present regularly to
ü Ensure KPIs can entire organization leadership on
be measured to review progress and
challenges

© Amazon Web Services, Inc. or its Affiliates.


Define what matters to you
L I N K I N G K P I S T O VA L U E C R E AT I O N

“AWS costs increased by 10% YoY, while searches grew 50%


“AWS costs increased by 10% YoY”
and reservations grew by 30%”
Cost-based KPIs Value driversKPIs
Value-based
($) Daily AWS run rate Searches
$ AWS cost per search
(#) Total EC2 hours $ AWS cost per listing
Listings
(%) RI coverage $ AWS cost per guest
Guests
(%) RI utilization $ AWS cost per host
Hosts
($) Underutilized/idle resources $ AWS cost
Mobile usersper mobile user
(%) Resources untagged $ AWS cost per microservice
Microservices
(%) Variance (budget to actual) $ AWS cost
Backend per backend job
jobs
… …
https://aws.amazon.com/blogs/aws-cost-management/getting-started-tracking-aws-cost-management-metrics/

© Amazon Web Services, Inc. or its Affiliates.


Your first steps

© Amazon Web Services, Inc. or its Affiliates.


Check list for first AWS account

q Stop using root user. Create admin user.

q Configure MFA for all of your user.

q Create usage Budget base on threshold and forecast.

q Learn about AWS Free-tier.

q Ensure your AWS account information are correct ( email, domainname of


email, phone number).

© Amazon Web Services, Inc. or its Affiliates.


Labs

© Amazon Web Services, Inc. or its Affiliates.


Labs

• Tạo tài khoản AWS đầu tiên


https://000001.awsstudygroup.com/vi/

• Quản lý chi phí với AWS Budgets


https://000007.awsstudygroup.com/vi/

• Trực quan hoá chi phí với AWS Cost Explorer


https://000034.awsstudygroup.com/vi/

• Quản lý tài nguyên bằng Tag và Resource Group


https://000027.awsstudygroup.com/vi/

© Amazon Web Services, Inc. or its Affiliates.


Kahoot Game

© Amazon Web Services, Inc. or its Affiliates.


Kahoot Game

Địa chỉ chơi game: kahoot.it


Có thể sử dụng máy tính hoặc điện thoại.

Thể lệ: Bao gồm nhiều câu hỏi trắc nghiệm, tính điểm theo số câu trả lời đúng và
thời gian trả lời, trả lời đúng càng nhiều câu hỏi với thời gian càng ngắn thì điểm
càng cao.

© Amazon Web Services, Inc. or its Affiliates.


Thank you!

© Amazon Web Services, Inc. or its Affiliates.

You might also like