Introduction to PgBench
17 likes12,928 views
This document provides an introduction to pgbench, which is a benchmarking tool for PostgreSQL. It discusses pgbench's history and origins, how to generate databases of different scales for testing, the database schema and scripting language used, and how to run standard, read-only, and custom tests. The author also analyzes results from tests at different database scales and number of clients, discusses warm vs. cold cache performance, and provides tips for thorough benchmarking.
1 of 43
Ad
Recommended
collectd & PostgreSQL
collectd & PostgreSQLMark Wong This presentation is primarily focused on how to use collectd (http://collectd.org/) to gather data from the Postgres statistics tables. Examples of how to use collectd with Postgres will be shown. There is some hackery involved to make collectd do a little more and collect more meaningful data from Postgres. These small patches will be explored. A small portion of the discussion will be about how to visualize the data.
OLTP Performance Benchmark Review
OLTP Performance Benchmark ReviewJignesh Shah The document provides an overview of various OLTP performance benchmarks including pgbench, sysbench, dbt2, BenchmarkSQL, and DVDStore. It discusses the benchmarks' workloads and metrics. It also outlines the development of new benchmarks like TPC-V and how ensuring they run well on PostgreSQL would benefit the open source database.
ProstgreSQLFailoverConfiguration
ProstgreSQLFailoverConfigurationSuyog Shirgaonkar The document describes how to set up PostgreSQL replication with load balancing using pgpool. Key steps include:
1. Configure streaming replication between a primary and standby PostgreSQL node. Repmgr is used to manage replication.
2. Install and configure pgpool to distribute read queries to primary and standby nodes, and trigger failover if needed.
3. Test replication, failover, and recovery of the primary-standby setup. The standby is promoted to primary and replication is reestablished when the original primary is recovered.
Advanced Postgres Monitoring
Advanced Postgres MonitoringDenish Patel This document discusses advanced Postgres monitoring. It begins with an introduction of the speaker and an agenda for the discussion. It then covers selection criteria for monitoring solutions, compares open source and SAAS monitoring options, and provides examples of collecting specific Postgres metrics using CollectD. It also discusses alerting, handling monitoring changes, and being prepared to respond to incidents outside of normal hours.
Matching the Scale at Tinder with Kafka 
Matching the Scale at Tinder with Kafka confluent (Krunal Vora, Tinder) Kafka Summit San Francisco 2018
At Tinder, we have been using Kafka for streaming and processing events, data science processes and many other integral jobs. Forming the core of the pipeline at Tinder, Kafka has been accepted as the pragmatic solution to match the ever increasing scale of users, events and backend jobs. We, at Tinder, are investing time and effort to optimize the usage of Kafka solving the problems we face in the dating apps context. Kafka forms the backbone for the plans of the company to sustain performance through envisioned scale as the company starts to grow in unexplored markets. Come, learn about the implementation of Kafka at Tinder and how Kafka has helped solve the use cases for dating apps. Engage in the success story behind the business case of Kafka at Tinder.
PostgreSQLアーキテクチャ入門（PostgreSQL Conference 2012）
PostgreSQLアーキテクチャ入門（PostgreSQL Conference 2012）Uptime Technologies LLC (JP) 2012年2月24日に開催されたPostgreSQLカンファレンス2012のセッション「PostgreSQLアーキテクチャ入門」の講演資料です。
Meta tags
Meta tagsPartnered Health Meta tags provide implicit information to search engines about web pages. Common meta tags include the description tag, which provides a short description of the page; the keywords tag, which lists relevant keywords; and the robots tag, which controls how search engines should index the page and follow links. The description and robots tags in particular can impact search engine results by optimizing click-through rates and inclusion or exclusion from search indexes. Meta tags must be included within the <head> section to be properly recognized.
ゼロトラスト・アーキテクチャを無料で（やれるだけ）実現する
ゼロトラスト・アーキテクチャを無料で（やれるだけ）実現するKeioOyama ゼロトラスト・アーキテクチャの概念をよく耳にします。ただ、実際どこまで実現できるのか、無料サービスの範囲で試してみました。
The Rise of ZStandard: Apache Spark/Parquet/ORC/Avro
The Rise of ZStandard: Apache Spark/Parquet/ORC/AvroDatabricks Zstandard is a fast compression algorithm which you can use in Apache Spark in various way. In this talk, I briefly summarized the evolution history of Apache Spark in this area and four main use cases and the benefits and the next steps:
1) ZStandard can optimize Spark local disk IO by compressing shuffle files significantly. This is very useful in K8s environments. It’s beneficial not only when you use `emptyDir` with `memory` medium, but also it maximizes OS cache benefit when you use shared SSDs or container local storage. In Spark 3.2, SPARK-34390 takes advantage of ZStandard buffer pool feature and its performance gain is impressive, too.
2) Event log compression is another area to save your storage cost on the cloud storage like S3 and to improve the usability. SPARK-34503 officially switched the default event log compression codec from LZ4 to Zstandard.
3) Zstandard data file compression can give you more benefits when you use ORC/Parquet files as your input and output. Apache ORC 1.6 supports Zstandardalready and Apache Spark enables it via SPARK-33978. The upcoming Parquet 1.12 will support Zstandard compression.
4) Last, but not least, since Apache Spark 3.0, Zstandard is used to serialize/deserialize MapStatus data instead of Gzip.
There are more community works to utilize Zstandard to improve Spark. For example, Apache Avro community also supports Zstandard and SPARK-34479 aims to support Zstandard in Spark’s avro file format in Spark 3.2.0.
Tuning PostgreSQL for High Write Throughput 
Tuning PostgreSQL for High Write Throughput Grant McAlister This presentation covers a number of the way that you can tune PostgreSQL to better handle high write workloads. We will cover both application and database tuning methods as each type can have substantial benefits but can also interact in unexpected ways when you are operating at scale. On the application side we will look at write batching, use of GUID's, general index structure, the cost of additional indexes and impact of working set size. For the database we will see how wal compression, auto vacuum and checkpoint settings as well as a number of other configuration parameters can greatly affect the write performance of your database and application.
Part 10: 5G Use cases - 5G for Absolute Beginners
Part 10: 5G Use cases - 5G for Absolute Beginners3G4G This document discusses 5G use cases. It describes augmented reality, virtual reality, and mixed reality experiences that 5G will enable. Specific use cases mentioned include AR games, monitoring and surveillance, fixed wireless access for indoor internet, connected cars for infotainment, and connected stadiums. Additional use cases discussed are private and industrial networks, cellular vehicle-to-everything communications, and autonomous driving through 5G-enabled truck platooning. The document concludes with a table summarizing 5G's enhanced mobile broadband, massive machine-type communications, and ultra-reliable low latency capabilities and the applications they will support.
Transparent Data Encryption in PostgreSQL and Integration with Key Management...
Transparent Data Encryption in PostgreSQL and Integration with Key Management...Masahiko Sawada The document discusses transparent data encryption in PostgreSQL databases. It proposes encrypting data at the tablespace and buffer levels for minimal performance impact. A two-tier key architecture with separate master and data encryption keys enables fast key rotation. Integrating with key management systems provides flexible and robust key management. The solution aims to securely encrypt database content with low overhead.
Understanding PostgreSQL LW Locks
Understanding PostgreSQL LW LocksJignesh Shah Lightweight locks (LWLocks) in PostgreSQL provide mutually exclusive access to shared memory structures. They support both shared and exclusive locking modes. The LWLocks framework uses wait queues, semaphores, and spinlocks to efficiently manage acquiring and releasing locks. Dynamic monitoring of LWLock events is possible through special builds that incorporate statistics collection.
PostgreSQLバックアップの基本
PostgreSQLバックアップの基本Uptime Technologies LLC (JP) 2012年8月29日に開催された「バックアップ勉強会#1」でのセッション「PostgreSQLバックアップの基本」の講演資料です（講演動画は以下を参照ください）。
http://www.uptime.jp/ja/resources/techdocs/2012/08/pgbackup/
OSS-DB Gold 合格体験記（第29回PostgreSQLアンカンファレンス@オンライン 発表資料）
OSS-DB Gold 合格体験記（第29回PostgreSQLアンカンファレンス@オンライン 発表資料）NTT DATA Technology & Innovation OSS-DB Gold 合格体験記
（第29回PostgreSQLアンカンファレンス@オンライン 発表資料）
2021年12月21日（火）
NTTデータ
技術開発本部
加藤 健
スケールアウトするPostgreSQLを目指して！その第一歩！（NTTデータ テクノロジーカンファレンス 2020 発表資料）
スケールアウトするPostgreSQLを目指して！その第一歩！（NTTデータ テクノロジーカンファレンス 2020 発表資料）NTT DATA Technology & Innovation スケールアウトするPostgreSQLを目指して！その第一歩！
（NTTデータ テクノロジーカンファレンス 2020 発表資料）
2020年10月16日（金）
NTTデータ
技術開発本部
データベーステクニカルリード
藤井 雅雄
講演動画は、YouTubeチャンネル「NTT DATA Tech」にて公開中！
https://www.youtube.com/watch?v=Tt7thFskjmU
初心者向けMongoDBのキホン！
初心者向けMongoDBのキホン！Tetsutaro Watanabe 初心者向けにMongoDBの基本を解説しています。
この資料は2014/3/1のOSC 2014 Tokyo/Springで発表しました 。
2015/3/3最新の情報で一部アップデートしました。
2015/7/15MongoDB ver3.0ようにちょっと修正しました。
SD-WAN Catalyst a brief Presentation of solution
SD-WAN Catalyst a brief Presentation of solutionpepegaston2030 The document discusses Cisco's SD-WAN solution which provides flexibility, transport independence, and a unified management plane. It describes the SD-WAN architecture including the management plane with vManage, control plane with vSmart controllers, and data plane with physical/virtual WAN edge routers. The SD-WAN solution uses an overlay protocol and transport locators to establish encrypted tunnels between sites and distribute routing policies and services across the WAN.
いまさら聞けないPostgreSQL運用管理
いまさら聞けないPostgreSQL運用管理Uptime Technologies LLC (JP) 2012年5月24日に開催された「第2回『いまさら聞けない！システム運用・管理のコツ』」のセッション「いまさら聞けないPostgreSQL運用管理」の講演資料です。
Zero Touch Provisioning for CloudBuilders
Zero Touch Provisioning for CloudBuildersJuniper Networks (日本) ジュニパーネットワークスによるクラウドビルダー向け ZTP (Zero Touch Provisioning）ご紹介資料です。
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...NTT DATA Technology & Innovation 大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -
（db tech showcase 2021 / ONLINE 発表資料）
2021年11月17日（水）
NTTデータ
技術開発本部
岩崎 正剛
NTTデータ
技術開発本部
猿田 浩輔
PGPool-II Load testing
PGPool-II Load testingEDB The document describes load testing of pgpool-II for stress testing, load balancing, and performance testing compared to a single PostgreSQL server. Large Amazon instances with PostgreSQL 9.3.2 and pgpool-II 3.3.3 were used. Pgbench testing with a 75% read/25% write workload was conducted at various scale factors and client levels to evaluate horizontal scaling and performance with increasing database and client size. Results showed that adding read replicas improved performance for large databases that exceeded server memory, while smaller databases in memory saw little benefit.
PostgreSQL and Benchmarks
PostgreSQL and BenchmarksJignesh Shah The document summarizes several industry standard benchmarks for measuring database and application server performance including SPECjAppServer2004, EAStress2004, TPC-E, and TPC-H. It discusses PostgreSQL's performance on these benchmarks and key configuration parameters used. There is room for improvement in PostgreSQL's performance on TPC-E, while SPECjAppServer2004 and EAStress2004 show good performance. TPC-H performance requires further optimization of indexes and query plans.
Ad
More Related Content
What's hot (20)
Meta tags
Meta tagsPartnered Health Meta tags provide implicit information to search engines about web pages. Common meta tags include the description tag, which provides a short description of the page; the keywords tag, which lists relevant keywords; and the robots tag, which controls how search engines should index the page and follow links. The description and robots tags in particular can impact search engine results by optimizing click-through rates and inclusion or exclusion from search indexes. Meta tags must be included within the <head> section to be properly recognized.
ゼロトラスト・アーキテクチャを無料で（やれるだけ）実現する
ゼロトラスト・アーキテクチャを無料で（やれるだけ）実現するKeioOyama ゼロトラスト・アーキテクチャの概念をよく耳にします。ただ、実際どこまで実現できるのか、無料サービスの範囲で試してみました。
The Rise of ZStandard: Apache Spark/Parquet/ORC/Avro
The Rise of ZStandard: Apache Spark/Parquet/ORC/AvroDatabricks Zstandard is a fast compression algorithm which you can use in Apache Spark in various way. In this talk, I briefly summarized the evolution history of Apache Spark in this area and four main use cases and the benefits and the next steps:
1) ZStandard can optimize Spark local disk IO by compressing shuffle files significantly. This is very useful in K8s environments. It’s beneficial not only when you use `emptyDir` with `memory` medium, but also it maximizes OS cache benefit when you use shared SSDs or container local storage. In Spark 3.2, SPARK-34390 takes advantage of ZStandard buffer pool feature and its performance gain is impressive, too.
2) Event log compression is another area to save your storage cost on the cloud storage like S3 and to improve the usability. SPARK-34503 officially switched the default event log compression codec from LZ4 to Zstandard.
3) Zstandard data file compression can give you more benefits when you use ORC/Parquet files as your input and output. Apache ORC 1.6 supports Zstandardalready and Apache Spark enables it via SPARK-33978. The upcoming Parquet 1.12 will support Zstandard compression.
4) Last, but not least, since Apache Spark 3.0, Zstandard is used to serialize/deserialize MapStatus data instead of Gzip.
There are more community works to utilize Zstandard to improve Spark. For example, Apache Avro community also supports Zstandard and SPARK-34479 aims to support Zstandard in Spark’s avro file format in Spark 3.2.0.
Tuning PostgreSQL for High Write Throughput
Tuning PostgreSQL for High Write Throughput Grant McAlister This presentation covers a number of the way that you can tune PostgreSQL to better handle high write workloads. We will cover both application and database tuning methods as each type can have substantial benefits but can also interact in unexpected ways when you are operating at scale. On the application side we will look at write batching, use of GUID's, general index structure, the cost of additional indexes and impact of working set size. For the database we will see how wal compression, auto vacuum and checkpoint settings as well as a number of other configuration parameters can greatly affect the write performance of your database and application.
Part 10: 5G Use cases - 5G for Absolute Beginners
Part 10: 5G Use cases - 5G for Absolute Beginners3G4G This document discusses 5G use cases. It describes augmented reality, virtual reality, and mixed reality experiences that 5G will enable. Specific use cases mentioned include AR games, monitoring and surveillance, fixed wireless access for indoor internet, connected cars for infotainment, and connected stadiums. Additional use cases discussed are private and industrial networks, cellular vehicle-to-everything communications, and autonomous driving through 5G-enabled truck platooning. The document concludes with a table summarizing 5G's enhanced mobile broadband, massive machine-type communications, and ultra-reliable low latency capabilities and the applications they will support.
Transparent Data Encryption in PostgreSQL and Integration with Key Management...
Transparent Data Encryption in PostgreSQL and Integration with Key Management...Masahiko Sawada The document discusses transparent data encryption in PostgreSQL databases. It proposes encrypting data at the tablespace and buffer levels for minimal performance impact. A two-tier key architecture with separate master and data encryption keys enables fast key rotation. Integrating with key management systems provides flexible and robust key management. The solution aims to securely encrypt database content with low overhead.
Understanding PostgreSQL LW Locks
Understanding PostgreSQL LW LocksJignesh Shah Lightweight locks (LWLocks) in PostgreSQL provide mutually exclusive access to shared memory structures. They support both shared and exclusive locking modes. The LWLocks framework uses wait queues, semaphores, and spinlocks to efficiently manage acquiring and releasing locks. Dynamic monitoring of LWLock events is possible through special builds that incorporate statistics collection.
PostgreSQLバックアップの基本
PostgreSQLバックアップの基本Uptime Technologies LLC (JP) 2012年8月29日に開催された「バックアップ勉強会#1」でのセッション「PostgreSQLバックアップの基本」の講演資料です（講演動画は以下を参照ください）。
http://www.uptime.jp/ja/resources/techdocs/2012/08/pgbackup/
OSS-DB Gold 合格体験記（第29回PostgreSQLアンカンファレンス@オンライン 発表資料）
OSS-DB Gold 合格体験記（第29回PostgreSQLアンカンファレンス@オンライン 発表資料）NTT DATA Technology & Innovation OSS-DB Gold 合格体験記
（第29回PostgreSQLアンカンファレンス@オンライン 発表資料）
2021年12月21日（火）
NTTデータ
技術開発本部
加藤 健
スケールアウトするPostgreSQLを目指して！その第一歩！（NTTデータ テクノロジーカンファレンス 2020 発表資料）
スケールアウトするPostgreSQLを目指して！その第一歩！（NTTデータ テクノロジーカンファレンス 2020 発表資料）NTT DATA Technology & Innovation スケールアウトするPostgreSQLを目指して！その第一歩！
（NTTデータ テクノロジーカンファレンス 2020 発表資料）
2020年10月16日（金）
NTTデータ
技術開発本部
データベーステクニカルリード
藤井 雅雄
講演動画は、YouTubeチャンネル「NTT DATA Tech」にて公開中！
https://www.youtube.com/watch?v=Tt7thFskjmU
初心者向けMongoDBのキホン！
初心者向けMongoDBのキホン！Tetsutaro Watanabe 初心者向けにMongoDBの基本を解説しています。
この資料は2014/3/1のOSC 2014 Tokyo/Springで発表しました 。
2015/3/3最新の情報で一部アップデートしました。
2015/7/15MongoDB ver3.0ようにちょっと修正しました。
SD-WAN Catalyst a brief Presentation of solution
SD-WAN Catalyst a brief Presentation of solutionpepegaston2030 The document discusses Cisco's SD-WAN solution which provides flexibility, transport independence, and a unified management plane. It describes the SD-WAN architecture including the management plane with vManage, control plane with vSmart controllers, and data plane with physical/virtual WAN edge routers. The SD-WAN solution uses an overlay protocol and transport locators to establish encrypted tunnels between sites and distribute routing policies and services across the WAN.
いまさら聞けないPostgreSQL運用管理
いまさら聞けないPostgreSQL運用管理Uptime Technologies LLC (JP) 2012年5月24日に開催された「第2回『いまさら聞けない！システム運用・管理のコツ』」のセッション「いまさら聞けないPostgreSQL運用管理」の講演資料です。
Zero Touch Provisioning for CloudBuilders
Zero Touch Provisioning for CloudBuildersJuniper Networks (日本) ジュニパーネットワークスによるクラウドビルダー向け ZTP (Zero Touch Provisioning）ご紹介資料です。
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...NTT DATA Technology & Innovation 大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -
（db tech showcase 2021 / ONLINE 発表資料）
2021年11月17日（水）
NTTデータ
技術開発本部
岩崎 正剛
NTTデータ
技術開発本部
猿田 浩輔
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...
大規模データ処理の定番OSS Hadoop / Spark 最新動向 - 2021秋 -（db tech showcase 2021 / ONLINE 発...NTT DATA Technology & Innovation
Viewers also liked (11)
PGPool-II Load testing
PGPool-II Load testingEDB The document describes load testing of pgpool-II for stress testing, load balancing, and performance testing compared to a single PostgreSQL server. Large Amazon instances with PostgreSQL 9.3.2 and pgpool-II 3.3.3 were used. Pgbench testing with a 75% read/25% write workload was conducted at various scale factors and client levels to evaluate horizontal scaling and performance with increasing database and client size. Results showed that adding read replicas improved performance for large databases that exceeded server memory, while smaller databases in memory saw little benefit.
PostgreSQL and Benchmarks
PostgreSQL and BenchmarksJignesh Shah The document summarizes several industry standard benchmarks for measuring database and application server performance including SPECjAppServer2004, EAStress2004, TPC-E, and TPC-H. It discusses PostgreSQL's performance on these benchmarks and key configuration parameters used. There is room for improvement in PostgreSQL's performance on TPC-E, while SPECjAppServer2004 and EAStress2004 show good performance. TPC-H performance requires further optimization of indexes and query plans.
PostgreSQL Portland Performance Practice Project - Database Test 2 Howto
PostgreSQL Portland Performance Practice Project - Database Test 2 HowtoMark Wong Fourth presentation in a speaker series sponsored by the Portland State University Computer Science Department. The series covers PostgreSQL performance with an OLTP (on-line transaction processing) workload called Database Test 2 (DBT-2). This presentation is a set of examples to go along with the live presentation given on March 12, 2009.
The Essential postgresql.conf
The Essential postgresql.confRobert Treat Discusses the the most important parameters inside the postgresql.conf. Given at the Beijing Perl Workshop, China, 2008
Architecture for building scalable and highly available Postgres Cluster
Architecture for building scalable and highly available Postgres ClusterAshnikbiz As PostgreSQL has made way into business critical applications, many customers who are using Oracle RAC for high availability and load balancing have asked for similar functionality for using PostgreSQL.
In this Hangout session we would discuss architecture and alternatives, based on real life experience, for achieving high availability and load balancing functionality when you deploy PostgreSQL. We will also present some of the key tools and how to deploy them for effectiveness of this architecture.
PostgreSQL performance improvements in 9.5 and 9.6
PostgreSQL performance improvements in 9.5 and 9.6Tomas Vondra The document summarizes performance improvements in PostgreSQL versions 9.5 and 9.6. Some key improvements discussed include optimizations to sorting, hash joins, BRIN indexes, parallel query processing, aggregate functions, checkpoints, and freezing. Performance tests on sorting, hash joins, and parallel queries show significant speedups from these changes, such as faster sorting times and better scalability with parallel queries.
Linux tuning to improve PostgreSQL performance
Linux tuning to improve PostgreSQL performancePostgreSQL-Consulting Slides from Linux tuning to improve PostgreSQL performance by Ilya Kosmodemiansky at PGConf.eu 2015 in Viena
The Good, The Bad and The Greys of Data Visualisation Design
The Good, The Bad and The Greys of Data Visualisation DesignAndy Kirk The document discusses guidelines for effective data visualization design. It outlines "The Good" practices that should be done more such as being curious and asking questions, communicating insights clearly, and crafting visualizations that are personally engaging. "The Bad" practices that should be done less include becoming complacent, using visualizations inappropriately, and applying colors harmfully. "The Greys" refers to areas requiring more discretion such as interactivity, simplification, audience awareness, and emphasis on meaning over details. The guidelines are intended to help designers improve data visualization quality.
Overview of Scientific Workflows - Why Use Them?
Overview of Scientific Workflows - Why Use Them?inside-BigData.com This document provides an overview of scientific workflows, including what they are, common elements, and problems they help address. A workflow is a formal way to express a calculation as a series of tasks with dependencies. Workflow tools automate task execution, data management, scheduling, and more. They can help scale applications from a local system to large clusters. An example is provided of how the CyberShake project uses the Pegasus workflow system to automate probabilistic seismic hazard analysis calculations involving hundreds of thousands of tasks and petabytes of data.
5 Steps to PostgreSQL Performance
5 Steps to PostgreSQL PerformanceCommand Prompt., Inc This document provides an overview of five steps to improve PostgreSQL performance: 1) hardware optimization, 2) operating system and filesystem tuning, 3) configuration of postgresql.conf parameters, 4) application design considerations, and 5) query tuning. The document discusses various techniques for each step such as selecting appropriate hardware components, spreading database files across multiple disks or arrays, adjusting memory and disk configuration parameters, designing schemas and queries efficiently, and leveraging caching strategies.
Ad
Similar to Introduction to PgBench (20)
Aplicações 10x a 100x mais rápida com o postgre sql
Aplicações 10x a 100x mais rápida com o postgre sqlFabio Telles Rodriguez This document discusses using window functions in PostgreSQL to analyze sales data. It shows a table with movie titles, categories, and total sales. Window functions can be used to calculate things like running totals, ranks, and more to analyze the sales data across rows.
Explain this!
Explain this!Fabio Telles Rodriguez The document provides information about troubleshooting and monitoring PostgreSQL performance. It includes:
- Top output showing PostgreSQL processes using significant CPU resources
- Iotop output showing disk IO from PostgreSQL processes
- Pg_stat_activity output listing active queries and sessions
- Pg_stat_statements output showing top queries by execution time
- Explanations and examples of using EXPLAIN, EXPLAIN ANALYZE, and ANALYZE to view query plans and statistics
OLTP+OLAP=HTAP
OLTP+OLAP=HTAPEDB Traditionally database systems were optimized either for OLAP either for OLTP workloads. Such mainstream DBMSes like Postgres,MySQL,... are mostly used for OLTP, while Greenplum, Vertica, Clickhouse, SparkSQL,... are oriented on analytic queries. But right now many companies do not want to have two different data stores for OLAP/OLTP and need to perform analytic queries on most recent data. I want to discuss which features should be added to Postgres to efficiently handle HTAP workload.
PgconfSV compression
PgconfSV compressionAnastasia Lubennikova Right now postgres can't compress its data in many situations and that leads sometimes to increased storage overhead by the order of magnitude comparing with commercial DBMS. Common viewpoint that this task can be accomplished by file system level compression but most popular and well tested Linux file system can't do that. I will talk about our patches that implements page compression on disk or on disk + in memory; in what situation it is better to use what kind of compression; and also discuss experience of using compression in production.
GC Tuning: Fortune 500 Case Studies on Cutting Costs and Boosting Performance
GC Tuning: Fortune 500 Case Studies on Cutting Costs and Boosting PerformanceKumarNagaraju4 This session will provide you with firsthand insights on how industry leaders tackled GC optimization exercises, yielding measurable performance enhancements. We will break down real GC logs, demonstrate essential tools, and share expert techniques that can transform your approach to Java application performance.
Additionally, you’ll walk away with 9 practical tips to optimize your application’s GC performance, ensuring smoother application response times, reduced CPU overhead, and optimized resource usage. Whether you’re a developer, architect, or performance engineer, this session promises to deliver invaluable knowledge that will revolutionize the way you approach system performance and scalability.
GC Tuning: Fortune 500 Case Studies on Cutting Costs and Boosting Performance
GC Tuning: Fortune 500 Case Studies on Cutting Costs and Boosting PerformanceKumarNagaraju4 In this session, you'll learn firsthand how industry leaders tackled Garbage Collection optimization exercises, yielding significant performance enhancements. We'll discuss real GC logs, unveil essential tools, and share expert tricks utilized during optimization efforts. Additionally, 9 practical tips will be shared with you to optimize your application's GC performance. Whether you're a developer, architect, or performance engineer, this session promises invaluable knowledge to revolutionize your approach to system performance and scalability.
PL/CUDA - Fusion of HPC Grade Power with In-Database Analytics
PL/CUDA - Fusion of HPC Grade Power with In-Database AnalyticsKohei KaiGai My presentation slides at PGconf.SV 2016
PL/CUDA - Fusion of HPC Grade Power with In-Database Analytics
http://www.pgconfsv.com/
Performance Optimization of Rails Applications
Performance Optimization of Rails ApplicationsSerge Smetana The document discusses optimizing the performance of Ruby on Rails applications. It covers optimizing Ruby code, Rails code, database queries, using alternative Ruby implementations like JRuby, and optimizing for production environments including shared filesystems, load balancing, and the frontend. Specific optimizations discussed include rewriting parts of the Date class in C, template inlining in Rails, pushing SQL conditions into subqueries, and using memcached instead of filesystem caching on a shared network.
Top-5-production-devconMunich-2023-v2.pptx
Top-5-production-devconMunich-2023-v2.pptxTier1 app Uncover the hidden challenges that plague production environments in this eye-opening session. Join us as we explore the five most common performance problems that emerge in live systems. Gain invaluable insights into detecting these issues early on, before they wreak havoc on your operations. Discover practical solutions that empower you to address these challenges head-on, ensuring optimal performance and seamless user experiences.
Speedrunning the Open Street Map osm2pgsql Loader
Speedrunning the Open Street Map osm2pgsql LoaderGregSmith458515 The Open Street Map project provides invaluable data that keeps driving users toward the PostGIS and PostgreSQL stacks. Loading today’s full Planet data set takes a 120GB XML file and unrolls it into over a terabyte of database data. Crunchy’s benchmark labs have followed the expansion of that Planet data over the last six database releases, as the re-ignition of the CPU wars combined with parallel execution features landing in the database. We’ll take a look at that data evolution, which server configurations worked, and which metrics techniques still matter in the all SSD era.
pgconfasia2016 plcuda en
pgconfasia2016 plcuda enKohei KaiGai The document discusses PG-Strom, an open source project that uses GPU acceleration for PostgreSQL. PG-Strom allows for automatic generation of GPU code from SQL queries, enabling transparent acceleration of operations like WHERE clauses, JOINs, and GROUP BY through thousands of GPU cores. It introduces PL/CUDA, which allows users to write custom CUDA kernels and integrate them with PostgreSQL for manual optimization of complex algorithms. A case study on k-nearest neighbor similarity search for drug discovery is presented to demonstrate PG-Strom's ability to accelerate computational workloads through GPU processing.
Osol Pgsql
Osol PgsqlEmanuel Calvo This document discusses PostgreSQL and Solaris as a low-cost platform for medium to large scale critical scenarios. It provides an overview of PostgreSQL, highlighting features like MVCC, PITR, and ACID compliance. It describes how Solaris and PostgreSQL integrate well, with benefits like DTrace support, scalability on multicore/multiprocessor systems, and Solaris Cluster support. Examples are given for installing PostgreSQL on Solaris using different methods, configuring zones for isolation, using ZFS for storage, and monitoring performance with DTrace scripts.
Adaptive Query Execution: Speeding Up Spark SQL at Runtime
Adaptive Query Execution: Speeding Up Spark SQL at RuntimeDatabricks Over the years, there has been extensive and continuous effort on improving Spark SQL’s query optimizer and planner, in order to generate high quality query execution plans. One of the biggest improvements is the cost-based optimization framework that collects and leverages a variety of data statistics (e.g., row count, number of distinct values, NULL values, max/min values, etc.) to help Spark make better decisions in picking the most optimal query plan.
Become a Garbage Collection Hero
Become a Garbage Collection HeroTier1app Are you building high throughput, low latency application? Are you trying to figure out perfect JVM heap size? Are you struggling to choose right garbage collection algorithm and settings? Are you striving to achieve pause less GC? Do you know the right tools & best practices to tame the GC? Do you know to troubleshoot memory problems using GC logs? You will get complete answers to several such questions in this presentation.
Web Performance Madness - brightonSEO 2018
Web Performance Madness - brightonSEO 2018Bastian Grimm My talk from brightonSEO 2018 covering various web performance strategies, this time mainly focussing on critical rendering path, various image optimisation strategies as well as how to handle custom web fonts.
test
testWentingLiu4 This document provides an overview of Linux performance monitoring tools including mpstat, top, htop, vmstat, iostat, free, strace, and tcpdump. It discusses what each tool measures and how to use it to observe system performance and diagnose issues. The tools presented provide visibility into CPU usage, memory usage, disk I/O, network traffic, and system call activity which are essential for understanding workload performance on Linux systems.
LISA2019 Linux Systems Performance
LISA2019 Linux Systems PerformanceBrendan Gregg Talk by Brendan Gregg for USENIX LISA 2019: Linux Systems Performance. Abstract: "
Systems performance is an effective discipline for performance analysis and tuning, and can help you find performance wins for your applications and the kernel. However, most of us are not performance or kernel engineers, and have limited time to study this topic. This talk summarizes the topic for everyone, touring six important areas of Linux systems performance: observability tools, methodologies, benchmarking, profiling, tracing, and tuning. Included are recipes for Linux performance analysis and tuning (using vmstat, mpstat, iostat, etc), overviews of complex areas including profiling (perf_events) and tracing (Ftrace, bcc/BPF, and bpftrace/BPF), and much advice about what is and isn't important to learn. This talk is aimed at everyone: developers, operations, sysadmins, etc, and in any environment running Linux, bare metal or the cloud."
Linux Systems Performance 2016
Linux Systems Performance 2016Brendan Gregg Talk for PerconaLive 2016 by Brendan Gregg. Video: https://www.youtube.com/watch?v=CbmEDXq7es0 . "Systems performance provides a different perspective for analysis and tuning, and can help you find performance wins for your databases, applications, and the kernel. However, most of us are not performance or kernel engineers, and have limited time to study this topic. This talk summarizes six important areas of Linux systems performance in 50 minutes: observability tools, methodologies, benchmarking, profiling, tracing, and tuning. Included are recipes for Linux performance analysis and tuning (using vmstat, mpstat, iostat, etc), overviews of complex areas including profiling (perf_events), static tracing (tracepoints), and dynamic tracing (kprobes, uprobes), and much advice about what is and isn't important to learn. This talk is aimed at everyone: DBAs, developers, operations, etc, and in any environment running Linux, bare-metal or the cloud."
Building scalable web socket backend
Building scalable web socket backendConstantine Slisenka WebSocket is cool, and you probably already played with it. But it’s just a transport technology. If you have thousands of client connections you need to do lots of improvements to make it scalable, reliable and achieve high performance. You need to implement many things on top of it.
We are building financial data streaming platform for thousands of traders using WebSocket. I’m going to share my experience and cover such techniques as delta delivery, conflation, dynamic throttling, bandwidth and frequency limitation and other. I will also do a live demo of how to build scalable WebSocket backend from scratch using Java and Spring.
20180920_DBTS_PGStrom_EN
20180920_DBTS_PGStrom_ENKohei KaiGai NVME and GPU accelerates PostgreSQL beyond the limitation
- Our challenge to the 10GB/s for query execution performance -
Ad
More from Joshua Drake (13)
Defining Your Goal: Starting Your Own Business
Defining Your Goal: Starting Your Own BusinessJoshua Drake The document provides an overview of starting a business from Joshua D. Drake, including:
1. Drake discusses reasons people want to start their own business like freedom and being the boss, but cautions that freedom isn't absolute and being the boss means dealing with problems.
2. He emphasizes the importance of knowing your market and having a clear understanding of what your business does. Consumer and business focused markets require different strategies.
3. Drake outlines different legal structures for businesses like sole proprietorships, partnerships, corporations and LLCs, noting the pros and cons of each. He recommends starting with an S Corp in most cases.
4. Resources for learning about starting a business include books on business
Defining Your Goal: Starting Your Own Business
Defining Your Goal: Starting Your Own BusinessJoshua Drake Joshua Drake will still go through the "business" steps of starting your own business, but will focus on the real decisions and sacrifices required that a pure business standpoint will not get into. Self improvement/discovery and focusing on your entrepreneurial nature will be the core theme.
An evening with Postgresql
An evening with PostgresqlJoshua Drake A gentle introduction to PostgreSQL and all that is cool about it. Includes discussion on JSON/JSONB, composite types, replication and community
Dumb Simple PostgreSQL Performance (NYCPUG)
Dumb Simple PostgreSQL Performance (NYCPUG)Joshua Drake The document provides tips for optimizing PostgreSQL performance on hardware and configuration settings. It recommends starting with hard drive optimization using RAID 1 or RAID 10 configurations on an SSD or SAS drive array. It also recommends optimizing memory settings like shared_buffers, work_mem and maintenance_work_mem as well as I/O settings like checkpoint_timeout. The document emphasizes the importance of hardware specifications and configuration tuning to improve PostgreSQL performance.
East09 Keynote
East09 KeynoteJoshua Drake This document provides information about the PostgreSQL Conference East 09 including an art exhibit featuring Chinese artists, a raffle prize donation from EnterpriseDB, and thanks to various sponsors, speakers, and the hosting university, Drexel. It also summarizes the United States PostgreSQL Association including its board members, goals of continuing conference support and establishing educational resources, and ways for readers to get involved through speaking, participating, writing curriculum, or starting local user groups. Lastly it discusses economic opportunities for open source databases and notes features recently added or improved in PostgreSQL version 8.4.
Go Replicator
Go ReplicatorJoshua Drake The document discusses PostgreSQL replication using the Replicator tool. It provides an overview of Replicator's features, how to install, configure, and test Replicator for basic replication between a master and multiple slave databases. Instructions are given for initializing the master database, enabling replication on tables, and checking replication status.
Pitr Made Easy
Pitr Made EasyJoshua Drake This document provides an overview of PITR (Point-in-Time Recovery) and introduces PITRTools, an open source tool that simplifies implementing PITR for PostgreSQL databases. PITRTools acts as a wrapper around common utilities like rsync, ssh, and pg_standby to enable features like warm standbys, backups, failover, and monitoring alerts. It works by pushing transaction log files from a master database to a slave, and includes configuration files and scripts to initialize, start, and manage the master archiver and slave standby processes.
Developing A Procedural Language For Postgre Sql
Developing A Procedural Language For Postgre SqlJoshua Drake Presentation presented by Joshua Tolley and PostgreSQL Conference West 08. Corresponding video is here: http://www.vimeo.com/3728119
PostgreSQL Conference: East 08
PostgreSQL Conference: East 08Joshua Drake The document discusses the growth and state of the PostgreSQL community over time. It notes that user groups first formed in Japan (2000), France (2005), the US (2006), and Italy (2007). In 2008, PostgreSQL.eu and PostgreSQL.us were formed to better support the European and US communities respectively. The document outlines elements needed for continued community growth, including growing the user base, supporting developers, improving education/training, strengthening infrastructure, and establishing common goals. It encourages the community to expand mentoring resources, push technological boundaries, and define its own vision and priorities to further progress.
PostgreSQL Conference: West 08
PostgreSQL Conference: West 08Joshua Drake The document discusses recent developments and plans for PostgreSQL over the next six months. It outlines a new development model of commit fests to increase transparency. It also discusses expanding non-profit infrastructures to support PostgreSQL communities internationally. Certification milestones are noted along with a new integrated replication offering for PostgreSQL. Plans are described to further engage with higher education and continue courting developers to expand PostgreSQL adoption.
What MySQL can learn from PostgreSQL
What MySQL can learn from PostgreSQLJoshua Drake This document summarizes some key differences between the MySQL and PostgreSQL open source database communities and projects. It notes that the PostgreSQL community is more active and advocate-driven, organizing numerous conferences each year. In contrast, MySQL AB (now Sun) focuses more on promoting their proprietary features and does not actively engage or advocate for the community. The document also discusses PostgreSQL's more conservative release schedule versus MySQL's tendency to add new features to stable releases, and argues that PostgreSQL prioritizes correctness, maintainability and stability over rapid feature additions.
Northern Arizona State ACM talk (10/08)
Northern Arizona State ACM talk (10/08)Joshua Drake This document discusses open source, PostgreSQL, and the job market. It begins by introducing the author and their background with open source and PostgreSQL. It then discusses the benefits of open source including producing smart software, providing the most opportunity for contribution, sustainability, having a merit-based model and ethic. The document also promotes PostgreSQL, describing it as a fully transactional database with a global community. It argues the job market for open source technologies is strong and provides tips for entering the market including being flexible, knowing multiple technologies, taking risks, and not overworking.
Plproxy
PlproxyJoshua Drake PL/proxy is a PostgreSQL extension that allows writing functions to query other PostgreSQL databases, enabling cross-database queries. It can be used to implement horizontal partitioning by running functions on any, all, or an exact node. However, PL/proxy should still be considered alpha software with limited documentation and stability for some use cases.
Recently uploaded (20)
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55 We’re bringing the TDX energy to our community with 2 power-packed sessions:
🛠️ Workshop: MuleSoft for Agentforce
Explore the new version of our hands-on workshop featuring the latest Topic Center and API Catalog updates.
📄 Talk: Power Up Document Processing
Dive into smart automation with MuleSoft IDP, NLP, and Einstein AI for intelligent document workflows.
AI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global TrendsInData Labs In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy.
This infographic contains:
-AI and data privacy: Key findings
-Statistics on AI data privacy in the today’s world
-Tips on how to overcome data privacy challenges
-Benefits of AI data security investments.
Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.
Complete Guide to Advanced Logistics Management Software in Riyadh.pdf
Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts!
📕 Agenda
Welcome & Introductions
Orchestrator API Overview
Exploring the Swagger Interface
Test Manager API Highlights
Streamlining Automation & Testing with APIs (Demo)
Q&A and Open Discussion
Perfect for developers, testers, and automation enthusiasts!
👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/
This session streamed live on April 29, 2025, 18:00 CET.
Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdffjgm517 descaripcion detallada del avance de las tecnologias en mesopotamia, egipto, roma y grecia.
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan This is a Quick Research Guide (QRG).
QRGs include the following:
- A brief, high-level overview of the QRG topic.
- A milestone timeline for the QRG topic.
- Links to various free online resource materials to provide a deeper dive into the QRG topic.
- Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic.
QRGs planned for the series:
- Artificial Intelligence QRG
- Quantum Computing QRG
- Big Data Analytics QRG
- Spacecraft Guidance, Navigation & Control QRG (coming 2026)
- UK Home Computing & The Birth of ARM QRG (coming 2027)
Any questions or comments?
- Please contact Arthur Morgan at [email protected].
100% human made.
Linux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru Introduction to LPIC-1 Exam - overview, exam details, price and job opportunities
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ Cybersecurity Identity and Access Solutions using Azure AD
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp This is the keynote of the Into the Box conference, highlighting the release of the BoxLang JVM language, its key enhancements, and its vision for the future.
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/
HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar.
Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten.
In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich
- Zugriff auf die Konsole
- Auffinden und Interpretieren von Protokolldateien
- Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS)
- Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien
- Nutzung der Client Clocking-Funktion
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv IEDM 2024 Tutorial2
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsInData Labs At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including:
-Artificial Intelligence Market Overview
-Strategies for AI Adoption in 2025
-Anticipated drivers of AI adoption and transformative technologies
-Benefits of AI and Big data for your business
-Tips on how to prepare your business for innovation
-AI and data privacy: Strategies for securing data privacy in AI models, etc.
Download your free copy nowand implement the key findings to improve your business.
Procurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptxJon Hansen Procurement Insights integrated Historic Procurement Industry Archives, serves as a powerful complement — not a competitor — to other procurement industry firms. It fills critical gaps in depth, agility, and contextual insight that most traditional analyst and association models overlook.
Learn more about this value- driven proprietary service offering here.
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell With expertise in data architecture, performance tracking, and revenue forecasting, Andrew Marnell plays a vital role in aligning business strategies with data insights. Andrew Marnell’s ability to lead cross-functional teams ensures businesses achieve sustainable growth and operational excellence.
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB Want to learn practical tips for designing systems that can scale efficiently without compromising speed?
Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development.
As you explore key principles of designing low-latency systems with Rust, you will learn how to:
- Create and compile a real-world app with Rust
- Connect the application to ScyllaDB (NoSQL data store)
- Negotiate tradeoffs related to data modeling and querying
- Manage and monitor the database for consistently low latencies
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025
https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/
Is AI just another technology, or does it fundamentally change the way we live and think?
Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater.
At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts.
At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat The MCP (Model Context Protocol) is a framework designed to manage context and interaction within complex systems. This SlideShare presentation will provide a detailed overview of the MCP Model, its applications, and how it plays a crucial role in improving communication and decision-making in distributed systems. We will explore the key concepts behind the protocol, including the importance of context, data management, and how this model enhances system adaptability and responsiveness. Ideal for software developers, system architects, and IT professionals, this presentation will offer valuable insights into how the MCP Model can streamline workflows, improve efficiency, and create more intuitive systems for a wide range of use cases.
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat