This is the presentation given as a Webinar using Webex, on World IPv6 Launch, 6 June 2012.
http://www.ipv6matrix.org/
http://www.worldipv6launch.org/
This presentation is the full original presentation of the IPv6Matrix project.
It contains details of the hardware used, as well as the type of data that's archived.
It also contains very useful instructions and tips on how to surf the IPv6Matrix Web site for more data.
Systematic integration of millions of peptidoform evidences into Ensembl and ...Yasset Perez-Riverol
There is an increasing demand for approaches to integrate proteomics data with other ‘omics’ data types, especially genomics. In fact, current resources to integrate proteomics in a genome context are insufficient for large-scale studies. To bring the genomics and proteomics results into coherence, novel resources must be developed that provide simple links across previously acquired datasets with minimal preprocessing and hassle.
PRIDE (http://www.ebi.ac.uk/pride) and Ensembl (http://www.ensembl.org) are world-leading resources for proteomics and genomics data. We have developed a new resource and framework to enable a systematic integration of mass spectrometry (MS) based proteomics evidences into genome browsers. We automatically integrate every high-quality MS-based peptidoform reported in the PRIDE database, into genome coordinates through Ensembl, and other genome browsers.
The document describes the agenda for a hands-on training workshop on methylation sequencing analysis. The training will cover topics such as WGBS dataset quality control, mapping, and basic analysis using tools like methpipe, BEDtools, and the UCSC Genome Browser. The first session in the morning focuses on WGBS dataset QC, mapping with methpipe, and calculating metrics like bisulfite conversion rate and methylation levels in different genomic regions. The second session in the afternoon involves more advanced analysis using BEDtools to analyze methylation differences between genomic regions and between male and female samples, as well as using the UCSC Genome Browser.
AI橋渡しクラウド(ABCI)における高性能計算とAI/ビッグデータ処理の融合Hitoshi Sato
AI Bridging Cloud Infrastructure (ABCI) is a large-scale open AI infrastructure in Japan operated by the University of Tokyo. It provides:
1) Over 0.55 exaflops of computing power with 1088 nodes equipped with 4352 NVIDIA GPUs and 43520 CPU cores for AI and data science research.
2) Dense rack design optimized for thermal management with ambient warm water cooling to achieve high density computing.
3) Hierarchical storage including 1.6PB of local NVMe SSDs, 22PB of parallel file storage, and object storage for burst buffers and campaign storage.
4) Open access platform to accelerate joint academic-industry R&D for AI through distributed
One of the presentations used in a discussion meeting about GlusterFS held on Sep. 14, 2011 in Japan.
Ust: http://www.ustream.tv/channel/glusterfs
Togetter: http://togetter.com/li/188183
- The document describes a media player plugin that allows choosing between IPv4 and IPv6 protocols for streaming video chunks to determine the faster connection speed.
- The plugin modifies an existing media player (Hls.js) to measure download speeds for each video chunk delivered over IPv4 or IPv6, and then selects the preferable protocol.
- Statistics from over 950 streaming sessions in Japan show IPv6 speeds are generally faster than IPv4, especially during night hours, though IPv4 can be faster in some cases like with older IPv6 tunneling.
1) The PG-Strom project aims to accelerate PostgreSQL queries using GPUs. It generates CUDA code from SQL queries and runs them on Nvidia GPUs for parallel processing.
2) Initial results show PG-Strom can be up to 10 times faster than PostgreSQL for queries involving large table joins and aggregations.
3) Future work includes better supporting columnar formats and integrating with PostgreSQL's native column storage to improve performance further.
PGCon 2014 - What Do You Mean my Database Server Core Dumped? - How to Inspec...Faisal Akber
Presented at PGCon 2014 in Ottawa.
Program crashes are a fact of life and occasionally unavoidable. If there are core dumps that get generated then understanding what happened becomes easier.
"Hadoop and NoSQL: Scalable Back-end Clusters Orchestration in Real-world Systems" was presented in CloudCon2012: BIT’s 1st Annual World Congress of Cloud Computing 2012 will be held from August 28-30, 2012 in Dalian, China
Devoxx France 2018 : Mes Applications en Production sur KubernetesMichaël Morello
Retour d'expérience sur la mise en production d'applications ( Java mais pas seulement ) sur Kubernetes à Devoxx France 2018
La vidéo avec la démo est disponible en ligne ici : https://www.youtube.com/watch?v=cqqLeS9mUyU
Supermicro High Performance Enterprise Hadoop Infrastructuretempledf
This document summarizes Supermicro's building block platforms for Hadoop clusters. It describes various 1U and 2U node configurations that are optimized for different Hadoop roles like NameNode and DataNode. These nodes include features like dual quad-core Xeons, hot-swappable HDDs and power supplies. The document also outlines turnkey pilot cluster kits and rack solutions that integrate Supermicro nodes with networking switches and software from partners like Cloudera for out-of-the-box Hadoop deployments.
The document compares on-heap and off-heap caching options. It discusses heap memory usage in the JVM and alternatives like off-heap memory using memory mapped files, ByteBuffers, and Unsafe. Popular off-heap caches like Chronicle, Hazelcast, and Redis are presented along with comparisons of their features, performance, and garbage collection impact. The document aims to help developers choose the most suitable cache for their application needs.
The document discusses Spark operations like map, filter, reduceByKey, and their execution across partitions. It provides examples of transforming RDDs with word count and joining datasets. Machine learning algorithms like linear regression are also covered, including creating labeled point datasets, training models, and evaluating predictions. Logs and errors from running Spark tests in Python are displayed.
The GIST AI-X Computing Cluster provides powerful accelerated computation resources for machine learning using GPUs and other hardware. It includes DGX A100 and DGX-1V nodes with 8 NVIDIA A100 or V100 GPUs each, connected by high-speed networking. The cluster uses Singularity containers, Slurm scheduling, and Ceph storage. It allows researchers to request resources, build container images, and run distributed deep learning jobs across multiple GPUs.
ABCI: AI Bridging Cloud Infrastructure for Scalable AI/Big DataHitoshi Sato
National Institute of Advanced Industrial Science and Technology (AIST) in Japan is focusing on bridging innovative technological seeds to commercialization. It currently lacks cutting-edge computing infrastructure dedicated to AI and big data that is openly available. The proposed AI Bridging Cloud Infrastructure (ABCI) project aims to provide a large-scale open AI infrastructure to accelerate joint academic-industry R&D for AI in Japan. ABCI will feature 1088 compute nodes with 4352 NVIDIA Tesla V100 GPUs providing 0.550 exaflops of AI performance, connected by an InfiniBand network and utilizing liquid cooling technologies. It will provide an open platform for AI research, applications, services and infrastructure design through industry and academic
Parallelized pipeline for whole genome shotgun metagenomics with GHOSTZ-GPU a...Masahito Ohue
Masahito Ohue, Marina Yamasawa, Kazuki Izawa, Yutaka Akiyama: Parallelized pipeline for whole genome shotgun metagenomics with GHOSTZ-GPU and MEGAN,
In Proceedings of the 19th annual IEEE International Conference on Bioinformatics and Bioengineering (IEEE BIBE 2019), 152-156, 2019. doi: 10.1109/BIBE.2019.00035
This document discusses GPU accelerated computing and programming with GPUs. It provides characteristics of GPUs from Nvidia, AMD, and Intel including number of cores, memory size and bandwidth, and power consumption. It also outlines the 7 steps for programming with GPUs which include building and loading a GPU kernel, allocating device memory, transferring data between host and device memory, setting kernel arguments, enqueueing kernel execution, transferring results back, and synchronizing the command queue. The goal is to achieve super parallel execution with GPUs.
The document describes Supermicro's building block platforms for Hadoop infrastructure, including 1U and 2U server nodes optimized for different Hadoop roles. It lists the specifications of the nodes, such as processor, memory, drive configuration and capacity. It also provides turnkey certified pilot cluster kits and optimized racks for Hadoop deployments.
The column-oriented data structure of PG-Strom stores data in separate column storage (CS) tables based on the column type, with indexes to enable efficient lookups. This reduces data transfer compared to row-oriented storage and improves GPU parallelism by processing columns together.
Tokyo Cabinet is a library of routines for managing a database. The database is a simple data file containing records, each is a pair of a key and a value. Every key and value is serial bytes with variable length. Both binary data and character string can be used as a key and a value. There is neither concept of data tables nor data types. Records are organized in hash table, B+ tree, or fixed-length array.
The document describes the TSUBAME2 supercomputing system overview. It has a total storage capacity of 11PB distributed across HDD, tape and SSD storage. It utilizes Intel Xeon and Nvidia GPU processors with Infiniband networking. The system employs a hierarchical parallel file system and provides various access protocols like NFS, CIFS and iSCSI for home directories and applications.
This document describes using in-place computing on PostgreSQL to perform statistical analysis directly on data stored in a PostgreSQL database. Key points include:
- An F-test is used to compare the variances of accelerometer data from different phone models (Nexus 4 and S3 Mini) and activities (walking and biking).
- Performing the F-test directly in PostgreSQL via SQL queries is faster than exporting the data to an R script, as it avoids the overhead of data transfer.
- PG-Strom, an extension for PostgreSQL, is used to generate CUDA code on-the-fly to parallelize the variance calculations on a GPU, further speeding up the F-test.
GPU Accelerated Data Science with RAPIDS - ODSC West 2020John Zedlewski
This document provides an overview of RAPIDS, an open source suite of libraries for GPU-accelerated data science. It discusses how RAPIDS uses GPUs to accelerate ETL, machine learning, and other data science workflows. Key points include:
- RAPIDS includes libraries like cuDF for dataframes, cuML for machine learning, and cuGraph for graph analytics. It aims to provide familiar Python APIs for these tasks.
- cuDF provides over 10x speedups for ETL tasks like data loading, transformations, and feature engineering by keeping data on the GPU.
- cuML provides GPU-accelerated versions of popular scikit-learn algorithms like linear regression, random forests,
This document provides a list of display filter keywords that can be used in Wireshark to filter packets based on fields in different protocols including Ethernet, ARP, IPv4, IPv6, TCP, UDP, ICMP, HTTP, BGP, MPLS, Frame Relay, PPP, DTP, VTP and more. It is presented in two parts and includes brief descriptions of common fields that can be filtered on for each protocol.
The following document contains a personal interpretation by the author of the events that led
to and took place at the World Conference on International Telecommunications (“WCIT”) in
Dubai, United Arab Emirates in December 2012. All views expressed in this document are
my own, although I admit that they have been biased by years of belief in multistakeholderism.
The reader is therefore encouraged to read accounts from other independent
sources to reduce bias.
There are two parts to this document. The first part provides a recollection of the events at
WCIT. The Second part provides suggestions for avenues that the Internet community and the
ICANN At-Large Advisory Committee in particular should explore with ICANN’s support to
take proactive steps to promote the Multi-Stakeholder Internet Governance Model and
improve its reach to the edges. The suggestions stem from deep needs that were made
apparent during WCIT – including but not limited to outreach, education, capacity building
and proactive engagement.
Presentation given at the Internet Society's INET conference in London on 29 September 2010.
It contains real results of IPv6 compatible content obtained from a Crawler testing the domains of the 1 Million most popular Internet Web sites. Tests WWW, SMTP, NameServers, and NTP.
September 2010 figures for Europe and Asia are given.
PGCon 2014 - What Do You Mean my Database Server Core Dumped? - How to Inspec...Faisal Akber
Presented at PGCon 2014 in Ottawa.
Program crashes are a fact of life and occasionally unavoidable. If there are core dumps that get generated then understanding what happened becomes easier.
"Hadoop and NoSQL: Scalable Back-end Clusters Orchestration in Real-world Systems" was presented in CloudCon2012: BIT’s 1st Annual World Congress of Cloud Computing 2012 will be held from August 28-30, 2012 in Dalian, China
Devoxx France 2018 : Mes Applications en Production sur KubernetesMichaël Morello
Retour d'expérience sur la mise en production d'applications ( Java mais pas seulement ) sur Kubernetes à Devoxx France 2018
La vidéo avec la démo est disponible en ligne ici : https://www.youtube.com/watch?v=cqqLeS9mUyU
Supermicro High Performance Enterprise Hadoop Infrastructuretempledf
This document summarizes Supermicro's building block platforms for Hadoop clusters. It describes various 1U and 2U node configurations that are optimized for different Hadoop roles like NameNode and DataNode. These nodes include features like dual quad-core Xeons, hot-swappable HDDs and power supplies. The document also outlines turnkey pilot cluster kits and rack solutions that integrate Supermicro nodes with networking switches and software from partners like Cloudera for out-of-the-box Hadoop deployments.
The document compares on-heap and off-heap caching options. It discusses heap memory usage in the JVM and alternatives like off-heap memory using memory mapped files, ByteBuffers, and Unsafe. Popular off-heap caches like Chronicle, Hazelcast, and Redis are presented along with comparisons of their features, performance, and garbage collection impact. The document aims to help developers choose the most suitable cache for their application needs.
The document discusses Spark operations like map, filter, reduceByKey, and their execution across partitions. It provides examples of transforming RDDs with word count and joining datasets. Machine learning algorithms like linear regression are also covered, including creating labeled point datasets, training models, and evaluating predictions. Logs and errors from running Spark tests in Python are displayed.
The GIST AI-X Computing Cluster provides powerful accelerated computation resources for machine learning using GPUs and other hardware. It includes DGX A100 and DGX-1V nodes with 8 NVIDIA A100 or V100 GPUs each, connected by high-speed networking. The cluster uses Singularity containers, Slurm scheduling, and Ceph storage. It allows researchers to request resources, build container images, and run distributed deep learning jobs across multiple GPUs.
ABCI: AI Bridging Cloud Infrastructure for Scalable AI/Big DataHitoshi Sato
National Institute of Advanced Industrial Science and Technology (AIST) in Japan is focusing on bridging innovative technological seeds to commercialization. It currently lacks cutting-edge computing infrastructure dedicated to AI and big data that is openly available. The proposed AI Bridging Cloud Infrastructure (ABCI) project aims to provide a large-scale open AI infrastructure to accelerate joint academic-industry R&D for AI in Japan. ABCI will feature 1088 compute nodes with 4352 NVIDIA Tesla V100 GPUs providing 0.550 exaflops of AI performance, connected by an InfiniBand network and utilizing liquid cooling technologies. It will provide an open platform for AI research, applications, services and infrastructure design through industry and academic
Parallelized pipeline for whole genome shotgun metagenomics with GHOSTZ-GPU a...Masahito Ohue
Masahito Ohue, Marina Yamasawa, Kazuki Izawa, Yutaka Akiyama: Parallelized pipeline for whole genome shotgun metagenomics with GHOSTZ-GPU and MEGAN,
In Proceedings of the 19th annual IEEE International Conference on Bioinformatics and Bioengineering (IEEE BIBE 2019), 152-156, 2019. doi: 10.1109/BIBE.2019.00035
This document discusses GPU accelerated computing and programming with GPUs. It provides characteristics of GPUs from Nvidia, AMD, and Intel including number of cores, memory size and bandwidth, and power consumption. It also outlines the 7 steps for programming with GPUs which include building and loading a GPU kernel, allocating device memory, transferring data between host and device memory, setting kernel arguments, enqueueing kernel execution, transferring results back, and synchronizing the command queue. The goal is to achieve super parallel execution with GPUs.
The document describes Supermicro's building block platforms for Hadoop infrastructure, including 1U and 2U server nodes optimized for different Hadoop roles. It lists the specifications of the nodes, such as processor, memory, drive configuration and capacity. It also provides turnkey certified pilot cluster kits and optimized racks for Hadoop deployments.
The column-oriented data structure of PG-Strom stores data in separate column storage (CS) tables based on the column type, with indexes to enable efficient lookups. This reduces data transfer compared to row-oriented storage and improves GPU parallelism by processing columns together.
Tokyo Cabinet is a library of routines for managing a database. The database is a simple data file containing records, each is a pair of a key and a value. Every key and value is serial bytes with variable length. Both binary data and character string can be used as a key and a value. There is neither concept of data tables nor data types. Records are organized in hash table, B+ tree, or fixed-length array.
The document describes the TSUBAME2 supercomputing system overview. It has a total storage capacity of 11PB distributed across HDD, tape and SSD storage. It utilizes Intel Xeon and Nvidia GPU processors with Infiniband networking. The system employs a hierarchical parallel file system and provides various access protocols like NFS, CIFS and iSCSI for home directories and applications.
This document describes using in-place computing on PostgreSQL to perform statistical analysis directly on data stored in a PostgreSQL database. Key points include:
- An F-test is used to compare the variances of accelerometer data from different phone models (Nexus 4 and S3 Mini) and activities (walking and biking).
- Performing the F-test directly in PostgreSQL via SQL queries is faster than exporting the data to an R script, as it avoids the overhead of data transfer.
- PG-Strom, an extension for PostgreSQL, is used to generate CUDA code on-the-fly to parallelize the variance calculations on a GPU, further speeding up the F-test.
GPU Accelerated Data Science with RAPIDS - ODSC West 2020John Zedlewski
This document provides an overview of RAPIDS, an open source suite of libraries for GPU-accelerated data science. It discusses how RAPIDS uses GPUs to accelerate ETL, machine learning, and other data science workflows. Key points include:
- RAPIDS includes libraries like cuDF for dataframes, cuML for machine learning, and cuGraph for graph analytics. It aims to provide familiar Python APIs for these tasks.
- cuDF provides over 10x speedups for ETL tasks like data loading, transformations, and feature engineering by keeping data on the GPU.
- cuML provides GPU-accelerated versions of popular scikit-learn algorithms like linear regression, random forests,
This document provides a list of display filter keywords that can be used in Wireshark to filter packets based on fields in different protocols including Ethernet, ARP, IPv4, IPv6, TCP, UDP, ICMP, HTTP, BGP, MPLS, Frame Relay, PPP, DTP, VTP and more. It is presented in two parts and includes brief descriptions of common fields that can be filtered on for each protocol.
The following document contains a personal interpretation by the author of the events that led
to and took place at the World Conference on International Telecommunications (“WCIT”) in
Dubai, United Arab Emirates in December 2012. All views expressed in this document are
my own, although I admit that they have been biased by years of belief in multistakeholderism.
The reader is therefore encouraged to read accounts from other independent
sources to reduce bias.
There are two parts to this document. The first part provides a recollection of the events at
WCIT. The Second part provides suggestions for avenues that the Internet community and the
ICANN At-Large Advisory Committee in particular should explore with ICANN’s support to
take proactive steps to promote the Multi-Stakeholder Internet Governance Model and
improve its reach to the edges. The suggestions stem from deep needs that were made
apparent during WCIT – including but not limited to outreach, education, capacity building
and proactive engagement.
Presentation given at the Internet Society's INET conference in London on 29 September 2010.
It contains real results of IPv6 compatible content obtained from a Crawler testing the domains of the 1 Million most popular Internet Web sites. Tests WWW, SMTP, NameServers, and NTP.
September 2010 figures for Europe and Asia are given.
Présentation des derniers résultats de la tortue IPv6. Cette version est en Français. Les résultats sont les mêmes que ceux présentés lors du Webinar IPv6 ISOC du 6 Juin 2012, du même auteur.
Date des résultats - 4 Juin 2012, c'est à dire 2 jours avant le "World IPv6 Launch".
Cette présentation a été faite lors du colloque de Déploiement IPv6 en Tunisie, le 19 Juin 2012. Ce colloque a été mis en place par la Fédération Méditerranéenne des Associations d'Internet (FMAI).
http://www.fmai.org/
This presentation relates the results of the IPv6 Matrix crawler 6 months after the world IPv6 Launch publicised on http://www.worldipv6launch.org/
While content providers in some countries clearly took advantage of this event to launch IPv6 service, others completely missed the buzz.
Check out http://www.ipv6matrix.org/ for more information.
This document provides an overview and results from the IPv6 Matrix Project, which tracks global IPv6 connectivity. It shows data on IPv6 penetration rates for infrastructure (DNS, web, email, NTP) and web servers alone in different regions from December 2012 to June 2013. Europe saw steady increases overall, with Estonia having the biggest growth. Slovakia and Portugal continued leading in dual-stack websites. Germany had the most dual-stack sites. Asia results showed Singapore and Hong Kong increasing slightly while others fluctuated.
myequivalents is a system to manage cross-references between entities that can be identified by pairs composed of a service name (e.g., EBI's ArrayExpress, Wikipedia) and an accession (e.g., E-MEXP-2514, Barack_Obama). For those familiar with the Semantic Web, we plan to support identification of entities via URIs and the owl:sameAs property. For those who already know MIRIAM and identifiers.org, myequivalents is more general than them and we plan to support these services in future.
This presentation relates the results of the IPv6 Matrix crawler just over a month after the world IPv6 Launch publicised on http://www.worldipv6launch.org/
While content providers in some countries clearly took advantage of this event to launch IPv6 service, others completely missed the buzz.
The document describes the IPv6 Matrix Project, which tracks IPv6 connectivity worldwide. The project involves running an IPv6 crawler on servers in London to test IPv6 connectivity of popular websites and services. The crawler gathers data that is stored in files and integrated into a database on a web server. This allows the results to be viewed worldwide on the project website at http://www.ipv6matrix.org. The project aims to measure adoption of IPv6 as IP addresses run out.
Apache Camel is a powerful open source integration framework that allows developers to focus on business logic by hiding complexity. It supports over 80 components and 19 data formats, and provides a domain-specific language for integration patterns in Java, XML, and Scala. Camel routes can be run in standalone applications or deployed to various containers.
Apache dubbo (incubating) open source present and futureHuxing Zhang
Dubbo is a Java-based RPC framework that was originally open-sourced by Alibaba in 2011 and donated to the Apache Software Foundation in 2017. The document discusses Dubbo's current status, roadmap, and future at Apache. It notes that Dubbo is widely used in production by major companies and has over 18,000 stars on GitHub. The roadmap section outlines plans for cloud native capabilities, service mesh, and polyglot support. It also discusses goals around modularity, fault tolerance, and handling large-scale clusters. The document concludes by covering Dubbo's incubation process at Apache and emphasizing the importance of community.
This document discusses and compares Neptune and JanusGraph graph databases. It provides an overview of Neptune's features like multi-AZ deployment and storage in S3. It also describes how to access Neptune using Gremlin and SPARQL query languages. The document then introduces JanusGraph and notes some key differences when using Gremlin APIs with Neptune versus JanusGraph. It shares the results of a performance test loading Amazon product graph data into both systems. Finally, it discusses options for loading and querying data between Neptune, Athena, Kinesis and other AWS services.
PLNOG 18 - Paweł Małachowski - Spy hard czyli regexpem po pakietachPROIDEA
This document discusses challenges related to implementing 100G deep packet inspection on x86 platforms. It begins by explaining why DPI is needed at speeds of 100G+ and examples of large DDoS attacks where DPI could help. It then sizes the requirements for scanning packets at 100Gbit/s rates. Next, it covers approaches to software payload lookup like regular expressions and finite state machines. The rest of the document discusses specific regex and DPI techniques like Hyperscan, benchmarking regex performance, and examples of hardware that could accelerate such inspection.
Spy hard, challenges of 100G deep packet inspection on x86 platformRedge Technologies
This document discusses challenges and approaches for performing deep packet inspection (DPI) at speeds of 100 gigabits per second and beyond on x86 platforms. It begins by explaining why DPI is needed at such high speeds, for tasks like large-scale intrusion detection. It then examines the performance requirements for scanning payloads at 100Gbps rates. The document reviews different software approaches for payload matching, such as regular expressions, and hardware that can assist, such as Intel's Hyperscan technology. It also provides examples of how Hyperscan can be integrated into real-world intrusion detection and prevention systems.
As presented at Hackfest 2015 Quebec City, November 7th 2015.
This session will focus on real world deployments of DDoS mitigation strategies in every layer of the network. It will give an overview of methods to prevent these attacks and best practices on how to provide protection in complex cloud platforms. The session will also outline what we have found in our experience managing and running thousands of Linux and Unix managed service platforms and what specifically can be done to offer protection at every layer. The session will offer insight and examples from both a business and technical perspective.
The document discusses implementing enterprise integration patterns through Apache Camel. It provides an overview of enterprise integration patterns, describes what Apache Camel is and how it is based on these patterns, and gives examples of implementing the Message Filter pattern in XML, Java, Scala and Spring configurations. It also discusses using beans with Camel for message translation and binding beans to endpoints.
The document discusses implementing enterprise integration patterns through Apache Camel. It provides an overview of enterprise integration patterns from a book by Gregor Hohpe and Bobby Woolf. It then describes Apache Camel as a powerful open source integration framework based on these patterns. As an example, it demonstrates how to implement a message filter pattern in Apache Camel using XML, Spring XML, and Java code. It also lists the many expression languages and over 120 components supported by Apache Camel.
Easy Integration with Apache Camel and Fuse IDEJBUG London
The talk presented by James Strachan (Red Hat) on the 6th of March 2013 at the London JBoss USer Group event.
Visit London JBUG on Meetup http://www.meetup.com/JBoss-User-Group/
This document discusses deployment strategies for Rails applications. It describes using Nginx as a front-end HTTP server with Mongrel as the application server. Capistrano is recommended for deployment automation. Caching at the page, action and fragment level with Memcached is also covered as a strategy for improving performance. Challenges discussed include Ruby threading and memory management issues, as well as integrating C extensions and ensuring interoperability. Installation details are provided for deploying a Rails app with Passenger on Apache. Benchmarks are mentioned comparing Mongrel, Thin and Passenger.
Ed Warnicke's talk at Open Networking Summit.
All Open Source Networking project depend on having access to a Universal Dataplane that is:
Able to they deployment models: Bare Metal/Embedded/Cloud/Containers/NFVi/VNFs
High performance
Feature Rich
Open with Broad Community support/participation
FD.io provides all of this and more. Come learn more about FD.io and how you can begin using it.
- IPv6 is needed to address the impending exhaustion of IPv4 address space. It features a 128-bit address compared to 32-bit in IPv4, vastly expanding the available addresses.
- Security issues in transitioning from IPv4 to IPv6 include weaknesses in enumeration, scanning and managing the large IPv6 address space. Firewalls and other perimeter defenses must also protect both IPv4 and IPv6 networks to prevent bypass.
- Attacks can exploit protocols like neighbor discovery in IPv6, as well as vulnerabilities in applications that operate over both IPv4 and IPv6. Proper implementation and maintenance of defenses is needed to secure the transition.
As presented at LinuxCon/CloudOpen 2015 Seattle Washington, August 19th 2015. Sagi Brody & Logan Best
This session will focus on real world deployments of DDoS mitigation strategies in every layer of the network. It will give an overview of methods to prevent these attacks and best practices on how to provide protection in complex cloud platforms. The session will also outline what we have found in our experience managing and running thousands of Linux and Unix managed service platforms and what specifically can be done to offer protection at every layer. The session will offer insight and examples from both a business and technical perspective.
This document discusses deployment strategies for Ruby on Rails applications. It covers common components of the "Rails stack" including databases, caching, application servers and load balancers. Popular options are mentioned like Nginx, Memcached, Mongrel and Capistrano. Performance optimization techniques are also summarized, such as caching, background processing and memory usage strategies. The document concludes with an overview of common deployment processes and challenges.
This document discusses integrating XGBoost machine learning with Spark and DataFrames. It provides examples of using XGBoost in Spark to train models on distributed data and make predictions on streaming data in parallel. It also discusses future work, such as using Rabbit for parallel learning, adding support to more platforms like Windows, and integrating with Spark ML pipelines.
2012 11-09 facex - i pv6 transition planning-Eduardo Coelho
IPv6 is an introduction to transition planning from IPv4 to IPv6. It discusses the need to plan the transition, presents a framework of getting to know, planning, testing and implementing changes. Key challenges with IPv4 like lack of addresses and NAT issues are reviewed. A dual stack deployment strategy is recommended to run IPv4 and IPv6 in parallel. Choosing network equipment, addressing, DNS settings, legacy device support, transition protocols and security are important considerations in the planning process. Careful planning is needed to define addressing, choose ISPs, support dual-stack devices and prefer native IPv6 when possible.
State of the art: Server-Side JavaScript - WebWorkersCamp IV - Open World For...Alexandre Morgaut
This document discusses the history and state of server-side JavaScript. It began in 1995 with LiveScript/JavaScript in browsers. In 2009, Node.js popularized an event-driven, non-blocking I/O model for servers using JavaScript. Since then many frameworks have adopted this approach, including RingoJS, Narwhal, and others. Benchmarks show Node.js has comparable or better performance than traditional server-side frameworks. Key concepts are its integration with databases, common APIs across browsers and servers, and an asynchronous event-based architecture using one thread and shared context.
What is Digital Rebar Provision (and how RackN extends)?rhirschfeld
Walks through how Digital Rebar Provision rethinks bare metal automation beyond simple O/S install into an integrated workflow system for building data center underlay.
INCLUDES VIDEO OF PRESO
Slide deck used in my presentation at the Second Ukrainian Internet Governance Forum in Kiev on 2nd September 2011.
This provides a good introduction about ICANN's bottom-up multi-stakeholder governance process, looking especially at the At-Large Advisory Committee (ALAC) process for bottom-up policy input.
Presentation made at Karunya University, Karunya Nagar, Coimbatore, India on 3 Feb 2012.
This presentation provides a summary of IPv6's main uses and main technical features.
It also includes a primer on how the Internet is changing the world - taking the music industry as an example.
Presentation at the Bharathi Dasan Institute of Management (BIM), Tiruchirappalli, 2 February 2012.
This slide deck provides a sense of the multi-stakeholder processes that have made the Internet what it is today. The presentation speaks of the support of the multi-stakeholder model, as well as user-centric Internet.
It also mentions that the Internet is a social catalyst to changing the world.
Shortly after this presentation, I was interviewed by the Hindu Newspaper for an article published on 3 February 2012.
Short presentation made at attempting to demonstrate the fast growth of the Internet.
Includes pictures of early ArpaNet diagrams, reproduced without permission but found openly on the Internet.
Most of the other material (host files as well as screen captures of early browser activity) is mine.
This presentation looks at many of the main features of IPv6 and how IPv6 differs with IPv4. It is a good starter for people not knowing about IPv6 and was presented at ICCA 2012 in Pondicherry, India on 31st January 2012.
Many thanks to Dr. Alaa Al Din Al Radhi for many of the visuals used in this slide deck.
This presentation incorporates results completed in July 2011, one month after the IPv6 Day taking place in June 2011.
http://www.ipv6matrix.org
This document describes the IPv6 Matrix Project, which tracks IPv6 connectivity worldwide. It crawls major websites and tests their DNS, web servers, email, and NTP servers for IPv6 support. This data is stored and analyzed to determine penetration rates for IPv6 infrastructure and content over time. Maps and data on European IPv6 adoption rates are presented as examples. The goal is to promote IPv6 adoption by providing transparency into connectivity and identifying areas still relying primarily on IPv4.
Presentation distributed for World IPv6 Day, on 8 June 2011.
This contains results for IPv6 dual stack Web sites in April 2011 and compares them with results collected in September 2010.
April 2011 Update of the IPv6 Matrix Project results, specifically focused on the situation in Europe.
This presentation was given at the EuroDIG Conference in Belgrade, Serbia, on Tuesday 31 May 2011. It contains a comparison of results from September 2010 to April 2011.
Presentation made at the Internet and Democracy Conference in Kiev, Ukraine, 18 February 2011.
My talk focuses on:
- what is a multi-stakeholder governance process?
- what is the Internet model?
- what is ICANN?
- how is it structured?
- how is it multi-stakeholder bottom-up?
- Structure of GNSO
- Structure of At-Large
- The End-User principle (no filtering)
- The Internet is changing the world of business
- The Internet is changing the world
- The Internet economic weight on GDP
- how do you create a business climate which will take advantage of the Internet?
- Join multi-stakeholder governance processes at ICANN
- An Internet Kill Switch is a Kill Switch for your economy
Full version of IPv6 Matrix project presentation, in French, as given at INET Tunis.
Includes a section focusing on the last IPv4 address blocks available, and another section on African IPv6 connectivity - with a parallel to the spread on Internet in Africa between 1994-1997, thanks to my archives on International Connectivity.
La version intégrale de la présentation du projet IPv6 Matrix, en français, comme présentée au congrès INET Tunis.
Comprend une section consacrée au dernier blocs d'adresses IPv4 disponibles, et une autre section sur la connectivité IPv6 en Afrique - avec un parallèle de propagation Internet en Afrique entre 1994-1997, grâce à mes archives sur la connectivité internationale.
This is a copy of a presentation I gave at IGF Ukraine in Kiev on 4 September 2010.
It provides a few leads to participants on where we're heading as far as the Future of the Internet is concerned.
This is a presentation containing slides which I borrowed from several other presentations, and which I found very useful in explaining how ISOC and ICANN work.
I gave this talk at IGF Ukraine in Kiev, on 4 September 2010, speaking on my own behalf, and making sure it is understood that ICANN and ISOC are two organisations I am a member of, in the same way someone is a member of a tennis club and a football club.
This long paper started out as a small experiment which was supposed to last an afternoon - a play-around with softwares NetDraw and yEd.
It ended up being a huge paper - too long to publish in a printed publication.
Results are not that significant, in that in the IETF (Internet Engineering Task Force) community, it appears that people really mingle a lot with each other, but the matter of interest is to discover the power of the analysis which can be performed using the software used.
I really believe that Social Network Analysis using Netdraw, yEd, and other SNA and visualisation software, should be mandatory for any bottom-up organisation. I also think that corporations and organisations would really benefit from:
1. having their internal social networks analysis in the same manner.
2. using this type of analysis on their external professional social networks
This pinpoints who are the movers and shakers in the organization. This also pinpoints areas/departments where information flow might not be optimal, thus having a lesser contribution to the organization as a whole.
Feedback/discussion very welcome.
A staged approach to rolling out IPv6/IPv4 dual stack is proposed, starting with easier services like DNS and email that are already IPv6 compatible, and testing the dual stack backbone. This allows costs to be spread out over time while gaining experience with IPv6. The suggested approach aims to make the transition to IPv6 seamless if started immediately.
This is the keynote of the Into the Box conference, highlighting the release of the BoxLang JVM language, its key enhancements, and its vision for the future.
Technology Trends in 2025: AI and Big Data AnalyticsInData Labs
At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including:
-Artificial Intelligence Market Overview
-Strategies for AI Adoption in 2025
-Anticipated drivers of AI adoption and transformative technologies
-Benefits of AI and Big data for your business
-Tips on how to prepare your business for innovation
-AI and data privacy: Strategies for securing data privacy in AI models, etc.
Download your free copy nowand implement the key findings to improve your business.
Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan
This is a Quick Research Guide (QRG).
QRGs include the following:
- A brief, high-level overview of the QRG topic.
- A milestone timeline for the QRG topic.
- Links to various free online resource materials to provide a deeper dive into the QRG topic.
- Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic.
QRGs planned for the series:
- Artificial Intelligence QRG
- Quantum Computing QRG
- Big Data Analytics QRG
- Spacecraft Guidance, Navigation & Control QRG (coming 2026)
- UK Home Computing & The Birth of ARM QRG (coming 2027)
Any questions or comments?
- Please contact Arthur Morgan at [email protected].
100% human made.
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc
Most consumers believe they’re making informed decisions about their personal data—adjusting privacy settings, blocking trackers, and opting out where they can. However, our new research reveals that while awareness is high, taking meaningful action is still lacking. On the corporate side, many organizations report strong policies for managing third-party data and consumer consent yet fall short when it comes to consistency, accountability and transparency.
This session will explore the research findings from TrustArc’s Privacy Pulse Survey, examining consumer attitudes toward personal data collection and practical suggestions for corporate practices around purchasing third-party data.
Attendees will learn:
- Consumer awareness around data brokers and what consumers are doing to limit data collection
- How businesses assess third-party vendors and their consent management operations
- Where business preparedness needs improvement
- What these trends mean for the future of privacy governance and public trust
This discussion is essential for privacy, risk, and compliance professionals who want to ground their strategies in current data and prepare for what’s next in the privacy landscape.
Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma
My talk for the Indian School of Business (ISB) Emerging Leaders Program Cohort 9. In this talk, I discussed key issues around adoption of GenAI in business - benefits, opportunities and limitations. I also discussed how my research on Theory of Cognitive Chasms helps address some of these issues
Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company
Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.
Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next.
Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/
Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul
Artificial intelligence is changing how businesses operate. Companies are using AI agents to automate tasks, reduce time spent on repetitive work, and focus more on high-value activities. Noah Loul, an AI strategist and entrepreneur, has helped dozens of companies streamline their operations using smart automation. He believes AI agents aren't just tools—they're workers that take on repeatable tasks so your human team can focus on what matters. If you want to reduce time waste and increase output, AI agents are the next move.
Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark?
At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍
Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock
Building 10x Organizations with Modern Productivity Metrics
10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’
Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them.
But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?
How Can I use the AI Hype in my Business Context?Daniel Lehner
𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨?
Everyone’s talking about AI but is anyone really using it to create real value?
Most companies want to leverage AI. Few know 𝗵𝗼𝘄.
✅ What exactly should you ask to find real AI opportunities?
✅ Which AI techniques actually fit your business?
✅ Is your data even ready for AI?
If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.
What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat
The MCP (Model Context Protocol) is a framework designed to manage context and interaction within complex systems. This SlideShare presentation will provide a detailed overview of the MCP Model, its applications, and how it plays a crucial role in improving communication and decision-making in distributed systems. We will explore the key concepts behind the protocol, including the importance of context, data management, and how this model enhances system adaptability and responsiveness. Ideal for software developers, system architects, and IT professionals, this presentation will offer valuable insights into how the MCP Model can streamline workflows, improve efficiency, and create more intuitive systems for a wide range of use cases.
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada
Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next.
Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/
Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.
Artificial Intelligence is providing benefits in many areas of work within the heritage sector, from image analysis, to ideas generation, and new research tools. However, it is more critical than ever for people, with analogue intelligence, to ensure the integrity and ethical use of AI. Including real people can improve the use of AI by identifying potential biases, cross-checking results, refining workflows, and providing contextual relevance to AI-driven results.
News about the impact of AI often paints a rosy picture. In practice, there are many potential pitfalls. This presentation discusses these issues and looks at the role of analogue intelligence and analogue interfaces in providing the best results to our audiences. How do we deal with factually incorrect results? How do we get content generated that better reflects the diversity of our communities? What roles are there for physical, in-person experiences in the digital world?
Splunk Security Update | Public Sector Summit Germany 2025Splunk
IPv6 Matrix presentation for World IPv6 Launch, June 2012
1. IPv6 Matrix Project
Tracking IPv6 connectivity Worldwide
http://www.ipv6matrix.org
Dr. Olivier MJ Crépin-Leblond – [email protected]
4 June 2012 Update for World IPv6 Launch on 6 June 2012
Page 1 IPv6 Matrix Project - http://www.ipv6matrix.org
2. We are running out of IP addresses
http://www.potaroo.net/tools/ipv4/index.html
When we reach this point, it will be too late since
there will be no more “free” IPv4 addresses!
Real time data collected September 2011
Page 2 IPv6 Matrix Project - http://www.ipv6matrix.org
3. World IPv6 Launch
Major Internet service providers
(ISPs), home networking
equipment manufacturers, and
web companies around the world
are coming together to
permanently enable IPv6 for their
products and services.
http://www.worldipv6launch.org
Page 3 IPv6 Matrix Project - http://www.ipv6matrix.org
4. IPv6 Matrix Project
ISOC England was awarded a Community
Grants Programme award in November
2009
Design and implementation of an “IPv6
Crawler,” software on a computer that
crawls through the DNS at regular intervals
in order to detect and test:
IPv6 DNS servers
IPv6 compliant Web servers
IPv6 compliant SMTP mailers
IPv6 compliant NTP servers.
Page 4 IPv6 Matrix Project - http://www.ipv6matrix.org
5. Project Rationale
Today, more than 95% of Internet traffic is generated
by a small number of data sources – i.e. the world’s
busiest Web Sites
Without IPv6 accessible content, IPv6 has no chance
of being used - ever.
Take the 1 Million most popular Web site list from
alexa.com as a starting point for the domains to be
tested. Add more domains later.
Test them for IPv6 connectivity
This is equivalent to testing about 6.3 million hosts
worldwide
Use GeoIP database to estimate real host location
Page 5 IPv6 Matrix Project - http://www.ipv6matrix.org
6. Project Teams
London, UK:
Project Management and support
Hardware supply and installation
Data Centre and IPv6 connectivity
Nile University, Egypt:
Software Programming
Page 6 IPv6 Matrix Project - http://www.ipv6matrix.org
7. Crawler (back
end)
Crawler Model
Name (eth0)
HP DL360p
turtle.ipv6matrix.org ;
crawler.ipv6matrix.org
turtle.ipv6matrix.com ;
crawler.ipv6matrix.com
turtle.ipv6matrix.net ;
crawler.ipv6matrix.net
IPv4 address 212.124.204.162 / 100 Mb/s
(eth0) /
speed
IPv6 address 2a00:19e8:20:1::a2 / 100 Mb/s
(eth0) /
speed
Name (eth1) shell.ipv6matrix.org
IPv4 address 194.33.63.250 / 1 Gb/s (GIH
(eth1) / private address space)
speed
CPU 2 x Dual Core Intel(R)
Xeon(TM) CPU 3.60GHz
RAM 4 Gb DDR2 SDRAM
HD Storage 146 Gb hardware SATA 2-disk
RAID (hot swappable)
PSU 2 x hot-swappable redundant
535W.
Operating CENTOS 5 Linux / updated
System
Page 7 IPv6 Matrix Project - http://www.ipv6matrix.org
8. Web Server
(front end)
Web Server Model
Name (eth0)
HP DL140
elephant.ipv6matrix.org ;
www.ipv6matrix.org
elephant.ipv6matrix.com ;
www.ipv6matrix.com
elephant.ipv6matrix.net ;
www.ipv6matrix.net
IPv4 address 212.124.204.170 / 100 Mb/s
(eth0) /
speed
IPv6 address 2a00:19e8:20:1::aa / 100 Mb/s
(eth0) /
speed
Name (eth1) tusk.ipv6matrix.org
IPv4 address 194.33.63.251 / 1 Gb/s (GIH
(eth1) / private address space)
speed
CPU 2 x Dual Core Intel(R) Xeon(TM)
CPU 3.40GHz
RAM 4 Gb DDR2 SDRAM
HD Storage 2 x 1 Tb fast SATA
PSU Single 500W
Operating System Ubuntu 4.4 Linux / updated
Page 8 IPv6 Matrix Project - http://www.ipv6matrix.org
9. Router
Router
Model CISCO 2811
Operating Advanced IP Services IOS
System
DRAM 64 Mb
Ethernet Ports / 2 / 100 Mb/s
speed
Interface card / MN-16ESW 16 port / 100
speed Mb/s
Page 9 IPv6 Matrix Project - http://www.ipv6matrix.org
10. Local Network
Page 10 IPv6 Matrix Project - http://www.ipv6matrix.org
14. What are we tracking?
Host IPv6 penetration
Using IPv4 Geo-location coordinates
Includes generic TLD (gTLDs, .com, .net, .org) and
country code ccTLDs
Two types of information:
Infrastructure: DNS + Web + E-mail + Time server
(NTP)
This tracks all of the infrastructure required to run
IPv6 Web services
Web sites only (actual content)
This tracks the Web services themselves. Usually this
percentage is lower than the figure for the
infrastructure
Page 14 IPv6 Matrix Project - http://www.ipv6matrix.org
15. What are we archiving?
Everything that we are tracking on the previous page,
plus:
Testing of connectivity to the above services in case
IPv6 addresses are advertised but no service runs on
them
Tracing of route from London Docklands to each one
of these hosts both using IPv4 and IPv6 – and
archiving all of this information in text format
A lot more data, accessible from the Web site archive
In June 2012, the size of this database in text format is
approx 140Gb and continually increasing (the testing
software runs 24/7)
Page 15 IPv6 Matrix Project - http://www.ipv6matrix.org
16. Data Archives
Selecting Data Archives provides
a link to the detailed information
Table.
Click on “Search”, to go
directly to the Top Level Domain,
or scroll down to the desired
Top Level Domain.
Page 16 IPv6 Matrix Project - http://www.ipv6matrix.org
17. Data Archives
Example Data in Data Archives (stop
at date)
Click on the “+” to the left of the
Top Level Domain to gain
access the sub-menu containing
the dates of all the data runs,
and so on, to reveal results.
year-month-day__hour-min-sec
Page 17 IPv6 Matrix Project - http://www.ipv6matrix.org
18. Data Archives - results
Click on the links to open a
new window containing
all of the detailed results
formatted in a table.
Page 18 IPv6 Matrix Project - http://www.ipv6matrix.org
19. Data Archives - results
Basic IPv4/IPv6 connectivity table
Domain penetration summary table
Geographical IP database
Type of IPv6 access (tunnels etc.)
Trace path, hop count, MTU IPv4 & IPv6
Ping count IPv4 and IPv6
Reverse IPv4 and IPv6
SOA for Nameserver
Service detection for SMTP, HTTP and HTTPs
TLS detection for SMTP
Page 19 IPv6 Matrix Project - http://www.ipv6matrix.org
20. Detailed Data for .AE
Clicked on tcp80_WWW_ae: connection to http port
Page 20 IPv6 Matrix Project - http://www.ipv6matrix.org
21. Using the filter
Use the filter to select by Top Level Domain, or by type of service tested.
Page 21 IPv6 Matrix Project - http://www.ipv6matrix.org
27. Europe Trends
Many countries see a significant rise in
infrastructure
Likely to be caused by a main hosting
provider, installing dual-stack Name-servers
Russia with biggest growth in infrastructure
Slovakia & Portugal still leading with dual-
stack Web sites
Spain catching up.
Country with largest number of dual stack
Web sites in Europe: Germany
Page 27 IPv6 Matrix Project - http://www.ipv6matrix.org
28. Asia Data snapshot
IPv6 Host Penetration 2.13%
6.96%
12.90%
Infrastructure 22.42%
- DNS or
- Web or
- E-mail or 0.20% 1.83%
0.50% 0.22% 2.02%
- NTP 0.47%
2.76% 0.25%
3.70% 0.54% 0.22%
0.90% 2.38%
2.21% 2.66% HK: 2.61%
2.51% HK: 2.49%
Low Sample 0.00% 3.52%
0.00% 3.81%
Low accuracy
0.64% 11.94%
1.84% 0.63% 12.79%
1.89% 3.12% 22.73%
December 2011 3.12% 6.16% 26.32%
7.74%
1.22% 4.22% 0.10%
0.27% 4.57% 0.47% 3.47% 4.16%
4 June 2012 3.84% 4.32%
SG: 25.52%
SG: 24.52%
Page 28 IPv6 Matrix Project - http://www.ipv6matrix.org
30. Previous Country DNS+WEB+E-mail+NTP % change
Order Dec 2011 4 June 2012
1 Singapore 25.52% 24.52% -1.00%
2 Armenia (*) 12.90% 22.42% 9.52%
3 Sri Lanka (*) 11.94% 12.79% 0.85%
4 Indonesia 6.16% 7.74% 1.58%
12 Russia 2.13% 6.96% 4.83%
8 Malaysia 4.22% 4.57% 0.35%
6 New Zealand 4.16% 4.32% 0.16%
5 Australia 3.47% 3.84% 0.37%
7 Philippines (*) 3.52% 3.81% 0.29%
IPv6 Host Penetration 10 Saudi Arabia (*) 2.76% 3.70% 0.94%
9 Oman (*) 3.12% 3.12% 0.00%
11 Taiwan 2.38% 2.66% 0.28%
14 Thailand 2.21% 2.51% 0.30%
Infrastructure 24 Hong Kong 2.61% 2.49% -0.12%
- DNS or 15 Japan 1.83% 2.02% 0.19%
13 Qatar (*) 1.84% 1.89% 0.05%
- Web or 20 India 0.54% 0.90% 0.36%
- E-mail or 17 United Arab Emirates (*) 0.64% 0.63% -0.01%
- NTP 18 Iran 0.50% 0.47% -0.03%
22 Vietnam (*) 0.10% 0.47% 0.37%
16 Pakistan 1.22% 0.27% -0.95%
(*) Low Sample 19 South Korea 0.25% 0.22% -0.03%
Low accuracy 21 China 0.20% 0.22% 0.02%
23 Kuwait (*) 0.00% 0.00% 0.00%
Page 30 IPv6 Matrix Project - http://www.ipv6matrix.org
31. Previous Country WEB % change
Order Dec 2011 4 June 2012
1 Sri Lanka (*) 11.21% 11.85% 0.64%
3 Armenia (*) 3.49% 5.95% 2.46%
2 Philippines (*) 4.69% 4.56% -0.13%
4 Qatar (*) 3.57% 3.45% -0.12%
5 Oman (*) 3.12% 3.12% 0.00%
6 Saudi Arabia (*) 1.77% 3.06% 1.29%
7 Taiwan 1.49% 1.59% 0.10%
13 Malaysia 1.24% 1.55% 0.31%
9 Indonesia 1.14% 1.40% 0.26%
IPv6 Host Penetration 12 Russia 1.17% 1.22% 0.05%
10 Australia 0.91% 0.98% 0.07%
22 Singapore 0.65% 0.90% 0.25%
11 New Zealand 0.97% 0.89% -0.08%
Web only 24 Hong Kong 0.71% 0.77% 0.06%
15 Thailand 0.38% 0.69% 0.31%
14 United Arab Emirates (*) 0.65% 0.64% -0.01%
16 Iran 0.38% 0.40% 0.02%
20 India 0.14% 0.40% 0.26%
(*) Low Sample 18 Japan 0.28% 0.29% 0.01%
Low accuracy 8 Pakistan 1.22% 0.27% -0.95%
19 China 0.15% 0.18% 0.03%
17 South Korea 0.13% 0.08% -0.05%
21 Vietnam (*) 0.11% 0.07% -0.04%
23 Kuwait (*) 0.00% 0.00% 0.00%
Page 31 IPv6 Matrix Project - http://www.ipv6matrix.org
32. Asia Trends
Singapore still leading by far in
infrastructure but trailing in dual-stack Web
Site content
Russia with biggest growth in infrastructure
China results abnormally very low – content
not dual stacked or IPv6 behind firewall?
India also low both in infrastructure and
most popular Web sites with dual stack
Less reliability of results due to smaller
sample size in many countries of the region
Page 32 IPv6 Matrix Project - http://www.ipv6matrix.org
33. Africa Data snapshot
IPv6 Host Penetration 36.61%
43.01%
Infrastructure
- DNS or
- Web or
- E-mail or
- NTP
9.52%
9.38% 7.42%
7.17%
Low Sample
10.20%
Low accuracy 9.43%
December 2011
4 June 2012
0.96%
1.01%
Page 33 IPv6 Matrix Project - http://www.ipv6matrix.org
34. Africa Data snapshot
IPv6 Host Penetration 0.00%
0.00%
Web only
10.00%
0.00% 2.78%
2.56%
Low Sample
14.29%
Low accuracy 14.29%
December 2011
4 June 2012
0.41%
0.46%
Page 34 IPv6 Matrix Project - http://www.ipv6matrix.org
35. Country DNS+WEB+E-mail+NTP % change
Dec 2011 4 June 2012
Tunisia (*) 36.61% 43.01% 6.40%
IPv6 Host Penetration Tanzania (*) 10.20% 9.43% -0.77%
Senegal (*) 9.52% 9.38% -0.14%
Kenya (*) 7.42% 7.17% -0.25%
Infrastructure
South Africa 0.96% 1.01% 0.05%
- DNS or
Algeria 0.00% 0.96% 0.96%
- Web or
- E-mail or
- NTP The small number of hosts tested make the results
for most of Africa appear higher than they really are
(*) Low Sample
Low accuracy
Page 35 IPv6 Matrix Project - http://www.ipv6matrix.org
36. Country WEB % change
Dec 2011 4 June 2012
IPv6 Host Penetration Tanzania (*) 14.29% 14.29% 0.00%
Kenya (*) 2.78% 2.56% -0.22%
Algeria 0.00% 1.28% 1.28%
South Africa 0.41% 0.46% 0.05%
Web only Senegal (*) 10.00% 0.00% -10.00%
Tunisia (*) 0.00% 0.00% 0.00%
(*) Low Sample The small number of hosts tested make the results
Low accuracy for most of Africa appear higher than they really are
Page 36 IPv6 Matrix Project - http://www.ipv6matrix.org
37. Africa Trends
Many countries now have IPv6
capability, some through tunnels
Dual Stack Islands starting to appear
Can be compared with the growth of
Internet connectivity in the nineties
Page 37 IPv6 Matrix Project - http://www.ipv6matrix.org
38. Compare Historical data on
African Internet Connectivity
June 1994 May 1997
Source: Internetology - http://www.nsrc.org/codes/bymap/ntlgy/ntlgy.htm
Page 38 IPv6 Matrix Project - http://www.ipv6matrix.org
39. North/South America
2.42%
3.30%
IPv6 Host Penetration
Infrastructure 5.81% 3.57%
6.17% 3.57%
- DNS or PR: 7.14%
PR: 6.67%
- Web or 0.53% 4.05%
- E-mail or 0.80% 4.35%
- NTP
0.00%
1.09%
Low Sample 0.93% 2.32%
1.14% 5.89%
Low accuracy
3.70%
4.44%
December 2011 0.30%
0.72%
2.63% 5.41%
4 June 2012 3.42% 0.49% 5.36%
0.49%
0.57%
0.56%
Page 39 IPv6 Matrix Project - http://www.ipv6matrix.org
41. Previous Country DNS+WEB+E-mail+NTP % change
Order Dec 2011 4 June 2012
2 Puerto Rico (*) 7.24% 6.67% -0.57%
4 United States 5.81% 6.17% 0.36%
9 Brasil 2.32% 5.89% 3.57%
3 Uruguay (*) 5.41% 5.36% -0.05%
7 Ecuador (*) 3.70% 4.44% 0.74%
5 Venezuela (*) 4.05% 4.35% 0.30%
6 Cuba (*) 3.57% 3.57% 0.00%
IPv6 Host Penetration 15 Peru (*) 2.63% 3.42% 0.79%
8 Canada 2.42% 3.30% 0.88%
10 Panama (*) 0.93% 1.14% 0.21%
Infrastructure 16 Costa Rica 0.00% 1.09% 1.09%
- DNS or 11 Mexico 0.53% 0.80% 0.27%
- Web or 14 Colombia (*) 0.30% 0.72% 0.42%
12 Chile 0.57% 0.56% -0.01%
- E-mail or
13 Argentina 0.49% 0.49% 0.00%
- NTP 1 Guatemala (*) 100.00% 0.00% -100.00%
(*) Low Sample
Low accuracy For (*) the small number of hosts tested make the results
in many countries appear higher than they really are
Page 41 IPv6 Matrix Project - http://www.ipv6matrix.org
42. Previous Country WEB % change
Order Dec 2011 4 June 2012
3 Ecuador (*) 6.38% 8.75% 2.37%
1 Puerto Rico (*) 7.14% 6.67% -0.47%
2 Uruguay (*) 2.68% 2.73% 0.05%
15 Peru (*) 2.44% 2.71% 0.27%
5 Brasil 1.36% 2.66% 1.30%
4 Venezuela (*) 1.85% 1.83% -0.02%
IPv6 Host Penetration 16 Costa Rica 0.00% 1.45% 1.45%
6 Mexico 0.86% 1.03% 0.17%
9 Colombia (*) 0.31% 0.95% 0.64%
Web only 8 Canada 0.54% 0.61% 0.07%
12 Panama (*) 0.29% 0.58% 0.29%
7 Chile 0.56% 0.56% 0.00%
10 Argentina 0.24% 0.35% 0.11%
11 United States 0.19% 0.20% 0.01%
(*) Low Sample
13 Guatemala (*) 0.00% 0.00% 0.00%
Low accuracy
14 Cuba (*) 0.00% 0.00% 0.00%
For (*) the small number of hosts tested make the results
in many countries appear higher than they really are
Page 42 IPv6 Matrix Project - http://www.ipv6matrix.org
43. America Trends
USA leads in infrastructure but low on dual
Stack Web site (although the figure is 1699
hosts).
Brazil leading in Latin America with 204 Dual
Stack Web Site hosts
Elsewhere, data based on low number of
Web sites, needs to be taken in moderation
(the restricted number of hosting providers
can make figures jump several percentage
points)
Page 43 IPv6 Matrix Project - http://www.ipv6matrix.org
44. Worldwide Trends
We are seeing a slow growth in dual stack IPv4-IPv6
implementation
A decrease in percentage in some countries, points to
unstable peering agreements (the IPv6 network is less
closely meshed than the IPv4 network)
Germany leads the world in the number of Dual Stack
Web sites among world’s most popular Web sites: 14636
hosts out of a sample size of 218 178 hosts tested
Bearing in mind the Asia Pacific Regional Internet
Registry has run out of IPv4 addresses, it is alarming to
see so few Web sites up and running IPv6 in that region,
especially in countries where Internet growth is high,
such as in India.
Page 44 IPv6 Matrix Project - http://www.ipv6matrix.org
45. Problems / Possible Errors
Lots of errors in the DNS – commas, no A, no AAAA
record, looping MX, etc.
Firewalls and security software:
Blocking of network segments
detecting denial of service attack (DoS) by error:
• Unusual UDP traffic. Trace-path / ping, SMTP, HTTP,
Secure HTTP, NTP port testing.
Internet snapshot from one location only
Less accurate results with small input data size (small
number of domains tested)
Disputed accuracy of Geographical IP database
Page 45 IPv6 Matrix Project - http://www.ipv6matrix.org
46. Example: fake IPv6 AAAA record
Country specific results? /P2
These “ipv6” addresses are AAAA records
which pretend to denote an IPv6 address,
(examples from the report / finding
but are actually IPv4 addresses.
errors etc.)
There are plenty of examples of such mis-
configuration in the DNS.
Worse problems are caused by commas in domain
names, ie. www.domain,com as well as IP
addresses returning localhost 127.0.0.1 or ::1 etc.
Comma!
Perform a search for ipv6 field starting with ::ffff
Page 46 IPv6 Matrix Project - http://www.ipv6matrix.org
47. Machine readable output
Command directly to SQL database
http://www.ipv6matrix.org:4444/getTable?crawl=2010-07-18_12-24-48&tld=com&table=WWW_com
It is therefore possible to use an entirely new user interface with the back end database
Page 47 IPv6 Matrix Project - http://www.ipv6matrix.org
48. Future work / funding required
Add more domains to be tested
Add more features to be tested
Current front end Web Pages are only an
example of possible analysis
Develop new data visualisation
Perform further analysis
Perform historical/time analysis from archives
Develop an engine to write automated reports
Duplicate Crawler to other regions
Page 48 IPv6 Matrix Project - http://www.ipv6matrix.org
49. Thank you
Contact: ISOC England – [email protected]
CTM
International
Page 49 IPv6 Matrix Project - http://www.ipv6matrix.org