pg_filedump
0 likes1,822 views
The document summarizes how to use the pg_filedump tool to recover data from PostgreSQL database files. It provides an example command to dump data from blocks containing integer, boolean, text and timestamp values. The output shows the recovered data includes two items - a text value and Russian text, with metadata on the block offsets, lengths and timestamps. Additional references are provided for more detailed articles on data recovery in Russian.
1 of 5
Download to read offline
Ad
Recommended
Data recovery using pg_filedump
Data recovery using pg_filedumpAleksander Alekseev The document demonstrates how to recover data from PostgreSQL database files using the pg_filedump tool. It shows extracting table data and metadata like the table schema from the heap and system catalog files. Key points extracted include:
- pg_filedump can display formatted contents of PostgreSQL files including tables, indexes, and system catalogs
- Running pg_filedump on the table file extracted the table data including column types
- Further analysis of system catalog files using pg_filedump provided the table and column names and types to fully recover the table schema
Full Text Search in PostgreSQL
Full Text Search in PostgreSQLAleksander Alekseev This document summarizes full text search capabilities in PostgreSQL. It begins with an introduction and overview of common full text search solutions. It then discusses reasons to use full text search in PostgreSQL, including consistency and no need for additional software. The document covers basics of full text search in PostgreSQL like to_tsvector, to_tsquery, and indexes. It also covers fuzzy full text search using pg_trgm and functions like similarity. Other topics mentioned include ts_headline, ts_rank, and the RUM extension.
Adaptive Query Processing on RAW Data
Adaptive Query Processing on RAW DataManos Karpathiotakis Presentation of RAW, a prototype query engine which enables querying heterogeneous data sources transparently using Just-In-Time access paths. Presentation given at the 40th International Conference on Very Large Databases (VLDB 2014)
Btree. Explore the heart of PostgreSQL. 
Btree. Explore the heart of PostgreSQL. Anastasia Lubennikova The document discusses B-tree indexes in PostgreSQL. It provides an overview of B-tree index internals including page layout, the meta page, Lehman & Yao algorithm adaptations, and new features like covering indexes, partial indexes, and HOT updates. It also outlines development challenges and future work needed like index compression, index-organized tables, and global partitioned indexes. The presenter aims to inspect B-tree index internals, present new features, clarify the development roadmap, and understand difficulties.
Silent Revolution by Max Voronoy (Senior Consultant, Engineering, Globallogic)
Silent Revolution by Max Voronoy (Senior Consultant, Engineering, Globallogic)GlobalLogic Ukraine The document provides examples of reactive programming concepts using Reactor.IO and Spring. It shows how to run simple Flux examples to transform and print string values. It also shows a more complicated example using Spring Data and MongoDB to retrieve Person objects reactively from a repository. The key aspects are running long operations asynchronously and non-blockingly using reactive streams instead of blocking the thread.
Inside database
Inside databaseTakashi Hoshino An introduction to database management systems.
Use internal study meeting named "DATABASE NO KIMOCHI WO SHIRU KAI" inside Cybozu.
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Databasewangzhonnew SequoiaDB is a distributed relational database. This article introduces the basic architecture and design for SequoiaDB.
Fantastic caches and where to find them
Fantastic caches and where to find themAlexey Tokar "Magical caches are terrorizing engineers. When engineers are afraid, they debug. Contain this, or it’ll mean refactoring." (c)
The story of how an internal Hibernate cache can consume 99% of 30GiB of your application memory with just the addition of a single line of code. The way it was discovered and root cause analysis to prevent it in the future will be the topic of the talk.
Hive practice
Hive practiceAnkalaRao Chinthapalli This document contains notes and examples for practicing Hive queries. It discusses loading a tab-delimited text file into a Hive table stored as a sequence file, creating internal and external tables, and performing select queries with where clauses to filter null values. Examples are provided for creating tables, loading data from files on HDFS, and selecting records from tables.
Faceting optimizations for Solr
Faceting optimizations for SolrToke Eskildsen Multiple low-level speed and space optimizations for String faceting with Apache Solr, presented at Lucene/Solr Revolution 2015.
STACK IMPLEMENTATION USING SINGLY LINKED LIST
STACK IMPLEMENTATION USING SINGLY LINKED LISTEr. Ganesh Ram Suwal This document implements a stack using a singly linked list in C. It defines a node structure with an info field and pointer to the next node. Functions are created to push, pop and display elements on the stack. Push adds a new node to the front of the list, pop removes the front node and frees memory. Display traverses the list and prints elements. The main function provides a menu to test the stack operations and uses a switch to call the appropriate function.
[Pgday.Seoul 2017] 3. PostgreSQL WAL Buffers, Clog Buffers Deep Dive - 이근오![[Pgday.Seoul 2017] 3. PostgreSQL WAL Buffers, Clog Buffers Deep Dive - 이근오](https://cdn.slidesharecdn.com/ss_thumbnails/pgday171104-171106041604-thumbnail.jpg?width=560&fit=bounds)
[Pgday.Seoul 2017] 3. PostgreSQL WAL Buffers, Clog Buffers Deep Dive - 이근오PgDay.Seoul This document provides technical details about PostgreSQL WAL (Write Ahead Log) buffers. It describes the structure and purpose of WAL segments, WAL records, and their components. It also explains how the WAL is used to safely recover transactions after a server crash by replaying the log.
Faster Python, FOSDEM
Faster Python, FOSDEMVictor Stinner This document summarizes two projects that aim to optimize Python performance: the AST optimizer and register-based bytecode. The AST optimizer rewrites Python abstract syntax trees to enable more optimizations than CPython's peephole optimizer. It aims to improve performance by constant folding, loop optimizations, and other transformations. The register-based bytecode project rewrites CPython's stack-based bytecode to use registers, enabling additional optimizations like common subexpression elimination and constant/attribute deduplication. Both projects showed speedups over CPython in benchmarks, but may not translate to all real applications. The document provides details on each project's approach and goals.
Internship - Final Presentation (26-08-2015)
Internship - Final Presentation (26-08-2015)Sean Krail The document describes a C++ task graph generator that takes C++ code with OpenMP directives as input, parses it using Clang's AST into a data structure representing the task graph, and then outputs the task graph in various formats. The key parts of the task graph are call tasks for function calls and parallel regions, statement group tasks for non-parallel statements, and parallel tasks for parallel statements. The task graph data structure is then converted to TGFF, DOT and DARTS formats, with DARTS code generated to execute the task graph and validate correct dependencies and ordering.
Faster Workflows, Faster
Faster Workflows, FasterKen Krugler Slides from my talk on using Flink to run complex big data workflows defined via Cascading's Java API.
Better Full Text Search in PostgreSQL
Better Full Text Search in PostgreSQLArtur Zakirov Full text search in PostgreSQL is a flexible and powerful facility to search collection of documents using natural language queries. We will discuss several new improvements of FTS in PostgreSQL 9.6 release, such as phrase search, better dictionaries support and tsvector editing functions. Also, we will present new features currently in development - RUM index support, which enables acceleration of some important kinds of full text queries, new and better ranking function for relevance search, loading dictionaries into shared memory and support for search multilingual content.
Как приготовить тестовые данные для Big Data проекта. Пример из практики
Как приготовить тестовые данные для Big Data проекта. Пример из практикиSQALab The document describes an approach to sampling large datasets for testing Big Data projects. It discusses clustering similar records into groups to reduce the size of the sample. The records are divided into quartiles based on field values and each unique combination of quartiles forms a cluster. A representative sample is taken by selecting one record from each cluster. A tool is presented that automates this process using T-SQL on SQL Server to partition, cluster and filter the data into a reduced representative sample for testing.
Improving go-git performance
Improving go-git performancesource{d} go-git is a 100% Go libray used to interact with git repositories. Even if it already supports most of the functionality it still lags a bit in performance when compared with the git CLI or some other libraries. I'll explain some of the problems that we face when dealing with git repos and some examples of performance improvements done to the library.
Java program-to-calculate-area-and-circumference-of-circle
Java program-to-calculate-area-and-circumference-of-circleUniversity of Essex This Java program uses user input to calculate the area and circumference of a circle based on its radius. The user is prompted to enter the radius, which is then used in the area and circumference formulas. The area is calculated as πr^2 and circumference as 2πr. The results are printed along with any exceptions.
Odoo Technical Concepts Summary
Odoo Technical Concepts SummaryMohamed Magdy Odoo Technical Concepts Summary that helps new developers to summarize the needed concepts like fields types and their attributes and some other notes.
Overloading Perl OPs using XS
Overloading Perl OPs using XSℕicolas ℝ. This talk will show how it's possible to mock PerlOps using XS and provide a convenient Pure Perl hook for each of the file check -X.
Overload::FileCheck provides a way to mock one or more file checks. It is also possible to mock stat/lstat functions using "mock_all_from_stat" and let Overload::FileCheck mock for you for any other -X checks.
Queue oop
Queue oopGouda Mando The document discusses queues and their implementation. It defines a queue as a FIFO data structure where new items are added to the rear and removed from the front. Key queue operations are described like add, remove, isEmpty and isFull. The document then provides examples of implementing a queue using arrays and pointers in C++. It includes functions for initialization, insertion, removal, checking if empty, and printing all elements.
Using Grafana with InfluxDB 2.0 and Flux Lang by Jacob Lisi
Using Grafana with InfluxDB 2.0 and Flux Lang by Jacob LisiInfluxData Flux, the new InfluxData data scripting and query language (formerly IFQL), super-charges queries both for analytics and data science. Jacob Lisi from Grafana Labs will give a quick overview of the language features as well as the moving parts for a working deployment. Grafana is an open source dashboard solution that shares Flux’s passion for analytics and data science. For that reason, they are very excited to showcase the new Flux support within Grafana, and a couple of common analytics use cases to get the most out of your data.
In this InfluxDays NYC 2019 talk, Jacob Lisi will share the latest updates they have made with their Flux builder in Grafana.
Data Structures and Performance for Scientific Computing with Hadoop and Dumb...
Data Structures and Performance for Scientific Computing with Hadoop and Dumb...Austin Benson This document discusses matrix storage and data serialization techniques for scientific computing with Hadoop and Dumbo. It provides examples of storing matrices in HDFS using different approaches like storing each row separately, storing two rows per record, or flattening the matrix into a single list. It also discusses optimizing data serialization and switching programming languages. The document then presents an example of outputting many small matrices to disk and compares two MapReduce implementations for computing the Cholesky QR decomposition, identifying which approach is usually better and why.
Interface record comparator
Interface record comparatormyrajendra The RecordComparator interface is used to compare two records to determine their sorting order. It defines a compare method that returns an integer indicating if the first record precedes, follows, or is equivalent to the second record. The compare method is called by RecordEnumeration to sort records in an application-specified order when retrieving records from a record store.
odoo 11.0 development (CRUD)
odoo 11.0 development (CRUD)Mohamed Magdy The document discusses CRUD (Create, Read, Update, Delete) operations in Odoo. It explains that CRUD is implemented by default through Odoo's ORM framework. It describes the main methods for each CRUD operation: create() for creating records, search(), read(), search_read(), browse() for reading records, write() for updating records, and unlink() for deleting records. For each method it provides a short description and code example of its usage.
21st Athens Big Data Meetup - 2nd Talk - Dive into ClickHouse storage system
21st Athens Big Data Meetup - 2nd Talk - Dive into ClickHouse storage systemAthens Big Data Title: Dive into ClickHouse storage system
Speaker: Alexander Sapin (https://github.com/alesapin/)
Date: Thursday, March 5, 2020
Event: https://meetup.com/Athens-Big-Data/events/268379195/
PgconfSV compression
PgconfSV compressionAnastasia Lubennikova Right now postgres can't compress its data in many situations and that leads sometimes to increased storage overhead by the order of magnitude comparing with commercial DBMS. Common viewpoint that this task can be accomplished by file system level compression but most popular and well tested Linux file system can't do that. I will talk about our patches that implements page compression on disk or on disk + in memory; in what situation it is better to use what kind of compression; and also discuss experience of using compression in production.
Address/Thread/Memory Sanitizer
Address/Thread/Memory SanitizerPlatonov Sergey The document discusses three sanitizers - AddressSanitizer, ThreadSanitizer, and MemorySanitizer - that detect bugs in C/C++ programs. AddressSanitizer detects memory errors like buffer overflows and use-after-frees. ThreadSanitizer finds data races between threads. MemorySanitizer identifies uses of uninitialized memory. The sanitizers work by instrumenting code at compile-time and providing a run-time library for error detection and reporting. They have found thousands of bugs in major software projects with reasonable overhead. Future work includes supporting more platforms and detecting additional classes of bugs.
The forgotten art of assembly
The forgotten art of assemblyMarian Marinov The document discusses the Assembly programming language. It covers Assembly registers and instructions, the ELF file format, using objdump and readelf to disassemble and inspect Assembly programs, and examples of building Assembly programs and using inline Assembly in C code. Key topics include common Assembly registers like EAX, EBP, ESP; basic instructions like mov, add, jumps; the ELF header and section structure; and using tools like objdump to disassemble Assembly code.
Ad
More Related Content
What's hot (20)
Hive practice
Hive practiceAnkalaRao Chinthapalli This document contains notes and examples for practicing Hive queries. It discusses loading a tab-delimited text file into a Hive table stored as a sequence file, creating internal and external tables, and performing select queries with where clauses to filter null values. Examples are provided for creating tables, loading data from files on HDFS, and selecting records from tables.
Faceting optimizations for Solr
Faceting optimizations for SolrToke Eskildsen Multiple low-level speed and space optimizations for String faceting with Apache Solr, presented at Lucene/Solr Revolution 2015.
STACK IMPLEMENTATION USING SINGLY LINKED LIST
STACK IMPLEMENTATION USING SINGLY LINKED LISTEr. Ganesh Ram Suwal This document implements a stack using a singly linked list in C. It defines a node structure with an info field and pointer to the next node. Functions are created to push, pop and display elements on the stack. Push adds a new node to the front of the list, pop removes the front node and frees memory. Display traverses the list and prints elements. The main function provides a menu to test the stack operations and uses a switch to call the appropriate function.
[Pgday.Seoul 2017] 3. PostgreSQL WAL Buffers, Clog Buffers Deep Dive - 이근오
[Pgday.Seoul 2017] 3. PostgreSQL WAL Buffers, Clog Buffers Deep Dive - 이근오PgDay.Seoul This document provides technical details about PostgreSQL WAL (Write Ahead Log) buffers. It describes the structure and purpose of WAL segments, WAL records, and their components. It also explains how the WAL is used to safely recover transactions after a server crash by replaying the log.
Faster Python, FOSDEM
Faster Python, FOSDEMVictor Stinner This document summarizes two projects that aim to optimize Python performance: the AST optimizer and register-based bytecode. The AST optimizer rewrites Python abstract syntax trees to enable more optimizations than CPython's peephole optimizer. It aims to improve performance by constant folding, loop optimizations, and other transformations. The register-based bytecode project rewrites CPython's stack-based bytecode to use registers, enabling additional optimizations like common subexpression elimination and constant/attribute deduplication. Both projects showed speedups over CPython in benchmarks, but may not translate to all real applications. The document provides details on each project's approach and goals.
Internship - Final Presentation (26-08-2015)
Internship - Final Presentation (26-08-2015)Sean Krail The document describes a C++ task graph generator that takes C++ code with OpenMP directives as input, parses it using Clang's AST into a data structure representing the task graph, and then outputs the task graph in various formats. The key parts of the task graph are call tasks for function calls and parallel regions, statement group tasks for non-parallel statements, and parallel tasks for parallel statements. The task graph data structure is then converted to TGFF, DOT and DARTS formats, with DARTS code generated to execute the task graph and validate correct dependencies and ordering.
Faster Workflows, Faster
Faster Workflows, FasterKen Krugler Slides from my talk on using Flink to run complex big data workflows defined via Cascading's Java API.
Better Full Text Search in PostgreSQL
Better Full Text Search in PostgreSQLArtur Zakirov Full text search in PostgreSQL is a flexible and powerful facility to search collection of documents using natural language queries. We will discuss several new improvements of FTS in PostgreSQL 9.6 release, such as phrase search, better dictionaries support and tsvector editing functions. Also, we will present new features currently in development - RUM index support, which enables acceleration of some important kinds of full text queries, new and better ranking function for relevance search, loading dictionaries into shared memory and support for search multilingual content.
Как приготовить тестовые данные для Big Data проекта. Пример из практики
Как приготовить тестовые данные для Big Data проекта. Пример из практикиSQALab The document describes an approach to sampling large datasets for testing Big Data projects. It discusses clustering similar records into groups to reduce the size of the sample. The records are divided into quartiles based on field values and each unique combination of quartiles forms a cluster. A representative sample is taken by selecting one record from each cluster. A tool is presented that automates this process using T-SQL on SQL Server to partition, cluster and filter the data into a reduced representative sample for testing.
Improving go-git performance
Improving go-git performancesource{d} go-git is a 100% Go libray used to interact with git repositories. Even if it already supports most of the functionality it still lags a bit in performance when compared with the git CLI or some other libraries. I'll explain some of the problems that we face when dealing with git repos and some examples of performance improvements done to the library.
Java program-to-calculate-area-and-circumference-of-circle
Java program-to-calculate-area-and-circumference-of-circleUniversity of Essex This Java program uses user input to calculate the area and circumference of a circle based on its radius. The user is prompted to enter the radius, which is then used in the area and circumference formulas. The area is calculated as πr^2 and circumference as 2πr. The results are printed along with any exceptions.
Odoo Technical Concepts Summary
Odoo Technical Concepts SummaryMohamed Magdy Odoo Technical Concepts Summary that helps new developers to summarize the needed concepts like fields types and their attributes and some other notes.
Overloading Perl OPs using XS
Overloading Perl OPs using XSℕicolas ℝ. This talk will show how it's possible to mock PerlOps using XS and provide a convenient Pure Perl hook for each of the file check -X.
Overload::FileCheck provides a way to mock one or more file checks. It is also possible to mock stat/lstat functions using "mock_all_from_stat" and let Overload::FileCheck mock for you for any other -X checks.
Queue oop
Queue oopGouda Mando The document discusses queues and their implementation. It defines a queue as a FIFO data structure where new items are added to the rear and removed from the front. Key queue operations are described like add, remove, isEmpty and isFull. The document then provides examples of implementing a queue using arrays and pointers in C++. It includes functions for initialization, insertion, removal, checking if empty, and printing all elements.
Using Grafana with InfluxDB 2.0 and Flux Lang by Jacob Lisi
Using Grafana with InfluxDB 2.0 and Flux Lang by Jacob LisiInfluxData Flux, the new InfluxData data scripting and query language (formerly IFQL), super-charges queries both for analytics and data science. Jacob Lisi from Grafana Labs will give a quick overview of the language features as well as the moving parts for a working deployment. Grafana is an open source dashboard solution that shares Flux’s passion for analytics and data science. For that reason, they are very excited to showcase the new Flux support within Grafana, and a couple of common analytics use cases to get the most out of your data.
In this InfluxDays NYC 2019 talk, Jacob Lisi will share the latest updates they have made with their Flux builder in Grafana.
Data Structures and Performance for Scientific Computing with Hadoop and Dumb...
Data Structures and Performance for Scientific Computing with Hadoop and Dumb...Austin Benson This document discusses matrix storage and data serialization techniques for scientific computing with Hadoop and Dumbo. It provides examples of storing matrices in HDFS using different approaches like storing each row separately, storing two rows per record, or flattening the matrix into a single list. It also discusses optimizing data serialization and switching programming languages. The document then presents an example of outputting many small matrices to disk and compares two MapReduce implementations for computing the Cholesky QR decomposition, identifying which approach is usually better and why.
Interface record comparator
Interface record comparatormyrajendra The RecordComparator interface is used to compare two records to determine their sorting order. It defines a compare method that returns an integer indicating if the first record precedes, follows, or is equivalent to the second record. The compare method is called by RecordEnumeration to sort records in an application-specified order when retrieving records from a record store.
odoo 11.0 development (CRUD)
odoo 11.0 development (CRUD)Mohamed Magdy The document discusses CRUD (Create, Read, Update, Delete) operations in Odoo. It explains that CRUD is implemented by default through Odoo's ORM framework. It describes the main methods for each CRUD operation: create() for creating records, search(), read(), search_read(), browse() for reading records, write() for updating records, and unlink() for deleting records. For each method it provides a short description and code example of its usage.
21st Athens Big Data Meetup - 2nd Talk - Dive into ClickHouse storage system
21st Athens Big Data Meetup - 2nd Talk - Dive into ClickHouse storage systemAthens Big Data Title: Dive into ClickHouse storage system
Speaker: Alexander Sapin (https://github.com/alesapin/)
Date: Thursday, March 5, 2020
Event: https://meetup.com/Athens-Big-Data/events/268379195/
PgconfSV compression
PgconfSV compressionAnastasia Lubennikova Right now postgres can't compress its data in many situations and that leads sometimes to increased storage overhead by the order of magnitude comparing with commercial DBMS. Common viewpoint that this task can be accomplished by file system level compression but most popular and well tested Linux file system can't do that. I will talk about our patches that implements page compression on disk or on disk + in memory; in what situation it is better to use what kind of compression; and also discuss experience of using compression in production.
Similar to pg_filedump (20)
Address/Thread/Memory Sanitizer
Address/Thread/Memory SanitizerPlatonov Sergey The document discusses three sanitizers - AddressSanitizer, ThreadSanitizer, and MemorySanitizer - that detect bugs in C/C++ programs. AddressSanitizer detects memory errors like buffer overflows and use-after-frees. ThreadSanitizer finds data races between threads. MemorySanitizer identifies uses of uninitialized memory. The sanitizers work by instrumenting code at compile-time and providing a run-time library for error detection and reporting. They have found thousands of bugs in major software projects with reasonable overhead. Future work includes supporting more platforms and detecting additional classes of bugs.
The forgotten art of assembly
The forgotten art of assemblyMarian Marinov The document discusses the Assembly programming language. It covers Assembly registers and instructions, the ELF file format, using objdump and readelf to disassemble and inspect Assembly programs, and examples of building Assembly programs and using inline Assembly in C code. Key topics include common Assembly registers like EAX, EBP, ESP; basic instructions like mov, add, jumps; the ELF header and section structure; and using tools like objdump to disassemble Assembly code.
Examining Oracle GoldenGate Trail Files
Examining Oracle GoldenGate Trail FilesBobby Curtis The document is a presentation about examining Oracle GoldenGate trail files and using the LogDump utility. It provides information on what trail files are, how to create and manage them, and how to navigate and examine the contents of trail files using the LogDump utility commands. It includes an example of using LogDump commands to open a trail file, view the record header and details, and examine the contents of a record.
Overview of file type identifiers (HackLu)
Overview of file type identifiers (HackLu)Ange Albertini Yara, LibMagic (file, binwalk, polyfile), TrID, Yara, Magika, PeID, Pronom, FDD, ShareMime, DiE...
How do they work? What are their pros and cons, their limitations, their risks?
Presented at Hack.Lu on the 24th October 2024.
Video recording: https://youtu.be/PBbld8xB2Bo
Fundamentals of Complete Crash and Hang Memory Dump Analysis
Fundamentals of Complete Crash and Hang Memory Dump AnalysisDmitry Vostokov Webinar: Fundamentals of Complete Crash and Hang Memory Dump Analysis (18th and 23rd of August, 2010)
Cram
CramJamesBonfield The document discusses CRAM, a compressed binary format for storing sequence alignment data. It provides an overview of common bioinformatics file formats like FASTQ and SAM/BAM, and describes how CRAM internally organizes and compresses different data series like sequences, names, qualities, and auxiliary fields using techniques like block codecs, bit-based codecs, and reference-based encoding. Results are presented comparing the compression ratio and speed of CRAM to other tools on real datasets with and without auxiliary data. Future directions discussed include supporting different sequencing technologies, custom codecs, and lossy compression of quality values.
PE102 - a Windows executable format overview (booklet V1)
PE102 - a Windows executable format overview (booklet V1)Ange Albertini This document provides a detailed overview of the structure and components of a Portable Executable (PE) file format, commonly used for executables and libraries in Windows. It describes the key elements such as the DOS header, PE header, optional header, section table, data directories, and other structures that provide metadata about resources, imports, exports, relocations, and other details. The summary includes key elements like the headers, sections, and data directories that provide the overall layout and organization of a PE file.
Pf: the OpenBSD packet filter
Pf: the OpenBSD packet filterGiovanni Bechis pf(4) is the OpenBSD packet filter that provides stateful packet filtering and network address translation (NAT). It is used in OpenBSD, FreeBSD, NetBSD, DragonflyBSD, and other systems. Some key features of pf include its flexible rule syntax, atomic ruleset updates, integrated traffic shaping, and ability to divert packets to userspace processes like spamd for inspection. It provides logging in tcpdump format and can integrate with CARP and other services. The pf code was developed for OpenBSD after the previous IPFilter code was removed due to licensing issues.
Heap Base Exploitation
Heap Base ExploitationUTD Computer Security Group We introduce the fundamentals of dynamic memory allocation and highlight several exploitable properties. These ideas are put into practice in a set of heap overflow challenges from exploit-exercise.com's Protostar VM. We walk through the first three. Other uses of heap space such as heap spraying are mentioned.
Проблемы использования TCP в мобильных приложениях. Владимир Кириллов
Проблемы использования TCP в мобильных приложениях. Владимир КирилловAnthony Marchenko This document discusses capturing network traffic on iOS and Android devices using various tools like tcpdump, tcpdump, and tcptrace. It provides examples of using tcpdump to capture traffic from an iPhone to a remote host and analyzing the captured traffic file using tcptrace. It also shows how to capture traffic from an Android device by connecting via ADB and using tcpdump directly on the device.
Quic illustrated
Quic illustratedAlexander Krizhanovsky QUIC is a new transport protocol developed by Google to replace TCP+TLS. It aims to reduce latency by eliminating OSI layers and supporting features like 0-RTT handshakes. The document provides a high-level overview of QUIC including its architecture, use of TLS 1.3, streams for multiplexing data, and support for features like connection migration through the use of connection IDs. It also discusses QUIC's current implementation status and adoption. Examples are given of QUIC packets and the handshake process.
Understanding DPDK
Understanding DPDKDenys Haryachyy 1. DPDK achieves high throughput packet processing on commodity hardware by reducing kernel overhead through techniques like polling, huge pages, and userspace drivers.
2. In Linux, packet processing involves expensive operations like system calls, interrupts, and data copying between kernel and userspace. DPDK avoids these by doing all packet processing in userspace.
3. DPDK uses techniques like isolating cores for packet I/O threads, lockless ring buffers, and NUMA awareness to further optimize performance. It can achieve throughput of over 14 million packets per second on 10GbE interfaces.
Embedded Recipes 2019 - Introduction to JTAG debugging
Embedded Recipes 2019 - Introduction to JTAG debuggingAnne Nicolas This talk introduces JTAG debugging capabilities, both for debugging hardware and software. Marek first explains what the JTAG stands for and explains the operation of the JTAG state machine. This is followed by an introduction to free software JTAG tools, OpenOCD and urJTAG. Marek shortly explains how to debug software using those tools and how that ties into the JTAG state machine. However, JTAG was designed for testing hardware. Marek explains what boundary scan testing (BST) is, what are BSDL files and their format, and practically demonstrates how to blink an LED using BST and only free software tools.
Marek Vasut
Oracle Deep Internal 2 (ver.2)
Oracle Deep Internal 2 (ver.2)EXEM The document describes the Oracle undo segment and how it tracks changes to data in transactions.
1) It shows the initial state when a value of "A" is entered into a table column.
2) It then shows an update transaction that changes the value from "A" to "B", with the undo segment recording the before image of "A".
3) A second update transaction is shown, changing the value from "B" to "C", with the undo segment recording the before images of "B" and "A".
Yandex may 2013 a san-tsan_msan
Yandex may 2013 a san-tsan_msanYandex AddressSanitizer and ThreadSanitizer are tools for finding bugs and vulnerabilities in the Chrome browser and server applications. AddressSanitizer detects buffer overflows and use-after-free errors. ThreadSanitizer detects data races in C++ and Go code. MemorySanitizer detects uninitialized memory reads. The tools use compiler instrumentation and run-time libraries to monitor memory accesses and detect errors. Over 1000 bugs have been found using these tools in Chrome and Google server applications.
Yandex may 2013 a san-tsan_msan
Yandex may 2013 a san-tsan_msanYandex AddressSanitizer and ThreadSanitizer are tools for finding bugs and vulnerabilities in the Chrome browser and server applications. AddressSanitizer detects buffer overflows and use-after-free errors. ThreadSanitizer detects data races in C++ and Go code. MemorySanitizer detects uninitialized memory reads. The tools use compiler instrumentation and run-time libraries to detect these types of bugs. Over 1000 bugs have been found using these tools in Chrome and Google server applications.
Yandex may 2013 a san-tsan_msan
Yandex may 2013 a san-tsan_msanYandex AddressSanitizer and ThreadSanitizer are tools for finding bugs and vulnerabilities in the Chrome browser and server applications. AddressSanitizer detects buffer overflows and use-after-free errors. ThreadSanitizer detects data races in C++ and Go code. MemorySanitizer detects uninitialized memory reads. The tools use compiler instrumentation and run-time libraries to detect these types of bugs. Over 1000 bugs have been found using these tools in Chrome and Google server applications.
Windbg랑 친해지기
Windbg랑 친해지기Ji Hun Kim The document discusses analyzing crashes using WinDbg. It provides tips on reconstructing crashed call stacks and investigating what thread or lock is causing a hang. The debugging commands discussed include !analyze, !locks, .cxr, kb to find the crashing function and stuck thread.
Ak12 upgrade
Ak12 upgradeAccenture The log captures SNMP permission errors when a user attempts to access the system before being added. The user "netapp" is then added, resolving the issue. Network interfaces and storage disks are listed.
Ad
More from Aleksander Alekseev (11)
Growing up new PostgreSQL developers (pgcon.org 2018)
Growing up new PostgreSQL developers (pgcon.org 2018)Aleksander Alekseev The document discusses growth and development. In a concise yet informative manner, it touches on the natural process of expanding and increasing in size over time through nourishment and care. While brief, it implies the importance of fostering growth through proper support and conditions.
PostgreSQL and Compressed Documents (pgconf.ru 2018)
PostgreSQL and Compressed Documents (pgconf.ru 2018)Aleksander Alekseev This document discusses data compression techniques for PostgreSQL, including ZSON for compressing JSONB data and pg_protobuf for indexing Protobuf data. It provides overviews of how these extensions work, such as replacing common strings with codes for ZSON and avoiding shared dictionaries for pg_protobuf. The document also shares ideas for future projects, such as adding modification support to pg_protobuf or generating PL/pgSQL procedures for Protobuf fields. Finally, it invites the audience to learn more about these open source projects and announces job opportunities at Postgres Professional.
PostgreSQL Sharding and HA: Theory and Practice (PGConf.ASIA 2017)
PostgreSQL Sharding and HA: Theory and Practice (PGConf.ASIA 2017)Aleksander Alekseev This document summarizes Aleksander Alekseev's talk on PostgreSQL sharding and high availability. The talk introduces replication in PostgreSQL, including physical and logical replication. It discusses solutions for high availability like Stolon and PostgreSQL Multimaster, as well as existing solutions for sharding like manual sharding, Citus, Greenplum, and pg_shardman. It also briefly covers other databases like Amazon Aurora and CockroachDB that are inspired by PostgreSQL but with additional distributed functionality.
Quality Assurance in PostgreSQL
Quality Assurance in PostgreSQLAleksander Alekseev This document discusses quality assurance processes for PostgreSQL, an open source object-relational database. It covers development practices like code reviews on mailing lists and testing patches through "commitfests". Comprehensive testing is emphasized, including modular unit tests, integration tests, performance benchmarks, and documentation reviews. A variety of tools are also presented to aid testing, debugging, and performance profiling of PostgreSQL code.
In-core compression: how to shrink your database size in several times
In-core compression: how to shrink your database size in several timesAleksander Alekseev The document discusses techniques for compressing database size in Postgres, including:
1. Using in-core block-level compression as a feature of Postgres Pro EE to shrink database size by several times.
2. The ZSON extension provides transparent JSONB compression by replacing common strings with 16-bit codes and compressing the data.
3. Various schema optimizations like proper data types, column ordering, and packing data can reduce size by improving storage layout and enabling TOAST compression.
Профилирование кода на C/C++ в *nix системах
Профилирование кода на C/C++ в *nix системахAleksander Alekseev Профилирование кода на C/C++ в *nix системах
Новые технологии репликации данных в PostgreSQL - Александр Алексеев
Новые технологии репликации данных в PostgreSQL - Александр АлексеевAleksander Alekseev Новые технологии репликации данных в PostgreSQL
Функциональное программирование - Александр Алексеев
Функциональное программирование - Александр АлексеевAleksander Alekseev Функциональное программирование
Ad
Recently uploaded (20)
Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025Splunk Splunk Security Update
Sprecher: Marcel Tanuatmadja
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganArthur Morgan This is a Quick Research Guide (QRG).
QRGs include the following:
- A brief, high-level overview of the QRG topic.
- A milestone timeline for the QRG topic.
- Links to various free online resource materials to provide a deeper dive into the QRG topic.
- Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic.
QRGs planned for the series:
- Artificial Intelligence QRG
- Quantum Computing QRG
- Big Data Analytics QRG
- Spacecraft Guidance, Navigation & Control QRG (coming 2026)
- UK Home Computing & The Birth of ARM QRG (coming 2027)
Any questions or comments?
- Please contact Arthur Morgan at [email protected].
100% human made.
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AIartmondano By 2026, AI agents will consume 10x more enterprise data than humans, but with none of the contextual understanding that prevents catastrophic misinterpretations.
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.
2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo Cloudflare Q4 Financial Results Presentation
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell With expertise in data architecture, performance tracking, and revenue forecasting, Andrew Marnell plays a vital role in aligning business strategies with data insights. Andrew Marnell’s ability to lead cross-functional teams ensures businesses achieve sustainable growth and operational excellence.
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In France
Manifest Pre-Seed Update | A Humanoid OEM Deeptech In Francechb3 The latest updates on Manifest's pre-seed stage progress.
tecnologias de las primeras civilizaciones.pdf
tecnologias de las primeras civilizaciones.pdffjgm517 descaripcion detallada del avance de las tecnologias en mesopotamia, egipto, roma y grecia.
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptx
DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock Building 10x Organizations with Modern Productivity Metrics
10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’
Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them.
But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?
Build Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For DevsBrian McKeiver May 2nd, 2025 talk at StirTrek 2025 Conference.
Procurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptxJon Hansen Procurement Insights integrated Historic Procurement Industry Archives, serves as a powerful complement — not a competitor — to other procurement industry firms. It fills critical gaps in depth, agility, and contextual insight that most traditional analyst and association models overlook.
Learn more about this value- driven proprietary service offering here.
Drupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove How to measure web front-end energy consumption using Firefox Profiler. Presented in DrupalCamp Finland on April 25th, 2025.
Linux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru Introduction to LPIC-1 Exam - overview, exam details, price and job opportunities
AI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global TrendsInData Labs In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy.
This infographic contains:
-AI and data privacy: Key findings
-Statistics on AI data privacy in the today’s world
-Tips on how to overcome data privacy challenges
-Benefits of AI data security investments.
Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next.
Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/
Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsInData Labs At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including:
-Artificial Intelligence Market Overview
-Strategies for AI Adoption in 2025
-Anticipated drivers of AI adoption and transformative technologies
-Benefits of AI and Big data for your business
-Tips on how to prepare your business for innovation
-AI and data privacy: Strategies for securing data privacy in AI models, etc.
Download your free copy nowand implement the key findings to improve your business.
TrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business ConsultingTrs Labs Hybrid Growth Mandate Model with TrsLabs
Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant.
An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices.
Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company
Talk to us & Unlock the competitive advantage
Heap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and DeletionJaydeep Kale This pdf will explain what is heap, its type, insertion and deletion in heap and Heap sort
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Artificial intelligence is changing how businesses operate. Companies are using AI agents to automate tasks, reduce time spent on repetitive work, and focus more on high-value activities. Noah Loul, an AI strategist and entrepreneur, has helped dozens of companies streamline their operations using smart automation. He believes AI agents aren't just tools—they're workers that take on repeatable tasks so your human team can focus on what matters. If you want to reduce time waste and increase output, AI agents are the next move.
pg_filedump
- 1. pg_filedump
- 2. Data recovery example ./pg_filedump -D int,bool,text,timestamp /path/to/db/base/16384/16393
- 3. Recovered data <Header> ----- Block Offset: 0x00000000 Offsets: Lower 32 (0x0020) Block: Size 8192 Version 4 Upper 8080 (0x1f90) LSN: logid 0 recoff 0x0301e4c0 Special 8192 (0x2000) Items: 2 Free Space: 8048 Checksum: 0x0000 Prune XID: 0x00000000 Flags: 0x0000 () Length (including item array): 32 <Data> ------ Item 1 -- Length: 56 Offset: 8136 (0x1fc8) Flags: NORMAL COPY: 123 t Text test test 2017-01-17 16:25:03.448488 Item 2 -- Length: 52 Offset: 8080 (0x1f90) Flags: NORMAL COPY: 456 N Ололо трооло N
- 4. More detailed articles ● https://habr.ru/p/319770/ ● https://habr.ru/p/323644/ ● Use Google Translate ;)
- 5. Thank you for your attention! Aleksander Alekseev https://afiskon.github.io/ [email protected]