SlideShare a Scribd company logo
Binary art
         Byte-ing the PE that fails you




   Ange Albertini      3rd November 2012
http://corkami.com    Lucerne, Switzerland
extended edition
●   the presentation deck had 60+ slides
●   this one has 140+
    ●   many extra explanation slides
    ●   many extra examples
agenda
what's a PE?
  the problem, and my approach
overview of the PE format
classic tricks
new tricks




                                 © ID software
Portable Executable
based on

Common Object File Format
Windows executables and more
●   since 1993, used in almost every executables
    ●   32bits, 64bits, .Net
    ●   DLL, drivers, ActiveX...
●   also used as data container
    ●   icons, strings, dialogs, bitmaps...


                 omnipresent in Windows
           also EFI boot, CE phones, Xbox,...
                 (but not covered here)
Binary art - Byte-ing the PE that fails you (extended offline version)
Binary art - Byte-ing the PE that fails you (extended offline version)
Binary art - Byte-ing the PE that fails you (extended offline version)
PEuniversal
Windows binary
            since 1993
pe101.corkami.com
the problem...
sins & punishments
●   official documentation limited and unclear
    ●   just describes standard PEs
    ●   not good enough for security


●   crashes (OS, security tools)
●
    obstacle for 3rd party developments
●   hinders automation, classification
    ●   PE or not?
    ●   corrupted, or malware?
●   fails best tools → prevents even manual analysis
aka “the gentle guide to standard PEs”
CVE-2012-2273

version_mini



               ibkernel
normal
Binary art - Byte-ing the PE that fails you (extended offline version)
Binary art - Byte-ing the PE that fails you (extended offline version)
Binary art - Byte-ing the PE that fails you (extended offline version)
...and my approach
from bottom up
●   analyzing what's in the wild
    ●   waiting for malware/corruption to experiment?
●   generate complete binaries from scratch
●   manually
    ●   no framework/compiler limitation
    ●   concise PoCs
→ better coverage


I share knowledge and PoCs, with sources
Binary art - Byte-ing the PE that fails you (extended offline version)
block by block
a complete executable
pe.corkami.com
Binary art - Byte-ing the PE that fails you (extended offline version)
File
       PE


       (Appended data)
defined by the PE header




data
                           PE

Appended
                           PE
PE
     Header
     Sections
       code, data, <you name it>
Header
    MZ


      DOS header           since IBM PC-DOS 1.0 (1981)
    PE (or NE/LE/LX/...)


    'modern' headers       since Windows NT 3.1 (1993)
Header
    DOS header
    (DOS stub) 16 bits


    (Rich header)        compilation info



   'PE headers'
DOS Stub



   ● obsolete 16b code
     ● prints msg & exits

   ● still present on all standard PEs

     ● even 64b binaries




                                 PoC: compiled
'Rich' header
● compiler information
● officially undocumented

  ● pitiful xor32 encryption

● completely documented by Daniel Pistelli

    http://ntcore.com/files/richsign.htm




                                             PoC: compiled
Binary art - Byte-ing the PE that fails you (extended offline version)
Dos header
●   obsolete stuff
    ●   only used if started in DOS mode
    ●   ignored otherwise
●   tells where the PE header is
Binary art - Byte-ing the PE that fails you (extended offline version)
'PE Headers'
                          'NT Headers'

   PE00


   File header        declares the rest



   Optional header       absent in .obj




   Section table
               mapping layout
File header
●   how many sections?
●   is there an Optional Header?
●   32b or 64b, DLL or EXE...
Binary art - Byte-ing the PE that fails you (extended offline version)
NumberOfSections values
●   0: Corkami :p
●   1: packer
●   3-6: standard
    ●   code, data, (un)initialized data, imports, resources...


●   16: free basic FTW :D
    ●   what for ?
Binary art - Byte-ing the PE that fails you (extended offline version)
Optional header
●   geometry properties
    ●   alignments, base, size
●   tells where code starts
●   32/64b, driver/standard/console
●   many non critical information
●   data directory
Binary art - Byte-ing the PE that fails you (extended offline version)
Sections
●   defines the mapping:
    ●   which part of the file goes where
    ●   what for? (writeable, executable...)
Binary art - Byte-ing the PE that fails you (extended offline version)
Binary art - Byte-ing the PE that fails you (extended offline version)
Data Directory
●   (RVA, Size) DataDirectory[NumbersOfRvaAndSizes]
●   each of the standard 16 firsts has a specific use
      → often called 'Data Directories'
Binary art - Byte-ing the PE that fails you (extended offline version)
PE                             DLL
...
call [API]                   API: …
…                                ret

         Imports   Exports
Exports
●   3 pointers to 3 lists
●   defining in parallel (name, address, ordinal)
    ●   a function can have several names
Binary art - Byte-ing the PE that fails you (extended offline version)
Imports
●   a null-terminated list of descriptors
    ●   typically one per imported DLL
●   each descriptor specifies
    ●   DLL's name
    ●   2 null-terminated lists of pointers
        –   API names and future API addresses

●   ImportsAddressTable highlights the address table
    ●   for write access
Binary art - Byte-ing the PE that fails you (extended offline version)
Relocations
●   PE have standard ImageBases
    ●   EXE: 0x400000, DLL 0x1000000
        → conflicts between DLLs
        → different ImageBase given by the loader
●   absolute addresses need relocation
    ●   most addresses of the header are relative
    ●   immediate values in code, TLS callbacks
    ●   adds (NewImageBase - OldImageBase)
Binary art - Byte-ing the PE that fails you (extended offline version)
Resources
●   icons, dialogs, version information, ...
●   requires only 3 APIs calls to be used
        → used everywhere
●   folder & file structure
    ●   3 levels in standard
Binary art - Byte-ing the PE that fails you (extended offline version)
Thread Local Storage
●   Callbacks executed on thread start and stop
    ●   before EntryPoint
    ●   after ExitProcess
Binary art - Byte-ing the PE that fails you (extended offline version)
32 bits ↔ 64 bits
●   IMAGE_FILE_HEADER.Machine
    ●   0x14c I386 ↔ 0x8664 AMD64
●   IMAGE_OPTIONAL_HEADER.Magic
    ●   0x10b ↔ 0x20b
●   ImageBase, stack, heap
    ●   double ↔ quad
    ●   sizeof(OptionalHeader): 0xe0 ↔ 0xf0
●   TLS, import thunks also switch to qwords
Binary art - Byte-ing the PE that fails you (extended offline version)
NumberOfSections
●   96 sections (XP)
●   65536 Sections (Vista or later)


    → good enough to crash tools!
maxsecXP




65535sects
Binary art - Byte-ing the PE that fails you (extended offline version)
SizeOfOptionalHeader
●   sizeof(OptionalHeader)
    ●   that would be 0xe0 (32b)/0xf0 (64b)
    ●   many naive softwares fail if different
●   offset(SectionTable) – offset(OptionalHeader)
●   can be:
    ●   bigger
         –   bigger than file (→ virtual table, xp)
    ●   smaller or null (→ overlapping OptionalHeader)
    ●   null (no section at all)
Section-less PE
●   standard mode:
    ●   200 ≤ FileAlignment ≤ SectionAlignment
    ●   1000 ≤ SectionAlignment
●   'drivers' mode:
    ●   1 ≤ FileAlignment == SectionAlignment ≤ 800
→ virtual == physical
●   whole file mapped as is
●   sections are meaningless
    ●   can be none, can be many (bogus or not)
1 ≤ FileAlignment == SectionAlignment ≤ 800




                                        nosection*
TinyPE
classic example of hand-made malformation
    ●   PE header in Dos header
    ●   truncated OptionalHeader
●   doesn't require a section
●   64b & driver compatible
●   92 bytes
    ●   XP only (no more truncated OptionalHeader)
    ●   extra padding is required since Vista
        → smallest universal PE: 268 bytes
tiny*
Dual 'folded' headers
DD only used after mapping
http://www.reversinglabs.com/advisory/pecoff.php
1.move down header
2.fake DD overlaps starts of section (hex art FTW)
3.section area contains real values
●   loading process:
1.header and sections are parsed
2.file is mapped
3.DD overwritten with real value
    ●   imports are resolved, etc...
Binary art - Byte-ing the PE that fails you (extended offline version)
foldedhdr
null EntryPoint
●   for EXEs
    ●   'MZ' disassembled as 'dec ebp/pop edx'
          (null EP for DLLs = no DllMain call)




                                                 nullEP
virtual EntryPoint
●   first byte not physically in the file
    ●   00 C0 => add al, al




                                            virtEP
TLS on the fly
●   the list of callbacks is updated on the fly
    ●   add callback #2 during callback #1




                                                  tls_onthefly
ignored TLS
●   TLS are not executed if only kernel32 is imported
    ●   and if no DLL importing kernel32 is imported
        –   Kaspersky & Ferrie




                                                        tls_k32
imports' trailing dots
●   XP only
●   trivial
    ●   trailing dots are ignored after DLL name
●   fails heuristics
dll-ld
Resources loops
●   (infinite) loops
    ●   not checked by the loader
    ●   ignored if a different path is required to reach
        resource
resourceloop
EntryPoint change via static DLLs
static DLLs are called before EntryPoint call
●   DllMain gets thread context via lpvReserved
    ●   which already contains the future EntryPoint


→ any static DLL can freely change the EntryPoint

documented by Skywing (http://www.nynaeve.net/?p=127),
but not widely known
ctxt*
Win32VersionValue
●   officially reserved
    ●   'should be null'
●   actually used to override versions info in the PEB
●   simple dynamic anti-emu
    ●   used in malwares
winver
★New★ tricks
Characteristics
●   IMAGE_FILE_32BIT_MACHINE
    ●   true for 64b
    ●   not required !!
●   IMAGE_FILE_DLL
    ●   not required in DLLs
        –   exports still useable
        –   no DllMain call!
             ●   invalid EP → not an EXE
             ●   no FILE_DLL → apparently not a DLL
                 → can't be debugged
mini
normal64
dllnomain*
Imports descriptor tricks
●   INT bogus or absent
    ●   only DllName and IAT required
●   descriptor just skipped if no thunk
    ●   DLL name ignored
         –   can be null or VERY big
    ●   parsing shouldn't abort too early
●   isTerminator = (IAT == 0 || DllName == 0)
●   terminator can be virtual or outside file
    ●   first descriptor too
dd OriginalFirstThunk
dd TimeDateStamp
dd ForwarderChain
----------------------------
dd Name
dd FirstThunk




                               imports_virtdesc
Collapsed imports
advanced imports malformation
●   extension-less DLL name
●   IAT in descriptor
    ●   pseudo-valid INT that is ignored
●   name and hint/names in terminator
●   valid because last dword is null
corkamix
Exceptions directory
●   64 bits Structured Exception Handler
    ●   usually with a lot of extra compiler code


●   used by W32.Deelae for infection
    ●   Peter Ferrie, Virus Bulletin September 2011


●   update-able manually, on the fly
    ●   no need to go through APIs
exceptions
seh_change64
Relocations tricks
●   allows any ImageBase
    ●   required on VAs: code, TLS, .Net
●   ignored if not required
    ●   no ImageBase change (→ fake relocs!)
    ●   no code
    ●   64 bits RIP-relative code
    ●   IP-independant code
●   can relocate anything
    ●   relocate ImageBase → alter EntryPoint
ibknoreloc64



        no_dd
fakerelocs




             ibreloc
Relocation types (in theory)
HIGHLOW
 ●   standard ImageBase delta
ABSOLUTE
 ●   do nothing
 ●   just for alignment padding
Relocation types in practice
●   type 6 and 7 are entirely skipped
    ●   type 8 is forbidden
●   type 4 (HIGHADJ) requires an parameter
    ●   that is actually not taken into account (bug)
●   type 2 (LOW) doesn't do anything
    ●   because ImageBase are 64kb aligned
●   type MIPS and IA64 are present on all archs
●   at last, some cleanup in Windows 8!
Binary art - Byte-ing the PE that fails you (extended offline version)
relocations' archeology
●   HIGHADJ was there all along
●   MIPS was recognized but rejected by Win95
●   NT3.1 introduces MIPS – available in all archs.
●   LOW was rejected by Win95/WinME
    ●   while it does nothing on other versions
●   Windows 2000 had an extra relocation type,
    also with a parameter
Bonus:
Win95 relocations use 2 copies of the exact same code.
code optimization FTW!
Binary art - Byte-ing the PE that fails you (extended offline version)
messing with relocations
●   4 relocation types actually do nothing
●   All relocations can be applied on a bogus address
    ●   HighAdj's parameter used as a trick
●   Relocations can alter relocations
    ●   one block can alter the next
●   Relocations can decrypt data
    ●   set a kernel ImageBase
    ●   default ImageBase is known
●   No static analysis possible
    ●   but highly suspicious :D
reloccrypt
reloccrypt
reloccrypt
Code in the header
●   header is executable
    ●   packers put some data or jumps there
●   many unused fields
●   many less important fields
    ●   Peter Ferrie
        http://pferrie.host22.com/misc/pehdr.htm


→ real code in the header
maxvals
hdrcode
traceless
.Net
Loading process:
1.PE loader
  •   requires only imports (DD[1]) at this stage
2.MSCoree.dll called
3..Net Loader
  ●   requires CLR (DD[13]) and relocations (DD[5])
  ●   forgets to check NumberOfRvaAndSizes :(
       –   works with NumberOfRvaAndSizes = 2


      fails IDA, reflector – but already in the wild
PE    .NET

  ...     ...
imports   ...
  ...     ...
  ...     ...
  ...     ...
  ...   relocs
  ...     ...
  ...     ...
  ...     ...
  ...     ...
  ...     ...
  ...     ...
  ...     ...
  ...     ...
  ...    CLR
  ...     ...




                 tinynet
non-null PE
●
    LoadlibraryEx   with LOAD_LIBRARY_AS_DATAFILE
●   data file PE only needs MZ, e_lfanew, 'PE00'
●   'PE' at the end of the file
    ●   pad enough so that e_lfanew doesn't contain 00s




        a non-null PE can be created and loaded
d_nonnull-*
Resources-only DLL
●   1 valid section
    ●   65535 sections under XP!
●   1 DataDirectory
d_resource*
subsystems
●   no fundamental differences
    ●   low alignments for drivers
    ●   incompatible imports: NTOSKRNL ↔ KERNEL32
    ●   console ↔ gui : IsConsoleAttached


     → a PE with low alignments and no imports
           can work in all 3 subsystems
multiss*
a 'naked' PE with code
●   low alignments → no section
●   no imports → resolve manually APIs
●   TLS only → no EntryPoint


       no EntryPoint, no section, no imports,
                but executed code
nothing*
external EntryPoint (1/2)
●   in a DLL (with no relocations)




                                      dllextEP
external EntryPoint (2/2)
●   allocated just before in a TLS




                                      tls_virtEP
skipped EntryPoint
ignored via terminating TLS




                                 tls_noEP
from ring 0 to ring 3
●   kernel debugging is heavy
    ●   kernel packers are limited
1.change subsystem
2.use fake kernel DLLs (ntoskrnl, etc...)
    ●   redirect APIs
        –   DbgPrint → MessageBoxA, ExAllocatePool → VirtualAlloc



→ automate kernel unpacking
ntoskrnl
TLS AddressOfIndex
●   pointer to dword
●
    overwritten with 0, 1... on nth TLS loading
●   easy dynamic trick
      call <garbage> on file → call $+5 in memory
●   handled before imports under XP, not in W7

     same working PE, different loading process
tls_aoiOSDET
Manifest
●   XML resource
    ●   can fail loading
    ●   can crash the OS ! (KB921337)
●   Tricky to classify
    ●   ignored if wrong type
Minimum Manifest
<assembly xmlns='urn:schemas-microsoft-com:asm.v1' manifestVersion='1.0'/>
DllMain/TLS corruption
●   DllMain and TLS only requires ESI to be correct
    ●   Even ESP can be bogus
    ●   easy anti-emulator
●   TLS can terminate with exception
    ●   no error reported
    ●   EntryPoint executed normally
fakeregs
a Quine PE
●   prints its source
    ●   totally useless – absolutely fun :D


●   fills DOS header with ASCII chars
●   ASM source between DOS and PE headers

●   type-able manually
●   types itself in new window when executed
quine
a binary polyglot
●   add %PDF within 400h bytes
      → your PE is also a PDF (→ Acrobat)
●   add PK0304 anywhere
      → your PE is also a ZIP (→ PKZip)
●   throw a Java .CLASS in the ZIP
      → your PE is also a JAR (→ Java)
●   add <HTML> somewhere
      → your PE is also an HTML page (→ Mosaic)
●   Bonus: Python, JavaScript
corkamix
Conclusion
Conclusion
●   the Windows executable format is complex
●   mostly covered, but many little traps
    ●   new discoveries every day :(




    http://pe101.corkami.com
    http://pe.corkami.com
Questions?
Thanks to
              Fabian Sauter, Peter Ferrie, ‫وليد عصر‬
Bernhard Treutwein, Costin Ionescu, Deroko, Ivanlef0u, Kris Kaspersky, Moritz Kroll, Thomas Siebert,
Tomislav Peričin, Kris McConkey, Lyr1k, Gunther, Sergey Bratus, frank2, Ero Carrera, Jindřich Kubec, Lord
Noteworthy, Mohab Ali, Ashutosh Mehra, Gynvael Coldwind, Nicolas Ruff, Aurélien Lebrun, Daniel
Plohmann, Gorka Ramírez, 최진영 , Adam Błaszczyk, 板橋一正 , Gil Dabah, Juriaan Bremer, Bruce Dang,
Mateusz Jurczyk, Markus Hinderhofer, Sebastian Biallas, Igor Skochinsky, Ильфак Гильфанов, Alex
Ionescu, Alexander Sotirov, Cathal Mullaney
Thank YOU!
  Ange Albertini @gmail.com
   @ange4771
      http://corkami.com
Bonus
Not PE, but still fun
older formats
●   32b Windows still support old EXE and COM
    ●   lower profile formats, evade detection
●   an EXE can patch itself back to PE
    ●   can use 'ZM' signature
    ●   only works on disk :(
●   a symbols-only COM file can drop a PE
    ●   using Yosuke Hasegawa's http://utf-8.jp/public/sas/
exe2pe, dosZMXP
aa86drop.com
file archeology
●   bitmap fonts (.FON) are stored in NE format
    ●   created in 1985 for Windows 1.0
●   vgasys.fon still present in Windows 8
    ●   file unchanged since 1991 (Windows 3.11)
    ●   font copyrighted in 1984
●   Properties show copyright name


           → Windows 8 still (partially) parses
           a 16b executable format from 1985
Binary art - Byte-ing the PE that fails you (extended offline version)
Drunk opcode
●   Lock:Prefetch
    ●   can't be executed
●   bogus behavior under W7 x64
    ●   does not trigger an exception either
    ●   modified by the OS (wrongly 'repaired')
    ●   yet still wrong after patching!


                infinite loop of silent errors
Binary art - Byte-ing the PE that fails you (extended offline version)
this is the end...
my only friend, the end...

More Related Content

PDF
Specialized Compiler for Hash Cracking
Positive Hack Days
 
ODP
Fscons scalable appplication transfers
Daniel Stenberg
 
PDF
Dynamic PHP web-application analysis
ax330d
 
PDF
System Programming and Administration
Krasimir Berov (Красимир Беров)
 
PDF
RIPS - static code analyzer for vulnerabilities in PHP
Sorina Chirilă
 
PDF
A bit more of PE
Ange Albertini
 
PDF
Sergi Álvarez + Roi Martín - radare2: From forensics to bindiffing [RootedCON...
RootedCON
 
Specialized Compiler for Hash Cracking
Positive Hack Days
 
Fscons scalable appplication transfers
Daniel Stenberg
 
Dynamic PHP web-application analysis
ax330d
 
System Programming and Administration
Krasimir Berov (Красимир Беров)
 
RIPS - static code analyzer for vulnerabilities in PHP
Sorina Chirilă
 
A bit more of PE
Ange Albertini
 
Sergi Álvarez + Roi Martín - radare2: From forensics to bindiffing [RootedCON...
RootedCON
 

What's hot (20)

PDF
DEF CON 23 - Ryan o'neil - advances in linux forensics with ecfs
Felipe Prado
 
PDF
Static and Dynamic Analysis at Ning
ZendCon
 
PDF
José Miguel Esparza - Obfuscation and (non-)detection of malicious PDF files ...
RootedCON
 
PDF
I Know You Want Me - Unplugging PlugX
Takahiro Haruyama
 
PDF
50 shades of PHP
Maksym Hopei
 
PDF
Redis: Lua scripts - a primer and use cases
Redis Labs
 
PPTX
Creating user-mode debuggers for Windows
Mithun Shanbhag
 
PPTX
Embedded c programming
PriyaDYP
 
PDF
In Vogue Dynamic
Alexander Shopov
 
PPTX
Winnti Polymorphism
Takahiro Haruyama
 
PPT
Embedded c program and programming structure for beginners
Kamesh Mtec
 
PDF
When AES(☢) = ☠ - Episode V
Ange Albertini
 
PDF
Lua and its Ecosystem
François Perrad
 
PDF
Exploiting Cryptographic Misuse - An Example
Dharmalingam Ganesan
 
PDF
Triton and symbolic execution on gdb
Wei-Bo Chen
 
PDF
HKG15-211: Advanced Toolchain Usage Part 4
Linaro
 
PDF
Fighting API Compatibility On Fluentd Using "Black Magic"
SATOSHI TAGOMORI
 
PDF
Embedded C - Lecture 4
Mohamed Abdallah
 
PDF
01 linux-quick-start
Nguyen Vinh
 
DEF CON 23 - Ryan o'neil - advances in linux forensics with ecfs
Felipe Prado
 
Static and Dynamic Analysis at Ning
ZendCon
 
José Miguel Esparza - Obfuscation and (non-)detection of malicious PDF files ...
RootedCON
 
I Know You Want Me - Unplugging PlugX
Takahiro Haruyama
 
50 shades of PHP
Maksym Hopei
 
Redis: Lua scripts - a primer and use cases
Redis Labs
 
Creating user-mode debuggers for Windows
Mithun Shanbhag
 
Embedded c programming
PriyaDYP
 
In Vogue Dynamic
Alexander Shopov
 
Winnti Polymorphism
Takahiro Haruyama
 
Embedded c program and programming structure for beginners
Kamesh Mtec
 
When AES(☢) = ☠ - Episode V
Ange Albertini
 
Lua and its Ecosystem
François Perrad
 
Exploiting Cryptographic Misuse - An Example
Dharmalingam Ganesan
 
Triton and symbolic execution on gdb
Wei-Bo Chen
 
HKG15-211: Advanced Toolchain Usage Part 4
Linaro
 
Fighting API Compatibility On Fluentd Using "Black Magic"
SATOSHI TAGOMORI
 
Embedded C - Lecture 4
Mohamed Abdallah
 
01 linux-quick-start
Nguyen Vinh
 
Ad

Viewers also liked (7)

DOC
nikhil resume
Nikhil Anish
 
PDF
Connecting communities
Ange Albertini
 
PDF
Trusting files (and their formats)
Ange Albertini
 
PDF
Caring for file formats
Ange Albertini
 
PDF
Binary art - funky PoCs & visual docs
Ange Albertini
 
PDF
Let's write a PDF file
Ange Albertini
 
PDF
Funky file formats - 31c3
Ange Albertini
 
nikhil resume
Nikhil Anish
 
Connecting communities
Ange Albertini
 
Trusting files (and their formats)
Ange Albertini
 
Caring for file formats
Ange Albertini
 
Binary art - funky PoCs & visual docs
Ange Albertini
 
Let's write a PDF file
Ange Albertini
 
Funky file formats - 31c3
Ange Albertini
 
Ad

Similar to Binary art - Byte-ing the PE that fails you (extended offline version) (20)

PDF
Binary art - Byte-ing the PE that fails you (live version)
Ange Albertini
 
PPT
Intro reverse engineering
Nitin kumar Gupta
 
PPTX
Reversing malware analysis training part3 windows pefile formatbasics
Cysinfo Cyber Security Community
 
PDF
hashdays 2011: Ange Albertini - Such a weird processor - messing with x86 opc...
Area41
 
PDF
Finding Xori: Malware Analysis Triage with Automated Disassembly
Priyanka Aash
 
PDF
Ch 6: The Wild World of Windows
Sam Bowne
 
PDF
CNIT 127 Ch 6: The Wild World of Windows
Sam Bowne
 
PPTX
OS Internals and Portable Executable File Format
Aitezaz Mohsin
 
PDF
PE102 - a Windows executable format overview (booklet V1)
Ange Albertini
 
PPTX
Revers engineering
AbdusSalam ALJBRI
 
PDF
Finding Xori: Malware Analysis Triage with Automated Disassembly
Priyanka Aash
 
PDF
Binary translation
GFI Software
 
PDF
The walking 0xDEAD
Carlos Garcia Prado
 
ODP
x86 & PE
Ange Albertini
 
PDF
OPCDE Crackme Solution
Мохачёк Сахер
 
PDF
Basic buffer overflow part1
Payampardaz
 
ODP
Such a weird Processor: messing with opcodes (...and a little bit of PE) (Has...
Ange Albertini
 
PDF
DLL Tutor maXbox starter28
Max Kleiner
 
PPT
PE Packers Used in Malicious Software - Part 2
amiable_indian
 
Binary art - Byte-ing the PE that fails you (live version)
Ange Albertini
 
Intro reverse engineering
Nitin kumar Gupta
 
Reversing malware analysis training part3 windows pefile formatbasics
Cysinfo Cyber Security Community
 
hashdays 2011: Ange Albertini - Such a weird processor - messing with x86 opc...
Area41
 
Finding Xori: Malware Analysis Triage with Automated Disassembly
Priyanka Aash
 
Ch 6: The Wild World of Windows
Sam Bowne
 
CNIT 127 Ch 6: The Wild World of Windows
Sam Bowne
 
OS Internals and Portable Executable File Format
Aitezaz Mohsin
 
PE102 - a Windows executable format overview (booklet V1)
Ange Albertini
 
Revers engineering
AbdusSalam ALJBRI
 
Finding Xori: Malware Analysis Triage with Automated Disassembly
Priyanka Aash
 
Binary translation
GFI Software
 
The walking 0xDEAD
Carlos Garcia Prado
 
x86 & PE
Ange Albertini
 
OPCDE Crackme Solution
Мохачёк Сахер
 
Basic buffer overflow part1
Payampardaz
 
Such a weird Processor: messing with opcodes (...and a little bit of PE) (Has...
Ange Albertini
 
DLL Tutor maXbox starter28
Max Kleiner
 
PE Packers Used in Malicious Software - Part 2
amiable_indian
 

More from Ange Albertini (20)

PDF
Overview of file type identifiers (HackLu)
Ange Albertini
 
PDF
A question of time - Troopers 2024 Keynote
Ange Albertini
 
PDF
Technical challenges with file formats
Ange Albertini
 
PDF
Relations between archive formats
Ange Albertini
 
PDF
Abusing archive file formats
Ange Albertini
 
PDF
TimeCryption
Ange Albertini
 
PDF
You are *not* an idiot
Ange Albertini
 
PDF
Improving file formats
Ange Albertini
 
PDF
KILL MD5
Ange Albertini
 
PDF
No more dumb hex!
Ange Albertini
 
PDF
Beyond your studies
Ange Albertini
 
PDF
An introduction to inkscape
Ange Albertini
 
PDF
The challenges of file formats
Ange Albertini
 
PDF
Exploiting hash collisions
Ange Albertini
 
PDF
Infosec & failures
Ange Albertini
 
PDF
TASBot - the perfectionist
Ange Albertini
 
PDF
Hacks in video games
Ange Albertini
 
PDF
PDF: myths vs facts
Ange Albertini
 
PDF
An overview of potential leaks via PDF
Ange Albertini
 
PDF
Advanced Pdf Tricks
Ange Albertini
 
Overview of file type identifiers (HackLu)
Ange Albertini
 
A question of time - Troopers 2024 Keynote
Ange Albertini
 
Technical challenges with file formats
Ange Albertini
 
Relations between archive formats
Ange Albertini
 
Abusing archive file formats
Ange Albertini
 
TimeCryption
Ange Albertini
 
You are *not* an idiot
Ange Albertini
 
Improving file formats
Ange Albertini
 
KILL MD5
Ange Albertini
 
No more dumb hex!
Ange Albertini
 
Beyond your studies
Ange Albertini
 
An introduction to inkscape
Ange Albertini
 
The challenges of file formats
Ange Albertini
 
Exploiting hash collisions
Ange Albertini
 
Infosec & failures
Ange Albertini
 
TASBot - the perfectionist
Ange Albertini
 
Hacks in video games
Ange Albertini
 
PDF: myths vs facts
Ange Albertini
 
An overview of potential leaks via PDF
Ange Albertini
 
Advanced Pdf Tricks
Ange Albertini
 

Binary art - Byte-ing the PE that fails you (extended offline version)

  • 1. Binary art Byte-ing the PE that fails you Ange Albertini 3rd November 2012 http://corkami.com Lucerne, Switzerland
  • 2. extended edition ● the presentation deck had 60+ slides ● this one has 140+ ● many extra explanation slides ● many extra examples
  • 3. agenda what's a PE? the problem, and my approach overview of the PE format classic tricks new tricks © ID software
  • 5. Windows executables and more ● since 1993, used in almost every executables ● 32bits, 64bits, .Net ● DLL, drivers, ActiveX... ● also used as data container ● icons, strings, dialogs, bitmaps... omnipresent in Windows also EFI boot, CE phones, Xbox,... (but not covered here)
  • 12. sins & punishments ● official documentation limited and unclear ● just describes standard PEs ● not good enough for security ● crashes (OS, security tools) ● obstacle for 3rd party developments ● hinders automation, classification ● PE or not? ● corrupted, or malware? ● fails best tools → prevents even manual analysis
  • 13. aka “the gentle guide to standard PEs”
  • 20. from bottom up ● analyzing what's in the wild ● waiting for malware/corruption to experiment? ● generate complete binaries from scratch ● manually ● no framework/compiler limitation ● concise PoCs → better coverage I share knowledge and PoCs, with sources
  • 26. File PE (Appended data)
  • 27. defined by the PE header data PE Appended PE
  • 28. PE Header Sections code, data, <you name it>
  • 29. Header MZ DOS header since IBM PC-DOS 1.0 (1981) PE (or NE/LE/LX/...) 'modern' headers since Windows NT 3.1 (1993)
  • 30. Header DOS header (DOS stub) 16 bits (Rich header) compilation info 'PE headers'
  • 31. DOS Stub ● obsolete 16b code ● prints msg & exits ● still present on all standard PEs ● even 64b binaries PoC: compiled
  • 32. 'Rich' header ● compiler information ● officially undocumented ● pitiful xor32 encryption ● completely documented by Daniel Pistelli http://ntcore.com/files/richsign.htm PoC: compiled
  • 34. Dos header ● obsolete stuff ● only used if started in DOS mode ● ignored otherwise ● tells where the PE header is
  • 36. 'PE Headers' 'NT Headers' PE00 File header declares the rest Optional header absent in .obj Section table mapping layout
  • 37. File header ● how many sections? ● is there an Optional Header? ● 32b or 64b, DLL or EXE...
  • 39. NumberOfSections values ● 0: Corkami :p ● 1: packer ● 3-6: standard ● code, data, (un)initialized data, imports, resources... ● 16: free basic FTW :D ● what for ?
  • 41. Optional header ● geometry properties ● alignments, base, size ● tells where code starts ● 32/64b, driver/standard/console ● many non critical information ● data directory
  • 43. Sections ● defines the mapping: ● which part of the file goes where ● what for? (writeable, executable...)
  • 46. Data Directory ● (RVA, Size) DataDirectory[NumbersOfRvaAndSizes] ● each of the standard 16 firsts has a specific use → often called 'Data Directories'
  • 48. PE DLL ... call [API] API: … … ret Imports Exports
  • 49. Exports ● 3 pointers to 3 lists ● defining in parallel (name, address, ordinal) ● a function can have several names
  • 51. Imports ● a null-terminated list of descriptors ● typically one per imported DLL ● each descriptor specifies ● DLL's name ● 2 null-terminated lists of pointers – API names and future API addresses ● ImportsAddressTable highlights the address table ● for write access
  • 53. Relocations ● PE have standard ImageBases ● EXE: 0x400000, DLL 0x1000000 → conflicts between DLLs → different ImageBase given by the loader ● absolute addresses need relocation ● most addresses of the header are relative ● immediate values in code, TLS callbacks ● adds (NewImageBase - OldImageBase)
  • 55. Resources ● icons, dialogs, version information, ... ● requires only 3 APIs calls to be used → used everywhere ● folder & file structure ● 3 levels in standard
  • 57. Thread Local Storage ● Callbacks executed on thread start and stop ● before EntryPoint ● after ExitProcess
  • 59. 32 bits ↔ 64 bits ● IMAGE_FILE_HEADER.Machine ● 0x14c I386 ↔ 0x8664 AMD64 ● IMAGE_OPTIONAL_HEADER.Magic ● 0x10b ↔ 0x20b ● ImageBase, stack, heap ● double ↔ quad ● sizeof(OptionalHeader): 0xe0 ↔ 0xf0 ● TLS, import thunks also switch to qwords
  • 61. NumberOfSections ● 96 sections (XP) ● 65536 Sections (Vista or later) → good enough to crash tools!
  • 64. SizeOfOptionalHeader ● sizeof(OptionalHeader) ● that would be 0xe0 (32b)/0xf0 (64b) ● many naive softwares fail if different ● offset(SectionTable) – offset(OptionalHeader) ● can be: ● bigger – bigger than file (→ virtual table, xp) ● smaller or null (→ overlapping OptionalHeader) ● null (no section at all)
  • 65. Section-less PE ● standard mode: ● 200 ≤ FileAlignment ≤ SectionAlignment ● 1000 ≤ SectionAlignment ● 'drivers' mode: ● 1 ≤ FileAlignment == SectionAlignment ≤ 800 → virtual == physical ● whole file mapped as is ● sections are meaningless ● can be none, can be many (bogus or not)
  • 66. 1 ≤ FileAlignment == SectionAlignment ≤ 800 nosection*
  • 67. TinyPE classic example of hand-made malformation ● PE header in Dos header ● truncated OptionalHeader ● doesn't require a section ● 64b & driver compatible ● 92 bytes ● XP only (no more truncated OptionalHeader) ● extra padding is required since Vista → smallest universal PE: 268 bytes
  • 68. tiny*
  • 69. Dual 'folded' headers DD only used after mapping http://www.reversinglabs.com/advisory/pecoff.php 1.move down header 2.fake DD overlaps starts of section (hex art FTW) 3.section area contains real values ● loading process: 1.header and sections are parsed 2.file is mapped 3.DD overwritten with real value ● imports are resolved, etc...
  • 72. null EntryPoint ● for EXEs ● 'MZ' disassembled as 'dec ebp/pop edx' (null EP for DLLs = no DllMain call) nullEP
  • 73. virtual EntryPoint ● first byte not physically in the file ● 00 C0 => add al, al virtEP
  • 74. TLS on the fly ● the list of callbacks is updated on the fly ● add callback #2 during callback #1 tls_onthefly
  • 75. ignored TLS ● TLS are not executed if only kernel32 is imported ● and if no DLL importing kernel32 is imported – Kaspersky & Ferrie tls_k32
  • 76. imports' trailing dots ● XP only ● trivial ● trailing dots are ignored after DLL name ● fails heuristics
  • 78. Resources loops ● (infinite) loops ● not checked by the loader ● ignored if a different path is required to reach resource
  • 80. EntryPoint change via static DLLs static DLLs are called before EntryPoint call ● DllMain gets thread context via lpvReserved ● which already contains the future EntryPoint → any static DLL can freely change the EntryPoint documented by Skywing (http://www.nynaeve.net/?p=127), but not widely known
  • 81. ctxt*
  • 82. Win32VersionValue ● officially reserved ● 'should be null' ● actually used to override versions info in the PEB ● simple dynamic anti-emu ● used in malwares
  • 85. Characteristics ● IMAGE_FILE_32BIT_MACHINE ● true for 64b ● not required !! ● IMAGE_FILE_DLL ● not required in DLLs – exports still useable – no DllMain call! ● invalid EP → not an EXE ● no FILE_DLL → apparently not a DLL → can't be debugged
  • 88. Imports descriptor tricks ● INT bogus or absent ● only DllName and IAT required ● descriptor just skipped if no thunk ● DLL name ignored – can be null or VERY big ● parsing shouldn't abort too early ● isTerminator = (IAT == 0 || DllName == 0) ● terminator can be virtual or outside file ● first descriptor too
  • 89. dd OriginalFirstThunk dd TimeDateStamp dd ForwarderChain ---------------------------- dd Name dd FirstThunk imports_virtdesc
  • 90. Collapsed imports advanced imports malformation ● extension-less DLL name ● IAT in descriptor ● pseudo-valid INT that is ignored ● name and hint/names in terminator ● valid because last dword is null
  • 92. Exceptions directory ● 64 bits Structured Exception Handler ● usually with a lot of extra compiler code ● used by W32.Deelae for infection ● Peter Ferrie, Virus Bulletin September 2011 ● update-able manually, on the fly ● no need to go through APIs
  • 95. Relocations tricks ● allows any ImageBase ● required on VAs: code, TLS, .Net ● ignored if not required ● no ImageBase change (→ fake relocs!) ● no code ● 64 bits RIP-relative code ● IP-independant code ● can relocate anything ● relocate ImageBase → alter EntryPoint
  • 96. ibknoreloc64 no_dd
  • 97. fakerelocs ibreloc
  • 98. Relocation types (in theory) HIGHLOW ● standard ImageBase delta ABSOLUTE ● do nothing ● just for alignment padding
  • 99. Relocation types in practice ● type 6 and 7 are entirely skipped ● type 8 is forbidden ● type 4 (HIGHADJ) requires an parameter ● that is actually not taken into account (bug) ● type 2 (LOW) doesn't do anything ● because ImageBase are 64kb aligned ● type MIPS and IA64 are present on all archs ● at last, some cleanup in Windows 8!
  • 101. relocations' archeology ● HIGHADJ was there all along ● MIPS was recognized but rejected by Win95 ● NT3.1 introduces MIPS – available in all archs. ● LOW was rejected by Win95/WinME ● while it does nothing on other versions ● Windows 2000 had an extra relocation type, also with a parameter Bonus: Win95 relocations use 2 copies of the exact same code. code optimization FTW!
  • 103. messing with relocations ● 4 relocation types actually do nothing ● All relocations can be applied on a bogus address ● HighAdj's parameter used as a trick ● Relocations can alter relocations ● one block can alter the next ● Relocations can decrypt data ● set a kernel ImageBase ● default ImageBase is known ● No static analysis possible ● but highly suspicious :D
  • 107. Code in the header ● header is executable ● packers put some data or jumps there ● many unused fields ● many less important fields ● Peter Ferrie http://pferrie.host22.com/misc/pehdr.htm → real code in the header
  • 111. .Net Loading process: 1.PE loader • requires only imports (DD[1]) at this stage 2.MSCoree.dll called 3..Net Loader ● requires CLR (DD[13]) and relocations (DD[5]) ● forgets to check NumberOfRvaAndSizes :( – works with NumberOfRvaAndSizes = 2 fails IDA, reflector – but already in the wild
  • 112. PE .NET ... ... imports ... ... ... ... ... ... ... ... relocs ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... CLR ... ... tinynet
  • 113. non-null PE ● LoadlibraryEx with LOAD_LIBRARY_AS_DATAFILE ● data file PE only needs MZ, e_lfanew, 'PE00' ● 'PE' at the end of the file ● pad enough so that e_lfanew doesn't contain 00s a non-null PE can be created and loaded
  • 115. Resources-only DLL ● 1 valid section ● 65535 sections under XP! ● 1 DataDirectory
  • 117. subsystems ● no fundamental differences ● low alignments for drivers ● incompatible imports: NTOSKRNL ↔ KERNEL32 ● console ↔ gui : IsConsoleAttached → a PE with low alignments and no imports can work in all 3 subsystems
  • 119. a 'naked' PE with code ● low alignments → no section ● no imports → resolve manually APIs ● TLS only → no EntryPoint no EntryPoint, no section, no imports, but executed code
  • 121. external EntryPoint (1/2) ● in a DLL (with no relocations) dllextEP
  • 122. external EntryPoint (2/2) ● allocated just before in a TLS tls_virtEP
  • 123. skipped EntryPoint ignored via terminating TLS tls_noEP
  • 124. from ring 0 to ring 3 ● kernel debugging is heavy ● kernel packers are limited 1.change subsystem 2.use fake kernel DLLs (ntoskrnl, etc...) ● redirect APIs – DbgPrint → MessageBoxA, ExAllocatePool → VirtualAlloc → automate kernel unpacking
  • 126. TLS AddressOfIndex ● pointer to dword ● overwritten with 0, 1... on nth TLS loading ● easy dynamic trick call <garbage> on file → call $+5 in memory ● handled before imports under XP, not in W7 same working PE, different loading process
  • 128. Manifest ● XML resource ● can fail loading ● can crash the OS ! (KB921337) ● Tricky to classify ● ignored if wrong type Minimum Manifest <assembly xmlns='urn:schemas-microsoft-com:asm.v1' manifestVersion='1.0'/>
  • 129. DllMain/TLS corruption ● DllMain and TLS only requires ESI to be correct ● Even ESP can be bogus ● easy anti-emulator ● TLS can terminate with exception ● no error reported ● EntryPoint executed normally
  • 131. a Quine PE ● prints its source ● totally useless – absolutely fun :D ● fills DOS header with ASCII chars ● ASM source between DOS and PE headers ● type-able manually ● types itself in new window when executed
  • 132. quine
  • 133. a binary polyglot ● add %PDF within 400h bytes → your PE is also a PDF (→ Acrobat) ● add PK0304 anywhere → your PE is also a ZIP (→ PKZip) ● throw a Java .CLASS in the ZIP → your PE is also a JAR (→ Java) ● add <HTML> somewhere → your PE is also an HTML page (→ Mosaic) ● Bonus: Python, JavaScript
  • 136. Conclusion ● the Windows executable format is complex ● mostly covered, but many little traps ● new discoveries every day :( http://pe101.corkami.com http://pe.corkami.com
  • 137. Questions? Thanks to Fabian Sauter, Peter Ferrie, ‫وليد عصر‬ Bernhard Treutwein, Costin Ionescu, Deroko, Ivanlef0u, Kris Kaspersky, Moritz Kroll, Thomas Siebert, Tomislav Peričin, Kris McConkey, Lyr1k, Gunther, Sergey Bratus, frank2, Ero Carrera, Jindřich Kubec, Lord Noteworthy, Mohab Ali, Ashutosh Mehra, Gynvael Coldwind, Nicolas Ruff, Aurélien Lebrun, Daniel Plohmann, Gorka Ramírez, 최진영 , Adam Błaszczyk, 板橋一正 , Gil Dabah, Juriaan Bremer, Bruce Dang, Mateusz Jurczyk, Markus Hinderhofer, Sebastian Biallas, Igor Skochinsky, Ильфак Гильфанов, Alex Ionescu, Alexander Sotirov, Cathal Mullaney
  • 138. Thank YOU! Ange Albertini @gmail.com @ange4771 http://corkami.com
  • 139. Bonus
  • 140. Not PE, but still fun
  • 141. older formats ● 32b Windows still support old EXE and COM ● lower profile formats, evade detection ● an EXE can patch itself back to PE ● can use 'ZM' signature ● only works on disk :( ● a symbols-only COM file can drop a PE ● using Yosuke Hasegawa's http://utf-8.jp/public/sas/
  • 144. file archeology ● bitmap fonts (.FON) are stored in NE format ● created in 1985 for Windows 1.0 ● vgasys.fon still present in Windows 8 ● file unchanged since 1991 (Windows 3.11) ● font copyrighted in 1984 ● Properties show copyright name → Windows 8 still (partially) parses a 16b executable format from 1985
  • 146. Drunk opcode ● Lock:Prefetch ● can't be executed ● bogus behavior under W7 x64 ● does not trigger an exception either ● modified by the OS (wrongly 'repaired') ● yet still wrong after patching! infinite loop of silent errors
  • 148. this is the end... my only friend, the end...