Cloud Native Java GraalVM 이상과 현실

Copyright © 2019, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted
Cloud Native Java: GraalVM
이상과 현실
김태완(taewanme@gmail.com)
Oracle Korea Solution Engineering
@taewanme, http://taewan.kim

Copyright © 2019, Oracle and/or its affiliates. All rights reserved. |
자바 다양성 시대
Confidential – Oracle Internal/Restricted/Highly Restricted 2

GraalVM
http://www.graalvm.org/

Why GraalVM?
8. Java code as a native library
1. High-performance modern Java
2. Low-footprint, fast-startup Java
3. Combine JavaScript, Java, Ruby, and R
4. Run native languages on the JVM
5. Tools that work across all languages
6. Extend a JVM-based application
7. Extend a native application
9. Polyglot in the database
10. Create your own languagehttps://chrisseaton.com/truffleruby/tenthings/

Why GraalVM?
10. Create your own language

Why GraalVM?
IoT
Polyglot
Cloud Native

Why GraalVMè Native Application
IoT
Polyglot
Cloud Native

https://medium.com/graalvm/instant-netty-startup-using-
graalvm-native-image-generation-ed6f14ff7692

GraalVM Team

GraalVM 개발 팀: Research
64편 이상 논문(2012 ~ 2019)
https://www.graalvm.org/community/publications/

GraalVM
8 + +

dk

JIT Compiler

Write Once, Run Anywhere
이미지 출처: https://commons.wikimedia.org/wiki/File:Java-program-execution.png
- javac compiler
- Java code(String) è byte[]
- java Binary Representation
- compact & small
- JIT compiler
- byte[] è byte[] (machine code)
- compact & small representation

Compiler
• AOT(Ahead-of-Time) Compiler
• JIT (Just-In-Time) Compiler
Static vs Dynamic
Compiler

AOT 컴파일러와 Dynamic 컴파일러 공통점
AOT
Compiler
JIT
Compiler
è Machine Code è Machine Code

AOT 컴파일러와 Dynamic 컴파일러 차이점
AOT Compiler JIT Compiler
Source code → Native executable Source code → Bytecode →
Interpreter + JIT executable
실행전에 무겁고 복잡한 분석&최적화 수행
실행 환경 정보 수집 어려움
Static Code 최적화
공격적이고 낙관적인 최적화
실행 프로파일 정보를 활용
특정 환경 특화된 최적화

JIT Compiler의 목표
빠른 컴파일 속도 & 최적화

JIT Compiler
• Speculation Without Regret: Reducing Deoptimization Meta-data in the
Graal compiler
http://ssw.jku.at/General/Staff/GD/PPPJ-2014-duboscq-29.pdf
JVM

HotSpot Optimization

Optimization: inlining
int addAll(int max){
int accum = 0;
for(int i = 0; i<max; i++) {
accum = add (accum, i);
}
return accum;
}
int add(int a, int b){return a+b;}
int addAll(int max){
int accum = 0;
for(int i = 0; i<max; i++) {
accum = accum + i;
}
return accum;
}
Optimization: inlining

JVM 성능 향상
http://www.dominicgiles.com/blog/files/abdb7a96e9db63644317c62d6e40c40b-142.html

JVM 성능 향상 주체
• JIT Compiler
– Profiling &
• CPU, Memory, Object Tracking, Mem
– Optimization
• 더 효율적인 코디 패턴 감지
• 더 효율적인 머신 코드 생성
http://ssw.jku.at/General/Staff/GD/PPPJ-2014-duboscq-29.pdf

Intel CPU의 Java 최적화

HotSpot

HotSpot
• Oracle Java JVM
• Java SE 1.3(1999. 04)에 추가
• 개발 언어: C++
• 2개의 JIT compiler를 포함
– C1: client compiler
• C1 디자인: 빠른 시작
• 코드 최적화의 비중 낮춤
– C2: server compiler
• C2 디자인: 약간 느린 시작
• 코드 최적화 비중 높임
HotSpot VM
C1 C2
Compiler Interface
HotSpot VM
c++
c++
c++
c++

JVM

HotSpot 의 고민

HotSpot – Limitation
https://github.com/netroby/jdk9-
dev/blob/master/jdk/src/java.base/share/classes/jdk/internal/HotSpotIntrinsicCandidate.java

GraalVM & Graal

GraalVM
8 + +

GraalVM Team

GraalVM의 핵심 키워드
Graal / JVMCI Polyglot/ Truffle Native Image
NEW JIT Complier Language Platform AOT Compiler

Graal != GraalVM
HotSpot VM
C1 C2
Compiler Interface
OpenJDK 8
HotSpot VM
Compiler Interface JVMCI
C1 Graal
GraalVM

Graal
• GraalVM의 새로운 JIT Compiler
• Hotspot의 C2 JIT 컴파일러 대체가 목표
• Java로 개발
• C2와 비교하여 20% 선능 개선 (Twitter 사례)
– Production Scala 애플리케이션에 적용
– GraalVM CE(Community Edition)
https://www.youtube.com/watch?v=ZbccuoaLChk

Community Edition
• Free
• Unsupported
• Runs all GraalVM languages
– Java (+Scala), JavaScript, Python, Ruby, R
• Support for native libraries in context of those languages too
– Tools (debugger, profiler, monitor agent)
• Basic version of SubstrateVM
– Native code has full access to address space
• Runs code in JVM, Node.js, MySQL, or standalone
Enterprise Edition
• Not Free
• Supported
• Best performance & size
– Graal EE Java is 20% faster than CE (on average)
– Dynamic languages (JS, Python, R, Ruby) 2x faster
– Smallest footprint – 2x smaller vs CE
• Native code memory protection
• Debugging tools for embedded use
GraalVM 라이센스

Scala 2.12.6 & GraalVM
https://medium.com/graalvm/compiling-scala-faster-with-graalvm-86c5c0857fa3

graal compiler
• OpenJDK 9 +
• OpenJDK 10 +
• OpenJDK 11 +
• GraalVM
-XX:+UnlockExperimentalVMOptions
-XX:+UseJVMCICompiler
-XX:+EnableJVMCI

graal compiler
https://www.graalvm.org/docs/examples/java-performance-examples/
https://github.com/taewanme/graalvm_seminar_examples/tree/master/examples/e01

graal compiler Demo
OpenJDK 11, Tiered Compiler OpenJDK 11, Graal Compiler

graal compiler 결과

graal compiler Demo: compile log

Graal과 Twitter
https://www.youtube.com/watch?v=G-vlQaPMAxg

GraalVM 기능과 JEP
• JEP: JDK Enhancement Proposal

Native Image

Native Runtime
Java
Java or node.js or R or Ruby or Python
or C/C++ User Function
SVM
dynamically
executed
native
precompiled
Graal VM on SubstrateVM
Java
Java or node.js or R or Ruby or Python
or C/C++ User Function
HotSpot
dynamically
executed
native
precompiled
Graal VM on HotSpot

Native Image

작은 footprint, 신속한 startup
OpenJDK 11, Graal Compiler
SubstrateVM (SVM)
• GraalVM의 하위 프로젝트
• JVM 애플리케이션을 컴파일하여 Native 실행파일을 생성
• Ahead-of-time compiler- 빠른 시작을 유도
• Virtual 머신이 필요 없음
• 작은 메모리로 시작
• 38Mbyte virt.x 애플리케이션을 10MB RAM에서 돌린 사례
• https://www.jetdrone.xyz/2018/08/10/Vertx-native-image-
10mb.html

Native Image Demo

Graal & SubstrateVM

빠른 Startup: Heap Image
• d
https://medium.com/graalvm/isolates-and-compressed-references-more-flexible-and-
efficient-memory-management-for-graalvm-a044cc50b67e

Substrate VM Java Limitations
https://github.com/oracle/graal/blob/master/substratevm/LIMITATIONS.md
항목 지원
Dynamic Class Loading / Unloading Not supported
Reflection Mostly supported
Dynamic Proxy Mostly supported
Java Native Interface (JNI) Mostly supported
Unsafe Memory Access Mostly supported
Static Initializers Partially supported
InvokeDynamic Bytecode and Method Handles Not supported
Finalizers Not supported
References Mostly supported
Security Manager Not supported
JVMTI, JMX, other native VM interfaces Not supported

Micronaut의 GraalVM 지원

GraalVM 기능과 JEP

Polyglot

Truffle

Polyglot Virtualization
63
Truffle API
JavaVM Runtime
JavaScript
Interpreter
Ruby
Interpreter
R
Interprete
r
Graal
compiler
Compiled
code snippetCompiled
code snippet
JavaScript
application
JavaScript
libraries
Node.js
…
Ruby
application
Ruby gems
& libraries
Rails
LLVM .bc
Interpreter
R native
libraries
Node.js
native libs
Ruby/Rails
native libs
Threads / Scheduler Filesystem Network GC / heap Code cache
Java
application
Truffle
Polyglot
API
eval("application/x-ruby",
"def add(a, b) a + b;
end;");

GraalVM Ecosystem

Ployglot Performance

GraalVM Language Status
Available 2017
Available 2018
Proposed / Prototyping
Java
C
C++
Python
C#
VB.NET
JavaScript
Assembly language
PHP
PerlRubyVBSwift
R
Objective-C
Go
MATLAB
Delphi/Object Pascal
PL/SQL
Scratch
Others
PROGRAMMING LANGUAGE POPULARITY
(TOP 20 LANGUAGES FROM MAY 2017 TIOBE INDEX)
Groovy
FORTRAN
Kotlin
Clojure
Scala
F#

Java에서 다른 언어 호출
import org.graalvm.polyglot.*;
public class Sample {
public static void main(String[] args) {
try (Context context = Context.newBuilder().allowAllAccess(true).build()){
System.out.println( context.getEngine().getLanguages().keySet());
context.eval("ruby", "puts '안녕, 루비’”);
context.eval("python", "print(안녕, 파이썬')");
context.eval("js", "console.log(‘안녕, JS')");
context.eval("R", "cat(‘안녕, R')");
} catch (PolyglotException e) {
e.printStackTrace();
}
}
}

spring-r: mvn spring-boot:run

Spring-r UI: http://localhost:8080/load

Java에서 다른 언어를 호출 (LLVM)
#include <stdio.h>
int main(){
print(“Hello from graalvm!n”);
return 0;
}
$ clang -c -O1 -emit-llvm hello.c
$ lli hello.bc
Hello from graalvm!
$

Java에서 다른 언어를 호출 (LLVM)
import org.graalvm.polyglot.*;
import java.io.*;
public class Sample {
public static void main(String[] args) throws Exception {
File f = new File("hello.bc");
Source source = Source.newBuilder("llvm", new File("hello.bc")).build();
try (Context context = Context.newBuilder().allowAllAccess(true).build()){
context.eval(source).execute();
}
}
}

https://github.com/taewanme/graalvm_seminar_examples

GraalVM 현재

GraalVM 사례

Twitter
https://www.youtube.com/watch?v=PtgKmzgIh4c
• Twitter VM 팀은 Graal
컴파일러를 사용하여 Scala
기반 microservices 운영
• 메모리 할당과 성능 향상
• 성능 개선: 20%

Goldman Sachs
https://www.youtube.com/watch?time_continue=417&v=MUECwHdr07Q

GraalVM Summary

GraalVM의 목표: Six degrees of freedom
https://commons.wikimedia.org/wiki/File:6DOF.svg
• Fast Startup Java Application: Native
• High Performance Java Application
• Integrated Polyglot Application
• Java as Language Platform
• Embedded Java Application

GraalVM, OpenJDK, Oracle Java
Graal
Native Image
JVMCI
JEP 243: Java-Level JVM Compiler Interface
JEP 295: Ahead-of-Time Compilation
JEP 317: Experimental Java-Based JIT Compiler
9 ~ 12
8

추가 자료
• http://taewan.kim/post/graalvm_seminar/ 발표 동영상

추가 자료
• https://github.com/taewanme/graalvm_seminar_examples

추가자료
gitter.im/graalvm

Cloud Native Java GraalVM 이상과 현실

Cloud Native Java GraalVM 이상과 현실

Recommended

More Related Content

What's hot (20)

Similar to Cloud Native Java GraalVM 이상과 현실 (20)

More from Taewan Kim (9)

Recently uploaded (20)

Cloud Native Java GraalVM 이상과 현실