Yapc Asia 2009 ペパボでのPerlの使い方

Sep 17, 2009Download as KEY, PDF1 like2,225 views

hiboma

YAPC Asia 2009 - 株式会社paperboy&co. でのPerl使い方についての発表

• gihyo.jp Puppet, Func

• http://gihyo.jp/admin/serial/01/puppet

• http://gihyo.jp/admin/serial/01/func

• MASHUP++
Plagger

• http://www.amazon.co.jp/dp/4861671655/

30days Album
• http://30d.jp/
•
• 30
• 30
• 10

• 40

30days Album + Perl
• Perlbal
• MogileFS
• API on Catalyst

• Gearman
• TheSchwartz

Perlbal

Perlbal

http://30d.jp/img http://30d.jp/img

Web

Perlbal
• Perl

•3
• MogileFS
• X-Reproxy-URL

MogileFS
client

mogilefsd mogilefsd mogstored mogstored

MySQL

MogileFS

• OSS

• Perlbal
• X-Reproxy-URL

API

• MogileFS
• API GET/PUT

• Perl + Catalyst

API
client

HTTP GET/PUT

API

mogilefsd mogilefsd mogstored mogstored

API
•
• MogileFS Content-Type Content-Length
API

•
• MogileFS API

Perlbal
Perlbal

X-Reproxy-URL:
http://storage_node/dev1/0/000/...
Content-Type GET

GET

mogstored mogstored
API

mogilefsd mogilefsd

Web
(Rails)

XML-RPC
API
(Catalyst)
German::Client TheSchwartz::Job

gearmand MySQL

gearman TheSchwartz
worker worker

API

• Web
gearman / TheSchwartz

• Catalyst + Catalyst::Plugin::XMLRPC API

Gearman
• ( )

• Web
•
•
• Proc::Background
daemontools

TheSchwartz
• ( )

•
~ )

• (zip)

• Proc::Background
daemontools

• Image::Imlib2

• =>

• yusukebe
• http://yusukebe.com/tech/archives/
20070526/011710.html
GD::Image

Image::Magick

Imager

- ﬂash media server
- coldfusion
- SSL
- SSH

CGI
• Apache2.0(Worker) + SuEXEC + mod_cgid
• PHP, Perl, Ruby, Python
• CGI =>

•
•
• CPU

hetepro
•
•
• Class::Component
• + Daemon::Generic
• + Sys::Statistics::Linux ( )

• 2007 ( Moose )

hetepro

ﬁlter:
- catch:
uid: gt: 1000
runtime: gt: 300
action:
- KillProcess:
- Log::TextTable:

Sys::Statistics::Linux

• /proc ( ,
) ...

• Linux !

• hetepro

Sys::Statistics::Linux
• CpuStats • NetStats
• DiskStats • PgSwStats
• DiskUsage • ProcStats
• FileStats • Processes
• LoadAVG
• SockStats
• MemStats • SysInfo

Sys::Statistics::Linux
•
• ex. CPU N /N

• ex.

•
Sys::Statistics::Linux::Processes

Archer
• id:tokuhirom Perl

• Ruby Capistrano

•

Archer
tasks:
process:
- module: Exec::Remote
name: update kernel
conﬁg:
command: sudo yum -y update kernel
projects:
users:
- example0.heteml.jp
- example1.heteml.jp
- ...

• API
• Web
•
API API API
k

• JSON-RPC Web
OK
API
API

API

• HTTP::Engine
• Any::Moose
• Data::ObjectDriver
• Kwalify
• Func(Python)

API
WEB

JSON-RPC

MySQL API

Func

WWW WWW MAIL MAIL

• MySQL

• Data::ObjectDriver

• Web

• Web

• Mail

•

2
•
• Apache
VirtualHost PHP php.ini
etc ...

• API
Func

Func
• Python

•
( XMLRPC over HTTPS)

• http://gihyo.jp/admin/serial/01/func/0001

• /usr/bin/func-transmit YAML
Perl

qpsmtpd

• Perl SMTP

•
• Apache
• mod_perl

• http://smtpd.develooper.com/

( )
• hook_connect

• hook_helo

• hook_rcpt

• hook_queue
• .... etc

• SMTP

• check_badsubject

• Subject

• check_relay_rcpt

• RCPT MySQL
( memcached )

• check_size
•
• ESMTP SIZE
qpsmtpd

• qpsmtpd

• max_rcpt_to
• RCPT

Qpsmtpd

• /

•

• http://wiki.qpsmtpd.org/api:plugin_hooks

This presentation covers the benefits of deploying to ECS, as we explore techniques and open source tools to help manage multiple ECS clusters. First we discuss why developing as containers and deploying to ECS offers a more cost-effective, faster, and safer workflow from dev to production than VMs on EC2. Next we present techniques Convox uses to manage countless clusters and apps. We will see a CloudFormation template that reliably provisions, updates, and horizontally and vertically scales ECS clusters, and another template that configures application containers inside the cluster. Finally we survey features that are "missing" on ECS and demonstrate simple tools and techniques Convox has developed to to fill in these gaps. For example: * Running a private build and registry service inside the ECS cluster itself * Splitting up an app's processes (i.e. web and worker) into their own task definitions for independent horizontal scaling * Running an agent on every cluster instance for forwarding all container logs to Kinesis, Lambda and beyond * Running an public API on a cluster that facilitates a `docker exec` debugging session inside application containers

Choose Your Own AWS AdventureNoah Zoschke

OpenResty/Lua 70+ Advanced Programming Skills and Optimization tipsHo Kim

Minimum Viable InfrastructureNoah Zoschke

I'm building Convox, an open-source platform that expertly configures AWS to run and manage any application. In doing this I have discovered a minimal set of 11 cloud infrastructure services that form an architecture that supports any application. Here I'll introduce the 11 service types that support our secure computing, application workload, and operational needs. I'll show how these services are used together to manage a secure computing cluster that can build Docker images for an app, roll out new images to production with zero downtime, and scale to handle any load. Finally we'll look at the cloud computing landscape to see how all the cloud providers and software projects compare with offering these 11 service types.

6 - Custom Mininet Topology Experiment by Dwina Fitriyandini Siswanto & Siti ...SDNRG ITB

Docstringを書こう！cocodrips

PyconRu 2016. Осторожно, DSL!Ivan Tsyganov

Каждый разработчик рано или поздно сталкивается с предметно-ориентированными языками (DSL). Мы разберемся, зачем же нам нужны DSL, и какие проблемы они нам помогают решать. Поймем, в каких случаях нам стоит разрабатывать свой язык, а в каких — использовать уже существующий. Попробуем провести грань и решить, где у нас просто библиотека, а где — предметно ориентированный язык. Придумаем свой DSL и сравним различные подходы к работе с ним в Python. Увидим, как работают лексический и синтаксический анализаторы. Обязательно поговорим про то, как облегчить жизнь пользователям нашего языка. Как сделать информативными сообщения об ошибках? Как тестировать сценарии, написанные на нашем языке? На эти вопросы мы сможем дать ответ.

Rubyslava2102Marius Sajgalik

詳説WebAssembly祐司伊藤

Wordpress 24/7Антон Еремин

Java script.trend(spec)dynamis

이승재, 강성훈, 내가 만든 언어의 개발환경을 Visual Studio Code로 빠르고 쉽게 구축하기 #2, NDC2017devCAT Studio, NEXON

Port knockingRamalhev90

Affär - inte teknikPer Åström

Where to start refactoring?thiagoalessio

ノンエンジニアがウェブサーバーを構築するまでKazuya Ueoka

강성훈, 마비노기 듀얼 서버, 동적 타입 언어에서 반 정적 타입 언어로의 변신, NDC2016devCAT Studio, NEXON

C/C++とWebAssemblyを利用したライブラリ開発祐司伊藤

MateriApps LIVE! の設定Computational Materials Science Initiative

Collection pipeline par Mathieu GodartCocoaHeads France

Git SubmodulesMaciej Lasyk

みんなのウェディングのデータ分析基盤の作り方。 Sunao Komuro

Modern Mobile Web Appsdynamis

[Deep Dive]Infra寄りのDevがお送りするRDS for Aurora徹底検証Terui Masashi

Human toxicity, environmental impact and legal implications of water fluorida...Declan Waugh

This technical report submitted to the Government of Ireland and the European Commission examines the human toxicity, environmental impacts, and legal implications of water fluoridation. The report finds health risks to humans from fluoride including increased risks of bone fractures, cancer, neurological impairments, and low calcium levels. It also finds environmental risks from fluoride as a water and soil pollutant that impacts fisheries. The report expresses concerns about inadequate risk assessment of fluoride for human consumption and calls for further research on fluoride's toxicity.

These words I share, written from despair, read them, speak them, but do so w...Blair Stuart

I wrote this during a period of my life of intense personal sadness and darkness. I, along with so many others, suffer from PTSD. A life changing illness and yes, it is an illness. Though the way some people carry on one would be forgiven for thinking that it is a Contagious Disease that must only be spoken of behind closed doors. Hopefully by sharing my words and thoughts I will in some small way bring the subject of Depression and in particular PTSD, out of the shadows and into the light of open and honest discussion.

Isu isu trenda terkini dalam teknologi pendidikanRenee Evelyn

C# & AWS LambdaPat Hermens

More Related Content

What's hot (17)

Rubyslava2102Marius Sajgalik

詳説WebAssembly祐司伊藤

Wordpress 24/7Антон Еремин

Java script.trend(spec)dynamis

이승재, 강성훈, 내가 만든 언어의 개발환경을 Visual Studio Code로 빠르고 쉽게 구축하기 #2, NDC2017devCAT Studio, NEXON

Port knockingRamalhev90

Affär - inte teknikPer Åström

Where to start refactoring?thiagoalessio

ノンエンジニアがウェブサーバーを構築するまでKazuya Ueoka

강성훈, 마비노기 듀얼 서버, 동적 타입 언어에서 반 정적 타입 언어로의 변신, NDC2016devCAT Studio, NEXON

C/C++とWebAssemblyを利用したライブラリ開発祐司伊藤

MateriApps LIVE! の設定Computational Materials Science Initiative

Collection pipeline par Mathieu GodartCocoaHeads France

Git SubmodulesMaciej Lasyk

みんなのウェディングのデータ分析基盤の作り方。 Sunao Komuro

Modern Mobile Web Appsdynamis

Rubyslava2102Marius Sajgalik

詳説WebAssembly祐司伊藤

Wordpress 24/7Антон Еремин

Java script.trend(spec)dynamis

이승재, 강성훈, 내가 만든 언어의 개발환경을 Visual Studio Code로 빠르고 쉽게 구축하기 #2, NDC2017devCAT Studio, NEXON

Port knockingRamalhev90

Affär - inte teknikPer Åström

Where to start refactoring?thiagoalessio

ノンエンジニアがウェブサーバーを構築するまでKazuya Ueoka

강성훈, 마비노기 듀얼 서버, 동적 타입 언어에서 반 정적 타입 언어로의 변신, NDC2016devCAT Studio, NEXON

C/C++とWebAssemblyを利用したライブラリ開発祐司伊藤

MateriApps LIVE! の設定Computational Materials Science Initiative

Collection pipeline par Mathieu GodartCocoaHeads France

Git SubmodulesMaciej Lasyk

みんなのウェディングのデータ分析基盤の作り方。 Sunao Komuro

Modern Mobile Web Appsdynamis

Viewers also liked (19)

[Deep Dive]Infra寄りのDevがお送りするRDS for Aurora徹底検証Terui Masashi

Human toxicity, environmental impact and legal implications of water fluorida...Declan Waugh

These words I share, written from despair, read them, speak them, but do so w...Blair Stuart

Isu isu trenda terkini dalam teknologi pendidikanRenee Evelyn

C# & AWS LambdaPat Hermens

Hazop gijutsushikai chubu koukuukai Kiyoshi Ogawa

Ruby HTTP clients comparisonHiroshi Nakamura

This document summarizes and compares Ruby HTTP client libraries. It discusses the sync and async APIs of 16 libraries including Net::HTTP, HTTPClient, and Faraday. It covers their compatibility, supported features like keep-alive connections, and performance based on benchmarks. The document recommends libraries based on priorities like speed, HTML handling, API clients, and SSL support. It encourages readers to check the detailed feature matrix and report any errors found.

The New Framework for Information Literacy for Higher EducationTrudi Jacobson

GBM Group Based Marketing: Marketing to GroupsScott Levine

How to Kill a WordPatrick McLean

好みや多数決で決めない、デザインとの正しい付き合い方Yasuhisa Hasegawa

「私はデザインができない」と言っている方でも、デザインの好き嫌いはあります。また、「使いやすい」という言葉にも様々な意味があるだけでなく、人によって優先にしていることが異なることがあります。デザインプロセスに参加するひとりひとりの意見は大事にしたいですが、なにを重んじて話し合い、進めればよいのか分からないことがあると思います。デザインの議論が脱線すると、プロジェクト全体にも影響します。本セッションでは、CMSをつかったデザイン案件のなかで気をつけておきたいデザインの進め方、話し方のポイントを紹介します。対クライアントだけでなく、社内でデザインを議論するときにも役立ちます。

Ui qa toolsSevilla QA

This document discusses tools for automating user interface (UI) quality assurance testing. It begins with introductions and defines UI quality as including code quality, look and feel consistency with designs, functional testing across browsers/devices, and performance testing. It then recommends specific open source tools for automating each type of testing, including Selenium for functional testing, Galen for look and feel testing, Linters for code quality checking, and performance testing services. The presentation aims to help share knowledge about quality assurance and convince attendees that automated testing is important and helps catch errors early. It concludes by thanking attendees and announcing an upcoming conference.

Corso storytelling a GemonaGemona Turismo

Bundesliga Report - 10 years of academies - Talent pools of top-level German ...Ítalo de Oliveira Mendonça

Escaneado 09 03-2017 10.02Juan Carreón

ブレンダーをDisってみるTetsuo Mitsuda

KnetMiner - EBI Workshop 2017Keywan Hassani-Pak

4 questions to help you secure ePHI todaySarabeth Marcello

Trend & Challenge Digital Marketing di Indonesia 2017 Nicko Krisna

Facebook dan Instagram akan memegang peranan penting dalam digital marketing 2017 karena fitur-fitur baru seperti Facebook Live, Instagram story, dan Instagram Live menjadi solusi praktis bagi pengguna yang tidak ingin repot dengan prosedur. Facebook Group dan fanpage menjadi pilihan utama netizen untuk membentuk komunitas karena dukungan Facebook terhadap fitur-fitur tersebut. Manajemen komunitas, terutama di Facebook, harus dilakukan oleh tim yang ahli dan berpengalaman agar dapat memonetis

[Deep Dive]Infra寄りのDevがお送りするRDS for Aurora徹底検証Terui Masashi

Human toxicity, environmental impact and legal implications of water fluorida...Declan Waugh

These words I share, written from despair, read them, speak them, but do so w...Blair Stuart

Isu isu trenda terkini dalam teknologi pendidikanRenee Evelyn

C# & AWS LambdaPat Hermens

Hazop gijutsushikai chubu koukuukai Kiyoshi Ogawa

Ruby HTTP clients comparisonHiroshi Nakamura

The New Framework for Information Literacy for Higher EducationTrudi Jacobson

GBM Group Based Marketing: Marketing to GroupsScott Levine

How to Kill a WordPatrick McLean

好みや多数決で決めない、デザインとの正しい付き合い方Yasuhisa Hasegawa

Ui qa toolsSevilla QA

Corso storytelling a GemonaGemona Turismo

Bundesliga Report - 10 years of academies - Talent pools of top-level German ...Ítalo de Oliveira Mendonça

Escaneado 09 03-2017 10.02Juan Carreón

ブレンダーをDisってみるTetsuo Mitsuda

KnetMiner - EBI Workshop 2017Keywan Hassani-Pak

4 questions to help you secure ePHI todaySarabeth Marcello

Trend & Challenge Digital Marketing di Indonesia 2017 Nicko Krisna

Yapc Asia 2009 ペパボでのPerlの使い方

1. Perl YAPC::Asia 2009 Tokyo 2009/9/10

3. • id:hiboma • • •

4. • CTO • •4 25

7. • id:MIZZY • • / • / .... etc

8. • gihyo.jp Puppet, Func • http://gihyo.jp/admin/serial/01/puppet • http://gihyo.jp/admin/serial/01/func • MASHUP++ Plagger • http://www.amazon.co.jp/dp/4861671655/

9. • • paperboy&co.

11. CTO

12. CTO

13. CTO

14. “ ”

17. • paperboy&co. • • •

18. • PHP • Perl • Perl

19. Perl

20. 30days Album

22. 30days Album • http://30d.jp/ • • 30 • 30 • 10 • 40

23. 30days Album • • •

24. 30days Album + Perl • Perlbal • MogileFS • API on Catalyst • Gearman • TheSchwartz

25. Perlbal • Perl • •

26. Perlbal Perlbal http://30d.jp/img http://30d.jp/img Web

27. Perlbal • Perl •3 • MogileFS • X-Reproxy-URL

28. MogileFS • Perl • •

29. MogileFS client mogilefsd mogilefsd mogstored mogstored MySQL

30. MogileFS • OSS • Perlbal • X-Reproxy-URL

31. API • MogileFS • API GET/PUT • Perl + Catalyst

32. API client HTTP GET/PUT API mogilefsd mogilefsd mogstored mogstored

33. API • • • • MogileFS::Client MKCOL API

34. API • • MogileFS Content-Type Content-Length API • • MogileFS API

35. Perlbal Perlbal X-Reproxy-URL: http://storage_node/dev1/0/000/... Content-Type GET GET mogstored mogstored API mogilefsd mogilefsd

36. • • • Gearman/TheSchwartz • API

37. Web (Rails) XML-RPC API (Catalyst) German::Client TheSchwartz::Job gearmand MySQL gearman TheSchwartz worker worker

38. API • Web gearman / TheSchwartz • Catalyst + Catalyst::Plugin::XMLRPC API

39. Gearman • ( ) • Web • • • Proc::Background daemontools

40. TheSchwartz • ( ) • ~ ) • (zip) • Proc::Background daemontools

41. • •

42. • Image::Imlib2 • => • yusukebe • http://yusukebe.com/tech/archives/ 20070526/011710.html GD::Image Image::Magick Imager

48. heteml ( )

49. - ﬂash media server - coldfusion - SSL - SSH

50. 4/1

51. • • •

52. CGI • Apache2.0(Worker) + SuEXEC + mod_cgid • PHP, Perl, Ruby, Python • CGI => • • • CPU

53. hetepro • • • Class::Component • + Daemon::Generic • + Sys::Statistics::Linux ( ) • 2007 ( Moose )

54. hetepro • • : CPU N kill -9 •

55. hetepro ﬁlter: - catch: uid: gt: 1000 runtime: gt: 300 action: - KillProcess: - Log::TextTable:

56. Sys::Statistics::Linux • /proc ( , ) ... • Linux ! • hetepro

57. Sys::Statistics::Linux • CpuStats • NetStats • DiskStats • PgSwStats • DiskUsage • ProcStats • FileStats • Processes • LoadAVG • SockStats • MemStats • SysInfo

58. Sys::Statistics::Linux • • ex. CPU N /N • ex. • Sys::Statistics::Linux::Processes

59. • • •

60. Archer • id:tokuhirom Perl • Ruby Capistrano •

61. Archer tasks: process: - module: Exec::Remote name: update kernel conﬁg: command: sudo yum -y update kernel projects: users: - example0.heteml.jp - example1.heteml.jp - ...

62. • ! • •

63. • API • Web • API API API k • JSON-RPC Web OK API API

64. API • HTTP::Engine • Any::Moose • Data::ObjectDriver • Kwalify • Func(Python)

65. API WEB JSON-RPC MySQL API Func WWW WWW MAIL MAIL

66. API • • procmail mailﬁlter

67. API • • …

68. API • •

69. • MySQL • Data::ObjectDriver • Web • Web • Mail •

70. 2 • • Apache VirtualHost PHP php.ini etc ... • API Func

71. Func • Python • ( XMLRPC over HTTPS) • http://gihyo.jp/admin/serial/01/func/0001 • /usr/bin/func-transmit YAML Perl

72. qpsmtpd • Perl SMTP • • Apache • mod_perl • http://smtpd.develooper.com/

74. qpsmtpd • Perl ! ! • • + • qmail ...

75. ( ) • hook_connect • hook_helo • hook_rcpt • hook_queue • .... etc • SMTP

76. • check_badsubject • Subject • check_relay_rcpt • RCPT MySQL ( memcached )

77. • check_size • • ESMTP SIZE qpsmtpd • qpsmtpd • max_rcpt_to • RCPT

78. Qpsmtpd • / • • http://wiki.qpsmtpd.org/api:plugin_hooks

79. • JugemKey API • JUGEM • • MySQL •

Yapc Asia 2009 ペパボでのPerlの使い方

Recommended

More Related Content

What's hot (17)

Viewers also liked (19)

Yapc Asia 2009 ペパボでのPerlの使い方