Stackup deck
1 like310 views
The Mid is a new media publication founded by Vinit Bharara, cofounder of Quidsi, targeting Gen Xers. It focuses on parenting, family, relationships, and work. The Mid uses a microservices architecture with containers running on CoreOS, including services for the frontend (Rendr, Butler), backend (Monsoon), and container orchestration (fleetd). Challenges include immaturity of some technologies and third party services, but mitigations include improving documentation, monitoring, and building alternatives in-house. The future aims to improve performance, allow multi-site control, and use data to better engage users.
Stackup deck
- 2. Who am I?Who am I? Edwin Fuquen [email protected] @efuquen Developed & built software systems for over 9 years. Grooveshark, Livestream, Getty Images, Bloomberg Systems & Ops, Backend, Frontend, Team Lead Scala, Java, C, Javascript, Python
- 3. What is The Mid?What is The Mid? Founded by Vinit Bharara, cofounder of Quidsi, an e- commerce company that include Diapers.com, Soap.com, & Wag.com. Acquired by Amazon. Originally Cafe, relaunched as The Mid. New media publication targeting GenXer's, one of many verticals we hope to pursue. Think parenting, family, relationships, & work. A 'lifestyle' publication.
- 5. FrontendFrontend Doorman - serves site Rendr, built on Backbone, client & server templates. Butler - api service Simple Express app Thumbor - python server for images. Use gulp + browserify to manage client/server js. BackendBackend Python workers read off RabbitMQ messages. Keep them small and focused on single task. Monsoon - built off Habari, heavily modified. Lots of frontend JS, use knockout.js & gulp + browserify to manage.
- 6. Conveniently manage containers. Containers share the same kernel of the host, but have different filesystems. Like lightweight VMs. The creation of lightweight, consistent, and easily shareable environments for running applications.
- 7. CoreOSCoreOS Linux distro based on Chrome OS No package manager, few preinstalled tools. Essentially docker, etcd, & fleetd. An OS fully built around managing containers in a distributed, fault tolerant cluster of machines.
- 8. etcdetcd A distributed key/value store. Meant for config data, not high latency/throughput. Strongly consistent, very reliable. Think zookeeper replacement. fleetdfleetd Uses etcd to make a distributed init system. Distributed systemd, standard unit files. Optional Fleet metadata. Conflict-X, MachineMetadta, control where units run.
- 9. ServiceService DiscoveryDiscovery IP & port stored in etcd. confd notified when keys modified and updates haproxy.cfg Seamless deploys Stage versioned app QA/Test on prod cluster Seamless switch-over of staged container to live
- 11. ChallengesChallenges Rendr & Habari - not well documented. Queues - consistency, ordering, backlogs. Third Party service issues. Docker/Core Maturing Docker builds can take a long time Security - docker pulls not verified No package manager in CoreOS BTRFS, not quiet production ready Docker does not play nice with systemd Ecosystem Politics ...
- 12. MitigationMitigation Dig into the code, comes with experience. Properly plan queue management, monitoring. Choose poorly running services to manage in house. Docker/CoreOS Learn & follow Dockerfile best practices. Internal registry, separately verify images. Build from source, admin container. Automate BTRFS management, switching to ext4 Hacks, and Rocket, when it's ready Change human nature? Room for two fish ...
- 13. The FutureThe Future Multi Site infrastructure Generalize the frontend for different designs Allow multi site control from the CMS Performance, Server & Client side. Data Analysis, gathering everything, now learn from it Persuasive and fine-grained AB testing. Keep users engaged with meaningful content, using tech to build that platform to create it and learn how best to serve it.
- 14. Places professional software developers in volunteer teaching positions in NYC high schools. Gets kids paid summer coding internships. You and your company can help! Looking for teams to place top students in. Contact me or [email protected] ScriptEdScriptEd