Building bigger, faster, more reliable websites.
Strategy
This is a guest repost by Siddharth Anand, Data Architect at Agari, on Airbnb's open source project Airflow, a workflow scheduler for data pipelines. Some think Airflow has a superior approach. Workflow schedulers are systems that are responsbile for the periodic execution of workflows in a reliable and
Example
This is Part 2 of a guest post by Kris Beevers, founder and CEO, NSONE, a purveyor of a next-gen intelligent DNS and traffic management platform. Here's Part 1. Integration and functional testing is crucial Unit testing is hammered home in every modern software development class. It’s
hot links
Who's Hiring? * Microsoft’s Visual Studio Online team is building the next generation of software development tools in the cloud out in Durham, North Carolina. Come help us build innovative workflows around Git and continuous deployment, help solve the Git scale problem or help us build a best-in-class
Example
This is Part 1 of a guest post by Kris Beevers, founder and CEO, NSONE, a purveyor of a next-gen intelligent DNS and traffic management platform. Here's Part 2. Every tech company thinks about it: the unavoidable – in fact, enviable – challenge of scaling its applications and systems as
hot links
Hey, it's HighScalability time: The oldest known fossil of a flowering plant. 130 million years old. What digital will last so long? * 32.6: Ashley Madison password cracks per hour; 1 million: cores in the Human Brain Project's silicon brain; 54,000: tennis balls used at
Strategy
Peter Thiel, VC, PayPal co-founder, early Facebook investor, and most importantly, the supposed inspiration for Silicon Valley's intriguing Peter Gregory character, argues in his book Zero to One that a successful business needs to make a product that is 10 times better than its closest competitor. The title
AskHighScalability
Jonathan Willis, software developer by day and superhero by night, asked an interesting question via Twitter on StackOverflow: I've been having discussions with other members of my team on the pros and cons of using an async app server such as the Play! Framework (built on Netty) versus
hot links
Hey, it's HighScalability time: Hunter-Seeker? Nope. This is the beauty of what a Google driverless car sees. Great TED talk. * $2.8 billion: projected Instagram ad revenue in 2017; 1 trillion: Azure event hub events per month; 10 million: Stack Overflow questions asked; 1 billion: max volts generated
Microsoft
This is a guest repost by Mark Russinovich, CTO of Microsoft Azure (and novelist!). We all benefit from a vibrant competitive cloud market and Microsoft is part of that mix. Here's a good container overview along with Microsoft's plan of attack. Do you like their story?
hot links
Who's Hiring? * VoltDB's in-memory SQL database combines streaming analytics with transaction processing in a single, horizontal scale-out platform. Customers use VoltDB to build applications that process streaming data the instant it arrives to make immediate, per-event, context-aware decisions. If you want to join our ground-breaking engineering
Example
This is a guest post by Olivier Paugam, SW Architect for the Autodesk Cloud. I really like this post because it shows how bits of infrastructure--Mesos, Kafka, RabbitMQ, Akka, Splunk, Librato, EC2--can be combined together to solve real problems. It's truly amazing how much can get done these
hot links
Hey, it's HighScalability time: Being Google CEO: Nice. Becoming Tony Stark: Priceless (Alphabet) * $7: WeChat's revenue per user and there are 549 million of them; 60%: Etsy users using mobile; 10: times per second a self-driving car makes a decision; 900: calories in a litre of