TERRAFORM INIT: BEST PRACTICES FOR PRODUCTION
Rather than fully configuring your backend.tf in a file.```
terraform {
backend “gcs” {
bucket = “my-bucket-123”
prefix = “terraform/state”
}
GOOGLE EMBRACES TERRAFORM FOR CLOUD PROJECTS
I’m glad Google are finally starting to embrace Terraform by creating their own modules. Version 0.1.0 of the project-factory looks really promising.
VERVERICA PLATFORM FOR FLINK MANAGEMENT
The DA Platform is a huge step forward for running Flink at scale. I was lucky enough to see a demo and was really impressed. Far more advanced that the what can be achieved with Dataflow at the moment.
BUILDING AN EFFECTIVE SRE CULTURE
Here are some tips on how to create an effective SRE culture:
DELIVERING RELIABLE HIGH-PERFORMANCE MICROSERVICES
Here are some tips on how to deliver reliable, high-throughput, low-latency (micro)services:
STOCK MARKET PREDICTION WITH MACHINE LEARNING
The premise was simple. Use “big” data analytics and machine learning models to predict the movement of stock prices. However, we had really “dirty” data and our Data Scientists were stuggling to seperate the noise from the signals. We spent a lot of time cleaning the data and introducing good old principles like “how can I run the model somewhere over than a laptop?”. This was a true startup, a bunch of people in a room trying to get stuff working. No red tape, no calling the “helpdesk” to sort out your IT problems (I actually was the helpdesk).
CALCULATE DELTA RISK WITH QUANTLIB
QuantLib is a free and open-source software library for quantitative finance. It provides a wide range of functionality for pricing and risk-managing financial derivatives, including interest rate swaps.
OPTIMIZING STRAGGLERS IN GOOGLE CLOUD DATAFLOW
I’m currently bench-marking Flink against Google Cloud Dataflow using the same Apache Beam pipeline for quantitative analytics. One observation I’ve seen with Flink is the tail latency associated with some shards.
WHY CRYPTOCURRENCY MATTERS
The point of cryptocurrency is to provide a decentralized, secure, and efficient way to transfer value. Cryptocurrencies are not issued by any central authority, such as a government or bank, and they are not backed by any physical asset. Instead, they are created and maintained by a network of computers that are running a special software program. This software program is designed to verify and record cryptocurrency transactions, and to prevent fraud.
OPTIMIZING LATENCY IN MICROSERVICES
Great talk by by Peter Lawrey regarding latency in micro-services. https://www.infoq.com/presentations/latency-sensitive-microservices/