What a global pandemic can tell you about better DevOps practices

TRACK: CULTURAL TRANSFORMATION NOVEMBER 12, 2020 Jeremy Meiss What a global pandemic can tell you about better DevOps practices

“

performance described vs performance derived

Jeremy Meiss Director, DevRel & Community

2 million 44,000+ 160,000+ 1,000x jobs/day orgs projects Larger than surveys

40k in 2019
150k in 2019 6

Four classic metrics Deployment frequency Lead time to change Change failure rate Recovery from failure time

CI/CD Benchmarks for high performance Throughput At will Duration <10 minutes Success Rate

90% Mean Time to Recovery <1 hour

The Data

Photo by: Matthew Henry

Throughput

Most teams are not deploying dozens of times per day

Image by Pawan Kolhe from Pixabay

Duration

Photo by Lukas from Pexels

Success Rate

Photo by Brett Sayles from Pexels

Recovery Time

The Insight

2020 has been a year.

Throughput

Throughput in a global pandemic

Peak Throughput was in April 2020

Duration

Duration in a global pandemic

Hypothesis: more tests written in March, driving up Duration. In April, a concerted effort on optimization

Success rate

Success rate in a global pandemic

Hypothesis: people working hard on core business stability

Recovery Time

Recovery time in a global pandemic

Hypothesis: few distractions* working at home

Things that make you go 🤔

Branch information

No significant change in default branch from master… yet.

Success Rate on default branch higher than on non-default

Duration on default branches faster at every percentile

Recovery Time lower on default branches at every percentile

What development practices definitively work?

Success Rate does not correlate with company size

Duration is longest for teams of one

Recovery Time decreases with increased team size (up to 200)

Performance is better with >1 contributor

Software is collaborative

Language by Throughput

Language by Success Rate

Language by fastest TTR

Language by shortest duration

“Don’t deploy on Friday” is not a thing.

“Don’t Deploy on Friday” is not a thing ○ 70% less Throughput on weekends ○ 11% less Throughput on Friday (UTC) ○ 9% less Throughput on Monday (UTC)

2021/22 Sneak Peek 1. Workflows with 0 tests increase YoY, but decrease as total of all workflows 2. More deployments YoY 3. Change validation

2021/22 Sneak Peek 50th percentile on CircleCI fit into the “Elite performer” category on the 2021 State of DevOps report

2021/22 Sneak Peek Kubernetes usage with CI/CD has increased YoY

Full Report https://circle.ci/ssd2020

Timeline.jerdog.me Thank you. For feedback and swag: circle.ci/jeremy IAmJerdog jerdog /in/jeremymeiss