Craigory Coppola

Camp Counselor

Benchmarking like a Scientist: Communicating Code's Performance.

Event Logo

Thursday, July 27, 2023 - 7:30 PM UTC, for 1 hour.

Regular, 60 minute presentation

Room: African 60


This session will explore several aspects of benchmarking. We will start by introducing the concept of code benchmarking, what it is and why it is important in software development. We will then cover the different approaches to benchmarking, including micro, macro, and synthetic benchmarking, and examine the pros and cons of each method. Next, we will delve into the best practices of benchmarking and the common pitfalls to avoid. This will include topics such as selecting the right metrics, avoiding bias in your benchmark results, and controlling environmental factors to ensure repeatability and reproducibility. We will also discuss the importance of benchmarking throughout the development process, and how it can be used to inform design decisions and optimize code. In addition to the technical aspects of benchmarking, we will also be focusing on the crucial aspect of communication. We will cover how to present your benchmark results in a clear and concise manner, so that they can be easily understood by both technical and non-technical stakeholders. This includes best practices for visualizing your results, and tips for effectively communicating the performance of your code. This session is aimed at developers of all levels, from those new to the field to experienced professionals. Whether you are looking to improve your benchmarking skills, or simply want to gain a deeper understanding of the science behind code performance, this session will provide you with the knowledge and tools you need to succeed.

Take Aways

  • - How to write benchmarks for individual sections of an app
  • - How to write benchmarks for happy-paths of an app
  • - How to communicate benchmark results to internal and external stakeholders

Supporting Resources

favorited by:
Dave Smith Brett Allenstein Ken Samson Bailey Whitehill Lance Larsen Alice Kim Jacob Graf Ryan Holmes Robin Schroeder Brenden Capps Geoff Rich Stephanie Chamblee Nicolette Anderson Rolando Lopez Bob Dankert Craigory Coppola Brian Meeker Dan Willman Jon Meer Joe Slack Adekunle Oduye Troy Landers Dave Boulineau Timothy Tyson Christopher Ebbert Eric Hamacher Jacob Galloway Jacob Netz Eric Olsson John Martin Elizabeth Groom Sushil Choudhary Nick Heidke