×
Reset Filters
Close
Close
Agenda

Event menu

Scroll top

Nanotube: High-Performance Metrics Router

12:45 - 13:30 (GMT+02:00)
14 October 2021
Industry-Focus Session
Add to calendar 10/14/2021 12:45 10/14/2021 13:30 Europe/Bucharest Nanotube: High-Performance Metrics Router - BIG DATA WEEK BUCHAREST 2021 - HYBRID This talk will cover how we solve the problem of putting down tens of millions of metric data points per second. We will cover the design, how we achieve resiliency, and manage high loads on hundreds of boxes.

Speakers:
ROMAN GRYTSKIV, Senior Developer @Booking.com

Click here to view more details about this session.
Online hello@bigdataweek.com aKyOfPFEVzRHclXpWmTW75232

Booking.com arguably runs the biggest Graphite metrics system setup in the world. We write around 50 million data points per second via relays and store about 500 million metrics in total. The data comes from our event system, apps, and other sources. We used the carbon-c-relay for routing our metrics. It was complex. This made maintenance hard, resiliency and performance suffered. So, we designed Nanotube (github.com/bookingcom/nanotube), which we built in Go, focused on simplicity, performance, and concurrency. Even though the language is of a higher level, we could achieve x3 better performance in our production setup. We made it more resilient, easier to use, and support.

Furthermore, we added support for metrics submission from Kubernetes in a well-governed manner. We added support for the OpenTelemetry gRPC protocol too. It enables the use of Nanotube as a bridge in migrations and hybrid systems.

This talk will cover how we solve the problem of putting down tens of millions of metric data points per second. We will cover the design, how we achieve resiliency, and manage high loads on hundreds of boxes.

ROMAN GRYTSKIV
ROMAN GRYTSKIV
Senior Developer
Booking.com


  • Graphite and monitoring @ Booking.com 01.2017-now
  • Built distributed eye-tracking data collection app @ ABTO Software 07.2014-01.2017
  • Developed application for engineering geology @ Uniservice 06.2013-07.2014
  • Developed large pipeline design CAD application @ Uniservice 11.2011-06.2013
  • Coded software for large-scale molecular systems modeling and analysis (as a Ph.D. student in computational physics) @ ICMP NASU 09.2010-11.2012


ROMAN GRYTSKIV' sessions:

12:45 - 13:30 (GMT)
Oct 14, 2021
Industry-Focus Session
Add to calendar 10/14/2021 12:45 10/14/2021 13:30 Nanotube: High-Performance Metrics Router - BIG DATA WEEK BUCHAREST 2021 - HYBRID This talk will cover how we solve the problem of putting down tens of millions of metric data points per second. We will cover the design, how we achieve resiliency, and manage high loads on hundreds of boxes.

Speakers:
ROMAN GRYTSKIV, Senior Developer @Booking.com

Click here to view more details about this session.
Online hello@bigdataweek.com aKyOfPFEVzRHclXpWmTW75232

Nanotube: High-Performance Metrics Router

This talk will cover how we solve the problem of putting down tens of millions of metric data points per second. We will cover the design, how we achieve resiliency, and manage high loads on hundreds of boxes.


09:30 - 10:15 (GMT+02:00)
14 October 2021
Industry-Focus Session
10:15 - 11:00 (GMT+02:00)
14 October 2021
Industry-Focus Session
11:00 - 11:45 (GMT+02:00)
14 October 2021
Industry-Focus Session
11:45 - 12:00 (GMT+02:00)
14 October 2021
Break
12:00 - 12:45 (GMT+02:00)
14 October 2021
Industry-Focus Session
Watching
Nanotube: High-Performance Metrics Router
12:45 - 13:30 (GMT+02:00)
14 October 2021
Industry-Focus Session
13:30 - 14:15 (GMT+02:00)
14 October 2021
Industry-Focus Session
14:15 - 15:15 (GMT+02:00)
14 October 2021
Break
15:15 - 16:00 (GMT+02:00)
14 October 2021
Industry-Focus Session
16:00 - 16:45 (GMT+02:00)
14 October 2021
Industry-Focus Session
16:45 - 17:30 (GMT+02:00)
14 October 2021
Industry-Focus Session