VictoriaMetrics Meetup April 2024
Watch the replay of our live Q1 2024 Virtual Meet Up with the following agenda:
- Intro & Warm Up
- What's new in VictoriaMetrics as of Q1 '24
- Long Term Support (LTS) Update
- Anomaly Detection launch & update
- Community News
- AMA session (open mic)
#opensource #timeseries #database #monitoring #anomalydetection #victoriametrics #observability #opentelemetry
Detailed agenda:
What's new in VictoriaMetrics
- New releases
- v1.97 - long-term support (LTS) release
- v1.98 - mTLS authorization in all VictoriaMetrics components
- v1.99 - improved propagation of label filters in MetricsQL queries
- v1.100 - improvements in streaming aggregation and vmauth
- New features
- DataDog integrations
- Accept data from new versions of DataDog agent via DataDog v2 API
- Accept data from DataDog AWS lambda extensions
- OpenTelemetry
- Data ingestion via Amazon Firehose: Accept OTEL metrics from Amazon Firehose
- Prometheus-compatible naming
- -opentelemetry.usePrometheusNaming command-line flag
- Converts metric names and labels into Prometheus-compatible naming in the
- same way as OTEL collector does
- Hetzner service discovery
- Discover scrape targets at Hetzner Cloud and Hetzner Robot
- hetzner_sd_configs
- Per-tenant and per-label downsampling (enterprise feature)
- Individual downsampling configs per distinct sets of tenants
- Individual downsampling configs per distinct sets of time series
- New Graphite query functions
- aggregateSeriesLists
- diffSeriesLists
- multiplySeriesLists
- sumSeriesLists
- mTLS support
- Every VictoriaMetrics Enterprise component verifies client TLS certificates if -mtls command-line flag is set
- Vmauth Enterprise supports mTLS-based request routing
- vmauth: improved request routing
- Host-based request routing
- Query args-based request routing
- Arbitrary header value-based request routing
- vmauth: DNS-based load balancing
- Even load balancing across IP addresses behind a single hostname
- Works great with vminsert and vmselect services
MetricsQL: new functions
- sum_eq_over_time
- sum_gt_over_time
- sum_le_over_time
- count_values_over_time - counts the number of unique sample values over time
- MetricsQL: improved label filters’ propagation
- Stream aggregation improvements
- Reduced memory usage by up to 5x
- De-duplication during data ingestion
- New aggregation functions:
- ○ unique_samples
- ○ increase_prometheus
- ○ total_prometheus
- Ability to drop labels before stream aggregation and de-duplication
- keep_metric_names option
- Performance improvements
- Improve registration speed for new time series by up to 10x
- Reduce memory usage when scraping targets with big number of metrics
- Optimize performance for /api/v1/labels and /api/v1/label/.../values APIs
VictoriaMetrics Long Term Support Updates
- VictoriaMetrics LTS. Status
- 1.93.x LTS will be supported at least until the end of July 2024 for Open Source Version
- 1.97.3+ contains bug fixes for Enterprise Version
- All bug fixes and improvements go to the master branch
- VictoriaMetrics LTS. Why?
- The amount of community support (GitHub issues, Slack, Telegram, StackOverflow questions etc.) overhead increased 4x during the last year
- Reducing test coverage of new releases by the VictoriaMetrics community
- By doing this we hope to get more feedback from the community
- VictoriaMetrics LTS. Your steps
- Update to the latest version of VictoriaMetrics. It contains all bug fixes and improvements/features
- For personal usage, you can request the VictoriaMetrics Enterprise version for free
Anomaly Detection launch & update
- Recap: What is anomaly detection?
- Recap: Why ML & AI for anomaly detection?
- Why VictoriaMetrics Anomaly Detection?
- What’s new: Flexible Configs
- What’s new: AutoTune
- What’s new: Docs & site updates
- Quickstart - minimalistic guide on how to set up and run `vmanomaly` (Docker, Kubernetes)
- Model types - explanations and diagrams to understand specifics of a lifecycle and find the best model for your use case
- AutoTuned model introduction - find out how to set-and-forget the model of your choice to learn from your data
- VictoriaMetrics Anomaly Detection got its own feature page
- Roadmap for 2024
- Streaming models support
- GUI: Deeper integration with anomaly detection service
- Node_exporter preset. Presets for common tasks, like “seasonal_weekly”, “testing”, “autotuned_daily”
- (Q3-Q4) Root Cause Analysis: Drill down your incidents faster and more efficient. Finishing transition from PoC to production.
Community Update & News Q1 Meet Up ‘24
0:00 Intro & Warm Up
4:50 What's New in VictoriaMetrics - Alex
31:27 Long Term Support (LTS) Update - Artem
36:58 VictoriaMetrics Anomaly Detection - Daria & Fred
46:16 Community Updates & News - JJ
55:16 AMA Session