Operations | Monitoring | ITSM | DevOps | Cloud

The latest News and Information on Log Management, Log Analytics and related technologies.

Calculating ingest lag and storing ingest time in Elasticsearch to improve observability

When viewing and analysing data with Elasticsearch, it is not uncommon to see visualizations and monitoring and alerting solutions that make use of timestamps that have been generated on remote/monitored systems. However, using remote-generated timestamps may be risky.

Benefits of Cloud-Based Log Monitoring

Most of the IT industry is floating on the cloud these days. From hosting websites to storing data, organizations have started to use the cloud for various purposes, so why not for log monitoring? In this blog, I’ll explain how cloud-based log monitoring is beneficial for you and how you can use SolarWinds® Papertrail™ for it.

Logstash Grok Tutorial with Examples

Logstash can parse CSV and JSON files easily, but that’s because data in those formats are perfectly organized and ready for Elasticsearch analysis. Sometimes, though, we need to work with unstructured data, like plain-text logs for example. In these cases, we’ll need to parse the data to make it structured data using Logstash Grok. This tutorial will enable you to take full advantage of Elasticsearch’s analysis and querying capabilities by parsing with Logstash Grok.

Shipping AWS Lambda Metrics to Logz.io

Serverless computing has taken off in recent years with more efficient cloud services. AWS Lambda is a great example of this, where provisioning and management of resources happens from the service’s end. You only have to deal with the code. This article will give a brief overview of AWS Lambda in contrast to EC2 instances, then walk through shipping AWS Lambda metrics to Logz.io.

Linux Logging Tutorial: What Are Linux Logs, How to View, Search and Centralize Them

TL;DR note: if you want the bzip2 -9 version of this post, scroll down to the very last section for some quick pointers. If you want to learn a bit about Linux system logs, please continue, as we’ll talk about all these and more.

The 7 Essential Metrics for Amazon EC2 Monitoring

Amazon EC2 offers a flexible and convenient way to run virtual machines in the cloud. With dozens of EC2 instance types available, as well as multiple pricing options, it’s easy to use EC2 to configure the best cloud-based virtual machines for your needs and budget. One thing that EC2 doesn’t make very easy on its own, however, is monitoring.

IBM Log Analysis with LogDNA

IBM Log Analysis with LogDNA enables you to quickly find the source of issues and gain deeper insight into application and cloud environment data. Easily aggregate and search application, and server logs within a single platform. Forward logs from IBM Cloud Kubernetes clusters, servers, and applications in as little as three steps. IBM Log Analysis with LogDNA is trusted by teams like IBM Cloud, The Weather Company, and IBM Watson.