Operations | Monitoring | ITSM | DevOps | Cloud

Preventing harmful LLM output with automated moderation

Large Language Models (LLMs) can produce impressive text responses, but they’re not immune to generating harmful or disallowed content. If you’re developing an LLM-powered application, you need a reliable way to detect and block risky outputs. Disallowed content – hate speech, explicit descriptions, harmful instructions – can damage your product’s reputation, endanger user safety, and potentially violate legal or platform guidelines.

What Is Cloud Orchestration and Which Tools to Use

Cloud infrastructure management is a complicated task for organizations of all sizes. Infrastructure teams are increasingly asked to improve developer velocity, unlock access to different cloud platforms, and provide comprehensive visibility into cost and performance. Choosing the right cloud orchestration tool reduces the burden on infrastructure teams.
Sponsored Post

System Center 2025 Migration: Preparing for a Smooth Transition

Microsoft System Center has been a cornerstone of enterprise IT management, evolving to meet the dynamic demands of modern IT infrastructures. The release of System Center 2025 represents a significant advancement, introducing new capabilities designed to enhance security, streamline operations, and support hybrid cloud environments. These enhancements address the growing complexity of IT ecosystems, enabling organizations to manage workloads more efficiently and securely across on-premises and cloud environments.

Getting Started with gRPC: A Developer's Guide

Within the realms of microservices and distributed systems, gRPC has emerged as a cornerstone technology. Its adoption by tech giants like Google, Netflix, and Square underscores its capability to facilitate high-performance, scalable inter-service communication. Built as a modern take on the traditional Remote Procedure Call (RPC) paradigm, gRPC enables services, potentially written in different languages, to communicate efficiently and reliably across networks.

Going Green with GPUs: The Role of Sustainability in Cloud Computing

As businesses increasingly transition to cloud-based services, the demand for data center resources has surged, leading to higher electricity consumption. Currently, data centers contribute to about 3% of global carbon emissions and account for roughly 1-1.5% of global electricity demand. As a result, the need for sustainable solutions in cloud computing has never been more urgent.

10 Google Cloud Alternatives Worth Exploring

Over the last few years, Google Cloud has grown at the fastest rate of any cloud service provider today. From 2020 to 2021, Google Cloud’s IaaS offering, GCP, grew 64%, followed by Microsoft Azure (51%) and Alibaba Cloud (42%), according to Gartner. Yet Google Cloud isn’t flawless. Here’s what we mean and some of the top Google Cloud alternatives you’ll want to consider today.

Troubleshooting Java Applications with Coroot

Java applications run on top of the JVM — a powerful but complex runtime environment that re-implements many OS features. It has its own memory management, garbage collector, and dynamic code compiler (JIT). While these features help with performance and portability, they often make troubleshooting a real challenge. At Coroot, we recently improved our support for continuous profiling in JVM-based applications.

What is Ring Deployment? A Guide to Phased Software Rollouts

Exploitation of vulnerabilities increased 180% year over year from 2023 to 2024, which means that quickly and effectively securing endpoints – always a priority – will only continue to escalate. Patching these vulnerabilities promptly, but without sacrificing stability, can present operational challenges. One way to achieve this: ring deployment — a technique that progressively scales rollouts to user groups.

How Choosing The Right DLT Tier Can Reduce Databricks Costs

Databricks is a critical part of many organizations’ tech stacks, facilitating analytics, machine learning, and other leading-edge data engineering tasks. But when a service like Databricks becomes essential, it also tends to become a cost black hole, leading engineering teams to a quandary: How can you keep Databricks costs in check without hurting application performance? At CloudZero, we give organizations unparalleled visibility into their Databricks costs.