Beam in Production: Lessons learned and best practices (Mike Clarke)
Mike describes gotchas and early struggles Sentry hit moving streaming data pipelines off our laptops and into production. He covers some unexpected Beam defaults, detecting schema errors, compare performance between the python & java SDK, and proactively identifying when production pipelines break due to unexpected data.
Mike Clarke is an engineering manager at Sentry, an open-source error monitoring tool that helps developers ship better software, faster. Mike's passion is bringing Sentry's monitoring solutions to data engineers & data scientists. Connect with Mike and leverage Sentry on your next project.