Amazon EMR now supports native data quality checks in Apache Spark jobs

T1Covered by 1 source · first reported by AWS — What's New / News Blog at 12 Oct, 07:00 UTC

Amazon EMR now validates data quality natively within Apache Spark jobs. Data engineering teams can catch quality issues inline before bad data reaches downstream systems, without building or maintaining separate validation infrastructure. Amazon EMR Data Quality, powered by AWS Glue, is available…