Follow the latest coverage, related explainers and connected technology stories.
Cloudflare has added the Transformers feature to Logpush, enabling logs to be filtered, sensitive data to be redacted, and fields to be reshaped using SQL before they are sent to SIEM systems, analytics platforms, and storage. The feature is based on Apache DataFusion and Apache Arrow and is available on all Cloudflare plans, from Free to Enterprise.
AWS announced the general availability of AWS Glue 6.0, with prices reduced by 30% compared with previous versions and full support for Apache Iceberg v3 capabilities. The release is based on Apache Spark 4.1, Python 3.12, and Scala 2.13, and adds improvements for semi-structured data processing, PySpark function development, and single-digit-millisecond-latency streaming.