A global media company with content operations spanning 100+ markets is hiring an AWS Data Engineer to build and maintain their content analytics and advertising data platform on AWS. You will design pipelines that process billions of content events daily, enabling editorial, advertising and executive teams to make data-driven decisions. Role & Responsibilities: • Build and maintain data ingestion pipelines using AWS Glue, Kinesis Data Streams and AWS Lambda • Design and optimise Redshift data warehouse schemas for content consumption, advertising performance and subscriber analytics • Implement data lake patterns on S3 using Apache Iceberg or Delta format with Glue catalogue integration • Build PySpark jobs on AWS Glue for large-scale batch transformations across media content metadata • Orchestrate pipelines using Apache Airflow on Amazon MWAA with SLA monitoring and alerting • Implement data quality checks using AWS Deequ or Great Expectations • Optimise Redshift performance: sort keys, distribution styles, WLM configuration and Redshift Spectrum • Collaborate with analytics and ML teams to deliver feature pipelines for recommendation and personalisation models Required Skills & Experience: • 4+ years of data engineering experience with strong AWS focus • Hands-on AWS Glue experience: visual ETL, PySpark jobs, crawlers and Glue catalogue • Proficiency with Amazon Redshift and SQL for large-scale analytical workloads • Experience with S3 data lake design and Iceberg/Delta table format • Python proficiency; PySpark for distributed data processing • Familiarity with Kinesis, Lambda and event-driven data architectures • AWS Certified Data Engineer — Associate or AWS Certified Solutions Architect preferred What We Offer: • Fully remote role based in India on flexible IST hours • Salary ₹30–45L based on experience • Work on data infrastructure powering content that reaches hundreds of millions of viewers • Modern AWS data stack with investment in tooling and engineering quality A strong choice for a data engineer who has AWS Glue and Redshift production experience and wants to apply it at significant scale in the media and entertainment industry.
Remote · India | ₹30–45L