top of page

Data Engineer - AWS

  • The Data Engineer is responsible for developing data pipeline and data engineering components to support strategic initiatives and ongoing business processes for customers.

  • This role works with leads, analysts, and data producers/consumers to understand requirements, develop technical solutions, and ensure the reliability and performance of the data engineering solutions.

  • Focus on scalability, performance, service robustness, and cost trade-offs

  • Continuous drive to explore, improve, enhance, automate, and optimise systems and tools to best meet evolving business and market needs

  • Attention to detail, coupled with ability to think abstractly

  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

  • Create prototypes and proof-of-concepts for iterative development

  • Keen to learn new technologies and apply the knowledge in production systems

  • Take complete ownership of projects and their development cycle

  • Experience with big data tools like Hadoop, Spark, Kafka, fink, Hive, Sqoop etc.

  • Experience with relational SQL and NoSQL databases like Mysql, Postgres, Mongodb and Cassandra.

  • Experience with data pipeline tools like Airflow, etc.

  • Experience with AWS cloud services like: EC2, S3, EMR, RDS, Redshift, BigQuery

  • Experience with stream-processing systems like: Storm, Spark-Streaming, Flink etc.

  • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

  • Strong communication and inter-personal skills

  • 7+ years

  • Bachelor / Master in Engineering, Computer Science , MCA,MCS

bottom of page