Data Engineer (4-7 Years)

Software Development | Job ID:DSC/Dat/080222/654

Posted: Jun 15, 2022

Updated 2 weeks ago

Senior Manager- Data Engineering

Job Purpose– As an Associate  Data Engineer, Working on data engineering projects, you’ll be responsible for creating robust programs and algorithms that scalably process big data using distributed computing.


  • Propose, Develop & implement best in class, high-performance architectural solutions for a BI Data Platform on cloud infrastructure
  • Define and create system architecture design specifications, data mapping and data transformation rules
  • Develop innovative approaches on performance optimization & automation
  • Analyzing enterprise specifics to understand current-state data schema and data model and contribute to define future-state data schema, data normalization and schema integration as required by the project
  • Ensure data mapping, data quality and data validation specifications & standards and data cleansing/data scrubbing techniques adhered to consistently
  • Understanding business objectives and develop business intelligence applications that help to monitor & improve critical business metrics
  • Improve key organizational metrics by collaborating with data scientists, operations & application development teams to understand, and resolve critical business challenges by driving better visibility into data
  • Perform transformations on big data and automate due diligence on data quality
  • Collaborate with the Operations, Network, Control Tower and Business Analysis team to develop cutting edge analytics solutions that improve the business
  • Maintain thorough and comprehensive documentation of data schema, data models, architecture, etc.
  • Develop robust work products by following best practices through all stages of development, testing & deployment


  • BE/Tech in in Engineering, Masters/PhD candidates preferred
  • Proficient in Python, Java & R, with sound knowledge of OOPS concepts
  • 7-10 years of experience in building large scale distributed enterprise applications using big data technologies such as Spark & Hadoop
  • High level of proficiency in querying & processing data with Spark, Hive, Pig, SQL, etc.
  • Experience with caching and queueing technologies – Kafka/Kinesis, Rabbitmq/SQS, Redis/Memcache etc.
  • Extensive experience solving analytical problems using quantitative approaches for large datasets
  • Hands on experience of developing high performing scalable Platform architecture using Public cloud like AWS & Azure
  • Hands on experience working with various database technologies such as, HBase, MongoDB, Neo4j, Cassandra, etc.
  • Working experience of a variety of cloud products and services (e.g. Amazon EC2, Amazon S3, Amazon DynamoDB, Amazon Redshift, Amazon CloudFront, Amazon EMR and/or Azure equivalent)
  • Knowledge of data visualization tools & technologies such as Power BI, Tableau, d3.js, etc.
  • Data Modeling (logical/Physical), ETL Routines
  • Highly motivated and innovative in approach
  • Should be people oriented and should have previously led teams
  • Excellent communication skills and ability to effectively manage stakeholders Experience with REST APIs, Python Django/Flask
  • Familiarity with Machine Learning and Artificial Intelligence Approaches would be preferred

We are an Equal Opportunity Employer. We source, hire, train, promote, compensate & nurture employees based on their ability to do their job, disregarding other factors i.e., Gender, Race, Ethnicity, Religion, Marital status, Physical Disability and Sexual orientation.

Apply for this job


Software Development

Experience Required

4-7 Years


BE/Tech in in Engineering, Masters/PhD candidates preferred



Employment Type

Full time

Track your Order Post your Query Call us on: +91-8376888888