Senior Data engineer

Boston Consulting group

Bangalore,India

Job Description

About the job

WHAT YOULL DO

YOURE GOOD AT

• Acquiring deep expertise in at least one analytics topic & understanding of all analytics capabilities
• Defining and explaining expected analytics outcome; defining approach selection
• Supporting and enhancing original analysis and insights to case teams, typically owning the maintenance of all or part of an analytics module post implementation.
• Establishing credibility by thought partnering with case teams on analytics topics; drawing conclusions on a range of external and internal issues related to their module
• Communicating analytical insights through sophisticated synthesis and packaging of results (including PPT slides and charts) with consultants, collects, synthesizes, analyses case team learning & inputs into new best practices and methodologies
• Assuring proper sign‐off before uploading materials into internal repository for reference; sanitizing confidential client content in marketing documents
• Able to generate project work for self via connects

• Guides juniors on analytical methodologies and platforms, and helps in quality checks
• Contributes to team’s content & IP development
• Imparts technical trainings to team members, consulting cohort and (If/when required) Client IT team.

• Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
• Enhancing/optimizing and maintaining ETL process(s) across on-premise and cloud architectures
• Monitoring performance and advising any necessary infrastructure changes

• You will be a clear and confident communicator, able to deliver messages in a concise manner with strong and effective written and verbal communication.

• You should be strong in analytical solutioning with hands on experience in advanced analytics delivery, through the entire life cycle of analytics. Strong analytics skills with the ability to develop and codify knowledge and provide analytical advice where required.

YOU BRING (EXPERIENCE & QUALIFICATIONS)

• Bachelors / Masters degree in computer science engineering/technology
• At least 5+ years within relevant domain of Data Engineering across industries and work experience providing analytics solutions in a commercial setting
• Consulting experience will be considered a plus
• Proficient understanding of distributed computing principles
• Management of Spark clusters, with all included services – various implementations of Spark preferred
• Ability to solve ongoing issues with operating the cluster and optimize for efficiency
• Understanding of prevalent cloud ecosystems and its associated services AWS, Azure, Google Cloud, IBM Cloud. Expertise in at least one.
• Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Experience with integration of data from multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Knowledge of various ETL techniques and frameworks, such as Flume
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O
• Good understanding of Lambda Architecture, along with its advantages and drawbacks

YOULL WORK WITH

You will work with the case team and/or client technical and border Gamma Team.

ADDITIONAL INFORMATION