Senior Data Engineer

FactSet

Hyderabad,Telangana, India

Job Description

About the job

About the jobRole/Department Description:The Enterprise Analytics team at FactSet provides actionable insights based on consistent, trusted data through a robust framework of analysis, infrastructure, and visualizations. Our vision is to empower the workforce to make informed decisions that drive value, growth, and efficiency throughout the enterprise.We are currently looking for a candidate with strong background in modern cloud-based serverless development (Azure preferred) with the ability to build and maintain robust, stable and scalable solutions to ingest and store terabytes of data in real-time.As a Senior Data Engineer, you would be responsible for leading the architecture, design and development of the modern cloud-based solutions to ingest, store and process terabytes of data on a real-time basis. At the same time, you would collaborate with a group of other engineers (software/data) to integrate your deliverables with theirs to establish a robust end-to-end solution.Responsibilities:Strong experience as a senior data developer on projects using modern cloud technologies methodologies such as Data Lake, Azure/Lambda functions, Docker/Kubernetes, Distributed systems and or MPP Data Warehouses (Azure Synapse Analytics, AWS Redshift).Experience being responsible for the design of enterprise application solutions of medium to high complexity, including solutions that integrate multiple custom and/or off-the-shelf technologies.Experience creating design artifacts for technical and non-technical audiences.Excellent planning, organization, and leadership skills to estimate, track, and complete deliverables.Influence the team for right design and technology implementation and provide future architectural direction.Provide production support with occasional after-hours availability.Required Skills:Bachelor’s degree, preferably in Computer Science or equivalent professional experience.5+ years proven experience designing and implementing solutions using Azure server less or similar cloud-native architectures.5+ years of experience in Advanced SQL programming working with large data sets.2+ years of hands-on experience on Data bricks Platform2+ years of hands-on experience on Apache SparkHands on experience in cloud architecture, serverless computing, distributed systems, and handling database systems of petabyte scale.Hands on development experience on streaming data and near-real time APIsStrong technical, analytical, troubleshooting, and communication skillsVery strong hands-on experience with C#, Python, SQL and pySpark.Experience building and deploying production level services.Understanding of lake house architecture and data lake query engines like Dremio, Photon etc.One of the following certifications are preferred: Azure Data Engineer Associate (DP 203), Data bricks Certified Associate Developer for Apache Spark, Data bricks Certified Data Engineer Associate