Data Engineer
Tata Cliq
Ex. 5-8 years of relevant exp
Full Time
Bangalore,India
Job Description
About the job
Tata CLiQ is the flagship digital commerce initiative of the Tata Group. It is a multi-category e-commerce platform, operating across categories such as Fashion, Footwear and Accessories, Electronics, and Luxury. It has a unique omnichannel marketplace model offering customers the convenience of quicker delivery (by shipping from store), easy pick-up and returns, across 1,200+ brands and 1,000 stores in 100+ Indian towns and cities. It is also Indias definitive destination for exclusive Fashion and Electronics brands.
At CLiQ:
• We obsess over customer delight.
• We are out there to find an alternate way of doing e-commerce.
• We carry an attitude to develop a culture of learning and continuous improvement, both for people and processes.
• We believe in Uncomfortable Transparency.
• We will always be respectful, empathetic, and caring about the well-being of our teams.
• we encourage experiments and creativity in Technology.
• We develop and use technology to enhance day-to-day life and have a positive impact on customers.
• We encourage experiments and creativity in Technology.
We are committed to strengthening diversity, equity, and inclusion at the workplace through an enabling environment, supportive work-life policies for employees, and a culture that welcomes differences and creates a sense of belonging. We strive to create a work environment where all employees can develop and grow to achieve their full potential. We are an equal opportunity employer and are committed to maintaining respect and dignity for allâ€
About the Team
The MLDS (Machine Learning and Data Science) team works in building scalable, cloud native, distributed data platforms. Pioneering work is done in cutting-edge technologies like AWS EMR, Sagemaker, Spark, Kinesis/ Kafka streaming, HANA, etc to build AI products for Recommendation, Personalisation, Fraud Detection, Search, etc..
Job Description
The “Lead Data Engineer (Data Solution Architect)†position will be the key to the success of our Data products development program. It is expected that the successful candidate will bring significant technical prowess to help build highly scalable, efficient, and cost-effective Data products. Work closely with data scientists, product managers, data platform team to understand the functional data requirements and build architectures and high-level designs with AWS “Analytics†stack to come up with scalable, robust data applications which can crunch terabytes of data in real-time.
Responsibilities
· Consult, Design, build and operationalize large scale enterprise data solutions using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake and Databricks.
· Analyse, re-architect and re-platform on-premises data stores/ Databases to modern data platforms on AWS cloud using AWS or 3rd party services.
· Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala.
· Design and optimize data models on AWS Cloud using AWS data stores such as Redshift, DynamoDB, RDS, S3
· Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
· Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud as part of customer consultation and business proposals.
· Participate in client design workshops and provide trade-offs and recommendations towards building solutions.
· Mentor other engineers in coding best practices and problem solving
Technical Competencies
· Experience and knowledge of Big Data Architectures, on cloud and on premise
· Proficiency in AWS Collection Services: Kinesis, Kafka, Database Migration Service
· Proficiency in AWS main Storage Service: S3, EBS, EFS
· Proficiency in AWS main Compute Service: EC2, Lambda, ECS, EKS
· Proven experience in: Java, Scala, Python, and shell scripting
· Working experience with: AWS Athena and Glue Pyspark, EMR, DynamoDB, Redshift, Kinesis, Lambda, Apache Spark, Databricks on AWS, Snowflake on AWS
· Proficient in AWS Redshift, S3, Glue, Athena, DynamoDB
· AWS Certification: AWS Certified Solutions Architect and/or AWS Certified Data Analytics
· Working experience with Agile Methodology and Kanban
· Good knowledge of SQL
· Experience in building and delivering proofs-of-concept, to address specific business needs, using the most appropriate techniques, data sources and technologies
· Working experience in migrating workloads from on premise to cloud environment
· Experience in monitoring distributed infrastructure, using AWS tools or open-source ones such as CloudWatch, Prometheus, and the ELK stack would be big advantage
Skills and Qualifications
· Should have worked on e-Commerce data products development projects, preferably, with one of top e-Marketplace players
· Computer science/ IT grad from tier-I/ II institutes
· 5-8 years of relevant exp
· AWS “Solution architect†certification
The opportunities we have are perfect for highly motivated and talented candidates.
We are looking for candidates who have a strong passion for customers, a high level of comfort with uncomfortable transparency, and a keen sense of ownership and drive to deliver results.
So QUiQ - PiQ – CliQ before the opportunity is missed.
Other Jobs
Associate Data Engineer
Uplers
Ex: 3+ year
Full Time
Hyderabad,Telangana, India
Data Engineer
Posted : 29-Dec-2022
Data Engineer
Uplers
Ex: 3 + year
Full Time
Guwahati,Assam, India
Mid-Senior level
Posted : 19-Dec-2022
Senior Data Engineer - (BI)
Motor Vehicle Manufacturing
Ex: 6+
Full Time
Trivandrum,Kerala, India
Motor Vehicle Manufacturing
Posted : 24-Nov-2022
