Big Data Hadoop Developers - Mid-Senior level

Tata Consultancy Services

Chennai,Tamil Nadu, India

Job Description

About the job

Big Data Hadoop Developers

Roles and Responsibilities

Interacting with IT Business Analysts and / or our business partners to acquire the information necessary for product design.

Following written requirements to help design databases and develop dashboards to support our customers.

Translating raw data from multiple sources (ETL) into a single dataset at aggregate levels necessary to meet project needs.

Suggesting alternative ways to group, filter and sort aggregated data for optimal presentation and performance possibilities.

Providing front-line production support by analyzing customer questions, evaluating data sets to explain end results or quickly adjust processes based on consumer demands.

Working independently and with groups while engaging in multiple initiatives simultaneously in a fast paced IT environment.

Desired Candidate Profile

Strong Knowledge on Spark, Scala, Python, PySpark • Strong in SQL concepts • Good Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume.

Knowledge on Hive Query Language with performance aspects.

Experience in Version Control tools like SVN, GITHUB as well as experiences in Production deployment process.

Batch processing in Hadoop Ecosystem.

Hands-on development with AWS services: Glue, Lake Formation, S3, DynamoDB, SQS, SNS, Aurora, Lambda, Step Functions, API Gateway, IAM, CloudWatch, Kinesis, ElasticSearch, Airflow, EventBridge, Grafana

Basic knowledge in below skill sets:

SQL Server

SQL Server l Scripting

Data Warehousing concept

Relevant Experience : 5+ yrs

Location : Pan India