Sr. Software Engineer - Data Engineering Job

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire Data Engineering Professionals in the following areas :

Experience required- 4 to 6

Job description-

Primary Skillsets: AWS services (EC2, Lambda, Athena, Ste function), build ETL/ELT workflows using Python, PySpark scripting, SQL, AWS Databricks,

Secondary Skillsets: React; Database; GitHub Actions; Terraform. Also, should have worked in an Agile environment (User Stories/Features and following all Agile Rituals/meetings)

1. Design, develop, and maintain scalable data pipelines using AWS services, including EC2, Lambda, Step Function, and Athena

2. Maintain EC2 instances with auto-scaling policies, implement and manage IAM roles, policies, and security in the AWS application

3. Strong in Python scripting, list comprehensions and generators, String manipulation and formatting, Data structures (lists, dictionaries, sets, tuples), File I/O operations and various exception handling scenarios

4. AWS Lambda: Function development, event-driven architecture, different trigger types (S3, DynamoDB, API Gateway, EventBridge, SQS, SNS, CloudWatch)

5. AWS Step Functions is like Workflow orchestration, state machines, and error handling. Also strong in EC2 Instance types, auto-scaling groups, launch configurations/templates, scaling policies (target tracking, step scaling, scheduled.

6. Worked with AWS Databricks to build and maintain data lake house architectures, notebook pipeline execution, optimisation, troubleshoot and resolve data pipeline issues.

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture