Sr. Software Engineer - PySpark Job

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire PySpark Professionals in the following areas :

Job description:

Role: Data Engineer.

Roles and Responsibilities
• Design, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala).
• Build data ingestion and transformation frameworks for structured and unstructured data sources.
• Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver reliable data solutions.
• Work with large volumes of data and ensure quality, integrity, and consistency.
• Optimize data workflows for performance, scalability, and cost efficiency on cloud platforms (Preferably Azure).
• Implement data quality checks and automation for ETL/ELT pipelines.
• Monitor and troubleshoot data issues in production and perform root cause analysis.
• Document technical processes, system designs, and operational procedures.

Must-Have Skills
• 5+ years of experience as a Data Engineer or similar role.
• Hands-on experience with PySpark or Spark using Scala.
• Strong knowledge of SQL for data querying and transformation.
• Experience working with any cloud platform (Preferably Azure).
• Solid understanding of data warehousing concepts and big data architecture.
• Experience with version control systems like Git.

Experience : Min 5 years

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture