Lead Data Engineer Job
Pune, IN
YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.
At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.
We are looking forward to hire Python Professionals in the following areas :
Job Description:
Experience Required: 5 - 9 yrs
Senior Lead Data Engineer
Artificial Intelligence and generative AI are taking the world by storm. More and more value is being delivered from data, both internally in companies as well as externally to their customers. The client is at the forefront of this development in their quest to deliver more value to their customers with their digital services offering. The client's common goal is to keep the end users safe and people flow uninterrupted. They move 1 billion people every day and that means their services can really make cities better places to live. Their strategy is to drive a more sustainable world which they believe can be obtained partly by advanced analytics.
The client is now looking for a dynamic Senior Lead Data Engineer to become a valued member of their community of 50+ dedicated Data Scientists and Data Engineers. The open position is within a team whose mission is to make sure that their 24/7 Connected Services customers receive the highest quality maintenance service available.
In this role, you will dive deep into the realm of IoT data, striving not only to predict equipment failures but also to gain a comprehensive understanding of the maintenance processes currently implemented across the 60+ countries where the client operates. Your expertise will be instrumental in delivering actionable insights and innovative ideas aimed at extracting even greater value from client data for the benefit of their customers.
All decisions and recommendations should be backed by data. While doing this, you get to solve challenging problems, experiment with generative AI and predictive analytics, and work with cutting-edge tools offered by client IT. It's worth noting that their team is already responsible for delivering thousands of valuable insights each day to enhance the customer experience, underscoring the significance of your role in handling production workloads in the AWS cloud environment.
The client looking for a senior person who is passionate about writing efficient and maintainable code and enjoys mentoring our talented junior team members. They value the desire for continuous learning and appetite for running production workloads.
An ideal candidate has a strong background in either SW engineering, or data science/data engineering, but above all will to commit to a devops mindset and reach goals together. Sharing knowledge and supporting others comes naturally to you. They have a great community of curious, friendly, and driven individuals, where everyone is treated respectfully. Knowledge sharing and team play are important for them. If such an environment resonates with you please apply for this position so we can learn more about you.
To be considered for this role, you must have:
- Degree in either software engineering, data engineering, data science, computer science, physics, statistics, mathematics, or a related field
- Proficiency in Python and SQL
- Familiarity with testing methodologies, DevOps and MLOps practices
- Experience in running production workloads
- Strong communication and mentoring skills with the ability to work effectively in a team
- Our working environment is multicultural so English is a must
To stand out you could have:
- Experience or interest in developing cloud solutions and using ML/AI tools preferably on AWS and Databricks
- Experience in dashboarding tools, such as Qliksense, Quick Sight, PowerBI, Tableau
- Experience in Spark and Databricks
- Knowledge of our tech stack: AWS Glue, AWS EMR, AWS Athena, Spark, Databricks, Apache Flink, Apache Kafka, Terraform, Gitlab CI
Join us in this exciting journey, where your skills and innovation will play a pivotal role in shaping the future of maintenance services and data-driven excellence.
At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.
Our Hyperlearning workplace is grounded upon four principles
- Flexible work arrangements, Free spirit, and emotional positivity
- Agile self-determination, trust, transparency, and open collaboration
- All Support needed for the realization of business goals,
- Stable employment with a great atmosphere and ethical corporate culture