Job description:

About HCLTech
HCLTech is a global technology company, spread across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. We re powered by our people a global, diverse, multi-generational talent - representing 161 nationalities whose unique spark, perspective and boundless passion drive our culture of proactive value creation and problem-solving.
Our purpose is to bring together the best of technology and our people to supercharge progress for everyone, everywhere our clients, partners, their stakeholders, communities, and the planet. As a company, we are deeply focused on accelerating our ESG agenda. We are also creating technology-enabled sustainable solutions with and for our clients and partners. We embed ESG imperatives into every aspect of our business and ensure that the progress we supercharge is responsible, inclusive and beneficial to all our stakeholders in the long term. We have committed to achieving net zero by 2040.

To learn more about how we can supercharge progress for you, visit www.hcltech.com

Technical Specialist with apache spark,scala,python

Job Summary
This role involves working as a Technical Specialist with expertise in apache spark, scala, and python. The primary responsibilities include developing, implementing, and maintaining data pipelines, performing data analysis, and ensuring the scalability and efficiency of data processing tasks using apache spark and related technologies.

• Key Responsibilities
  1. Develop and implement data processing applications using apache spark, scala, and python.
  2. Design and maintain scalable data pipelines to process large volumes of data efficiently.
  3. Perform data analysis and optimization to enhance the performance of data processing tasks.
  4. Collaborate with cross functional teams to understand business requirements and translate them into technical solutions.
  5. Troubleshoot and resolve issues related to data processing and data quality.
  6. Stay updated with the latest advancements in apache spark, scala, and python to continuously improve data processing capabilities.
  
  Skill Requirements
  1. Proficiency in apache spark for big data processing and analytics.
  2. Strong programming skills in scala for developing scalable applications.
  3. Advanced knowledge of python programming for data manipulation and analysis.
  4. Experience with data processing frameworks and tools in the apache spark ecosystem.
  5. Understanding of distributed computing principles and parallel data processing.
  6. Excellent problem-solving skills and ability to work in a fast paced environment.
  7. Strong communication skills and ability to collaborate effectively with team members.