Data Engineers (Python, Pyspark)

Job ID
2025-8056
Category
Information Technology
Department
Information Management & Data Governance
Location
Hyderabad

Overview

At Prolifics, we are currently implementing multiple solutions in Software Development, and we are looking to hire talented Data Engineers (Python,pyspark) for our development centre in India. This position would be based out of Hyderabad and is a permanent position.

 

If you are looking for a high growth company with rock-solid stability, if you thrive in the energetic atmosphere of high-profile projects, we want to talk to you today! Let’s connect and explore possibilities of having you onboard the Prolifics team!

 

  • Job Title: Data Engineers (Python,pyspark)
  • Primary skills: experience in Python, PySpark, and building data pipelines
  • Secondary skills: Strong knowledge of ETL frameworks (Airflow, Kafka, Oozie, etc.) and SQL
  • Location: Hyderabad (Mindspace#12B)
  • Educational Qualification: B.Tech/BE/M.Tech/MCA/M.Sc
  • Experience: 8+

 

Job Description:

 

Key Responsibilities:

Develop, optimize, and maintain scalable PySpark data pipelines for batch and real-time processing.

Architect and implement robust ETL processes across multiple tools (Airflow, Kafka, etc.).

Lead end-to-end project delivery, from gathering requirements to deploying production systems.

Manage client relationships and effectively translate business requirements into technical solutions.

Mentor and manage a team of data engineers, ensuring high-quality code and meeting project deadlines.

Implement performance tuning strategies for handling large datasets efficiently.

Collaborate with cross-functional teams (Data Scientists, Analysts, DevOps) to deliver integrated solutions.

Document solutions, maintain high code standards, and contribute to best practices.

Required Skills:

8+ years of experience in Python, PySpark, and building data pipelines.

Strong knowledge of ETL frameworks (Airflow, Kafka, Oozie, etc.) and SQL.

Hands-on experience with cloud platforms (AWS, Azure, GCP) and distributed computing.

Proficient in data modeling, Spark SQL, and working with both structured and semi-structured data (Parquet, JSON, Avro).

Familiarity with CI/CD practices and tools like Git, Jenkins, and Docker.

Strong client management and stakeholder communication skills.

Ability to work independently, manage multiple tasks, and prioritize effectively.

 

About us:

Prolifics Corporation Limited is a Global Technology Solutions Provider with presence across North America (USA and Canada), Europe (UK and Germany), Middle East & Asia. In India, we have offshore development centres: 2 in Hyderabad & 1 in Pune.

 

For more than 40 years, Prolifics has transformed enterprises of all sizes including over 100 Fortune 1000 companies by solving their complex IT challenges. Our clients include Fortune 50 and Fortune 100 companies across a broad range of industries including Financial Services, Insurance, Government, Healthcare, Telecommunications, Manufacturing and Retail. We rank consistently in Dream Companies to Work for and Dream Employer of the Year ranking from World HRD Congress, ranked 7 in 2019.

 

We encourage you to visit us on www.prolifics.com or follow us on Twitter, LinkedIn, Facebook, YouTube and other social media to know more about us.

Options

Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed