PW (PhysicsWallah) is a leading ed-tech platform in India, revolutionizing education by making learning accessible and affordable for millions of students. With a mission to empower learners through innovative technology and quality content, PW has become a trusted name in the education sector. Headquartered in India, PW operates with a focus on building robust technological solutions to enhance the learning experience and support its expansive community of students and educators.
Join PW to be part of a dynamic team that solves real-world challenges in education through cutting-edge data engineering. Work in a collaborative environment where your contributions directly impact the scalability and efficiency of educational tools and platforms used by millions.
💼 Role Overview: Data Engineer SDE-1
📍 Location: Bengaluru, Karnataka, India (On-site, also available in Noida)
🕒 Experience: Entry-Level (SDE-1, relevant experience expected)
📱 Tech Stack: Python, Scala, Spark, AWS, SQL, NoSQL, Airflow, Kubernetes, EMR
🧠 Role Type: Full-Time, Individual Contributor
🔧 What You’ll Do
- Develop ETL (Extract, Transform, Load) processes to move and transform data between systems
- Integrate data from various sources, ensuring consistency and accuracy across platforms
- Monitor system performance and identify areas for optimization to enhance efficiency
- Align architecture with business requirements to provide solutions that solve key business problems
- Build infrastructure for optimal ETL pipelines using SQL and AWS big data technologies
- Evaluate and recommend new technologies to improve data processing capabilities
- Collaborate with data scientists, analysts, and stakeholders to meet diverse data needs
- Use programming languages (Python, Spark) to collate data and discover automation opportunities
- Improve data reliability, efficiency, and quality through innovative approaches
📚 What You’ll Need
- Ability to develop ETL processes for data movement and transformation between systems
- Hands-on experience in coding with Python or Scala
- Good understanding of data engineering concepts like data warehousing, data lakes, data modeling, and streaming data
- Strong grasp of cloud-based ecosystems, with AWS experience preferred
- Knowledge of data pipeline orchestration tools like Airflow (preferred) or Azkaban
- Experience with Spark, EMR, and Kubernetes clusters for data processing
- Proficiency in writing Spark jobs, shell scripts, and optimized data pipelines
- Familiarity with relational SQL (Postgres, Amazon Redshift) and NoSQL databases (MongoDB)
- Understanding of OOPS-based data platforms and backend APIs with their use cases
🚀 Why PW (PhysicsWallah)?
- Join a leading ed-tech platform transforming education for millions of students in India
- Work on impactful data engineering projects that enhance learning experiences at scale
- Collaborate with a passionate team of data scientists, analysts, and educators to solve real-world challenges
- Be part of an innovative environment focused on leveraging technology for accessible education
- Gain hands-on experience with cutting-edge tools like AWS, Spark, and Kubernetes
- Contribute to a mission-driven organization empowering learners through quality and affordability
📩 How to Apply
Data Engineer – Job Application Form
