We’re searching for a talented and experienced Big Data Engineer to join our team in Hyderabad! In this role, you’ll play a critical role in designing, developing, and maintaining our big data infrastructure to extract valuable insights from complex datasets.
Responsibilities:
- Design, develop, and implement scalable data pipelines using technologies like Apache Spark, Hadoop, Kafka, etc.
- Work with various data sources (structured, semi-structured, unstructured) to ingest, transform, and load data into data warehouses and data lakes.
- Develop and maintain data quality checks and ensure data integrity throughout the processing pipeline.
- Collaborate with data analysts and data scientists to understand data requirements and translate them into technical solutions.
- Monitor and optimize big data infrastructure for performance and efficiency.
- Stay up-to-date on the latest advancements in big data technologies and tools.
Qualifications:
- 5-6 years of experience in big data engineering or a related field.
- Strong understanding of big data concepts, distributed computing frameworks, and data warehousing principles.
- Proficiency in programming languages like Python, Java, Scala, and SQL.
- Experience with cloud platforms like AWS, Azure, or GCP (a plus).
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Benefits:
- Competitive salary and benefits package
- Opportunity to work on challenging and impactful projects
- Work in a dynamic and fast-paced environment
- Be part of a team that is passionate about innovation and big data