Job Description:

We seek a highly skilled Senior Software Engineer with a strong focus on Data Engineering and Big Data platforms. The ideal candidate will have 6 to 8 years of experience designing, building, and maintaining scalable data solutions to support critical business needs. You will work closely with cross-functional teams to architect,implement, and optimize large-scale data systems while ensuring best practices in data processing and governance.

Key Responsibilities:

• Design and implement large scale data pipelines and data processing systems using big data technologies like Apache Spark, Trino, and Hadoop ecosystem

• Own critical datasets and work on relentless pursuing of goals on data coverage, data freshness, data quality and key performance & SLA metrics goals by data-driven processes and mindset

• Build reusable, extensible systems with strong design principles, enabling new capability and value unlocking from multiple datasets with high agility

• Build high performant and scalable data processing systems that handle current scale needs seamlessly, and serve well for future growth and scale

• Identify, design, and implement process improvements in data flow across multiple stages and via collaboration with multiple cross functional teams e.g. automating manual processes, optimizing data delivery, hand-off processes

• Build engineering systems with strong foundations of scalability, reliability, data governance, security, privacy and compliance.

• Collaborate with product managers, data analysts, data scientists and Sales, Customer Support teams to understand requirements to deliver robust solutions, and support for any troubleshooting and data analytics needs.• Drive continuous improvement by identifying and implementing best practices, tools and processes for development and execution, and champion their adoption

• Help build a team and cultivate innovation by driving cross-collaboration and execution of projects across multiple teams

• Mentor and coach other team members on scalable and extensible solutions design, and coding standards

• Stay updated with the latest advancements in data engineering, cloud technologies, and Big Data ecosystems.

Required Skills and Qualifications:

• 6 to 8 years of experience in Data Engineering, Data Platforms, or a related field.

• Strong data analytical skills and data driven mindset

• Proficiency in Big Data technologies such as Apache Spark, Hadoop, Hive, HBase, or similar.

• Experience with ETL pipelines and data processing frameworks.

• Strong programming skills in languages such as Python, Java, or Scala.

• Hands-on experience with cloud platforms (e.g., AWS, GCP, Azure) and their data solutions (e.g., AWS S3, Redshift, GCP BigQuery).

• In-depth knowledge of SQL and database technologies (e.g., PostgreSQL, MySQL, NoSQL databases).

• Familiarity with data governance, security, and compliance best practices.

• Strong problem-solving skills and a passion for working with complex data sets.