We are seeking a highly skilled Senior Data Engineer, on a permanent basis, with a strong focus on E-commerce. The ideal candidate will have extensive production experience working at consumer E-commerce scale, with a deep understanding of versioned events, queueing, event busses, and data lakes. Key Responsibilities:
Design, build, and maintain scalable data pipelines and systems to support E-commerce operations, ensuring reliability, efficiency, and performance at scale. Implement versioned events, queueing mechanisms, event busses, and data lakes to facilitate real-time data processing, analysis, and insights generation. Collaborate with cross-functional teams to understand business requirements and translate them into effective data engineering solutions. Optimize data processing workflows and infrastructure to handle large volumes of data efficiently, ensuring high availability and low latency. Stay updated on emerging technologies and best practices in data engineering, evaluating and adopting new tools and techniques as needed. Provide technical leadership and mentorship to junior team members, fostering a culture of continuous learning and innovation. Qualifications:
Bachelor's degree in Computer Science, Engineering, or a related field. Advanced degree preferred. Proven track record of success in data engineering roles, with a focus on E-commerce and consumer-scale applications. Extensive experience with versioned events, queueing systems, event busses, and data lakes in a production environment. Strong understanding of distributed systems, data modeling, and performance optimization techniques. Proficiency in working with data serialization formats such as Avro. Familiarity with relational databases, with experience in Postgres considered a plus. Knowledge of stream processing platforms, with experience in Kafka highly desirable. #J-18808-Ljbffr