Sr, D, A?t? N

Description: • Wizard is revolutionizing the shopping experience using generative AI and messaging technologies. • Seeking a Senior Data Engineer to enhance data collection, storage, and analysis capabilities. • This position is critical for strengthening data infrastructure for data-driven decision making and growth initiatives. • Develop and maintain scalable data infrastructure for batch and real-time data processing. • Build and optimize ETL pipelines for efficient data flow and accessibility. • Collaborate with data scientists and cross-functional teams for accurate monitoring and analysis. • Design backend data solutions for microservices architecture, ensuring seamless integration. • Implement and manage integrations with third-party e-commerce platforms. Requirements: • 5+ years of professional experience in software development with a strong focus on data engineering. • Bachelor's degree in Computer Science or a related field, or equivalent practical experience. • Proficiency in Python with experience implementing software engineering best practices. • Strong expertise in building ETL pipelines using tools such as Apache Spark, Databricks, or Hadoop (Spark experience is required). • Solid understanding of distributed computing and data modeling for scalable systems. • Hands-on experience with NoSQL databases like MongoDB, Cassandra, DynamoDB, or CosmosDB. • Proficiency in real-time stream processing systems such as Kafka, AWS Kinesis, or GCP Data Flow. • Experience with Delta Lake, Parquet files, and cloud platforms (AWS, GCP, or Azure). • Familiarity with caching and search technologies such as Redis, Elasticsearch, or Solr. • Knowledge of message queuing systems like RabbitMQ, AWS SQS, or GCP Cloud Tasks. • Advocate for Test-Driven Development (TDD) and experienced in using version control tools like GitHub or Bitbucket. Benefits: Apply Job!