Kafka Developer
Accenture is changing the world through advanced cloud-native solutions. They are seeking a talented and experienced Kafka developer to design, develop, and maintain real-time data streaming pipelines using Apache Kafka.
Responsibilities
- Design and development: Create and maintain high-throughput, low-latency data streaming applications and pipelines using Kafka
- Cluster Management: Set up, configure, and manage Kafka clusters, topics, and brokers to ensure high availability and scalability
- Integration: Connect Kafka with other data sources, systems, and processing frameworks using tools like Kafka Connect
- Performance Optimization: Monitor, tune, and optimize cluster performance to meet business requirements
- Troubleshooting: Diagnose and resolve issues related to Kafka applications, performance, and reliability
- Security: Implement and maintain security best practices for data integrity and confidentiality within Kafka ecosystems
- Collaboration: Work with cross-functional teams (e.g., software engineers, DevOps) to align on technical requirements and deliver solutions
Skills
- Bachelor's degree or equivalent (minimum 12 years work experience). If Associate's Degree, must have equivalent minimum 6 years work experience
- A minimum of one year of experience in Core Kafka, deep knowledge of Kafka architecture, features, and components like Kafka Streams, ZooKeeper, and Schema Registry
- A minimum of one year of experience in programming, proficiency in languages like Java or Scala for developing Kafka-based applications and microservices
- Experience in databases and data warehousing with related technologies like PostgreSQL, Elasticsearch, or Snowflake can be beneficial
- Experience in understanding of distributed computing principles and how to build fault-tolerant systems
- Experience in Kubernetes
- Experience in Cloud Platform and cloud services is a plus, especially for roles involving AWS or other cloud-native solutions
Company Overview