IT Industry News. Daily.
AN award-winning leader in contact centre AI software seeks a passionate Data Engineer with expertise in Kafka pipelines and a thorough understanding of Elastic, looking to contribute to cutting-edge technology and make a difference in the Financial Services industry.
You will design, implement, and maintain robust data pipelines; troubleshoot data pipeline and Elasticsearch issues while ensuring data infrastructure aligns with business needs. The ideal candidate will have proven experience in designing and implementing data pipelines including End-to-End Testing of analytics pipelines & managing and optimising Elasticsearch clusters, including performance tuning and scalability. You will also be proficient with Python, Scala or Java and DevOps.Design, implement, and maintain robust data pipelines, ensuring the efficient and reliable flow of data across systems.Collaborate with cross-functional teams to Extract, Transform, and Load data into Elasticsearch for advanced analytics and search capabilities. Troubleshoot data pipeline and Elasticsearch issues, ensuring the integrity and availability of data for analytics and reporting. Participate in the design and development of data models and schemas to support business requirements. Continuously monitor and optimise data pipeline and Elastic performance to meet growing data demands.Contribute to the evaluation and implementation of new technologies and tools that enhance Data Engineering capabilities. Demonstrate strong analytical, problem-solving, and troubleshooting skills to address data-related challenges. Collaborate effectively with team members and stakeholders to ensure data infrastructure aligns with business needs.Experience with End-to-End Testing of analytics pipelines. Expertise in managing and optimising Elasticsearch clusters, including performance tuning and scalability.Familiarity with data modeling and schema design for efficient data storage and retrieval.Knowledge of DevOps and automation practices related to Data Engineering.Familiarity with ksqlDB / Kafka or other stream processing frameworks.Experience with integrating Machine Learning models into data pipelines.Excellent communication and collaboration skills to work effectively with cross-functional teams.Alignment with company values and a dedication to driving positive change through data. While we would really like to respond to every application, should you not be contacted for this position within 10 working days please consider your application unsuccessful.SA Citizens will be considered for this role. If you are not in the mentioned location of any of the jobs, please note your relocation plans in all applications for jobs and correspondence. Apply here OR e-mail a Word copy of your CV to and mention the reference number of the job.
United Kingdom Latest News, United Kingdom Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Senior Full Stack Data EngineerIT Industry News. Daily.
Read more »
Senior Full Stack Data Engineer - Gauteng JohannesburgIT Industry News. Daily.
Read more »
Senior Data Engineer (Architect)IT Industry News. Daily.
Read more »
Senior Data Engineer (Remote) - Gauteng JohannesburgIT Industry News. Daily.
Read more »
Senior Data Engineer (Remote)IT Industry News. Daily.
Read more »
Senior BI Developer / Software Developer/ Data Engineer - Western Cape Cape Town CBDIT Industry News. Daily.
Read more »