Data Streaming Engineer
Logifuture
- Ta' Xbiex, Malta Island
- €55,000-65,000 per year
- Permanent
- Full-time
- Design and implement scalable data streaming solutions using Apache Kafka, with a focus on on-prem deployments.
- Develop and maintain event-driven architectures and streaming ETL processes, integrating Apache Spark or Apache Flink for advanced data processing and analytics.
- Optimize on-prem data streaming solutions for performance, reliability, and scalability.
- Establish robust support and maintenance protocols for our on-prem data streaming infrastructure.
- Lead efforts in securing data, implementing encryption and compliance measures for on-prem data processing.
- Troubleshoot and resolve issues in the data streaming architecture, providing expert guidance and technical support.
- Continuously evaluate new technologies and tools in the streaming ETL and data processing space to enhance our system capabilities.
- Facilitate knowledge sharing and ensure best practices are followed in the design and implementation of on-prem data streaming solutions.
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Proven experience with Apache Kafka, event sourcing, and streaming ETL technologies, specifically tailored to on-prem deployments.
- Strong programming skills in Java, Scala, or Python.
- Good to have: Experience with Apache Spark or Apache Flink for data processing - candidates with this experience will be given preference.
- Demonstrated capability in designing and supporting on-prem data streaming architectures, including performance optimization and troubleshooting.
- Deep understanding of data security, encryption, and compliance frameworks relevant to on-prem data processing.
- Exceptional problem-solving skills, along with effective communication and project management abilities.
- Vibrant modern office space.
- Remote work arrangements.
- Bi-monthly company wide social and team building activities.
- Lunch vouchers.
- Support in personal and professional growth.
- Pension scheme.
- Private medical and dental insurance coverage for employees + dependents.