Data Engineer
iKhokha
uMhlanga, KZN, South Africa
Salary not specified - Full-time
Job Description
About the Role
Love data, solving problems and building things that make a difference? We’re looking for a passionate Data Engineer to turn raw data into powerful insights, smart solutions and real business impact.
Responsibilities
- If Python, SQL, cloud platforms and tackling complex data challenges excite you, your next data adventure starts here!
- Minimum 3-5 years’ experience in a Data Engineering role with the following:
- You’ll enable data-driven decision-making by building and maintaining the infrastructure and tools needed to collect, organise, process and store large volumes of data.
- You’ll collaborate with Data Scientists, Data Analysts and key stakeholders to understand their data needs and turn them into effective, scalable solutions. While using your strong technical expertise and passion for all things data.
- Design, develop, and maintain data pipelines, ensuring efficient and reliable data processing, transformation, and storage.
- Integrate data from various sources, both internal and external, ensuring data quality and integrity.
- Optimise data infrastructure and pipelines for scalability, performance, and cost-effectiveness.
- Collaborate with data scientists and analysts to understand their data requirements and assist in the design and implementation of data models and structures.
- Collaborate with cross-functional teams to define data requirements, develop data solutions, and support data-driven decision-making.
- Stay updated with industry trends and emerging technologies in data engineering and recommend innovative solutions to enhance our data infrastructure and processes.
- Document and maintain technical specifications, system configurations, and data flow diagrams.
- Implement and monitor data governance and security measures to ensure data privacy and compliance with relevant regulations.
- Troubleshoot and resolve issues related to data processing, pipeline performance, and data quality.
- BSc Computer Science / BCom / IT related Degree.
- Relevant certification(s) in Data Engineering or a related field.
- Experience working directly with Data teams (Including Data Analysts, Data Scientists and Product Managers).
- A good exposure to various business functions as well as excellent understanding of Database’s, ETL, Python and SQL.
- Solid Experience working in cloud Platforms (Snowflake /Azure / AWS), data modelling (Kimball), ETL, Data integration and API’s as well as good experience in developing in Python.
- Has worked previously in a data warehouse environment as well as knowledge of the Data Engineering landscape.
- Good Quality Assurance experience in testing Specifications and Data Integrity.
- Good understanding of the data engineering and analytics landscape, how SLDC works in a Data driven environment as well as how various functional areas within a business work: Sales, Marketing, Finance, HR, Logistics, Operations and Product.
- Experience in infrastructure as Code (IaC) would be advantageous and specifically Pulumi.
- Previous industry experience in financial services and / or Data Engineering | analytics environment would be an advantage.
- Some Understanding and exposure to Data management principles such as general Knowledge of the DMBOK framework would be advantageous.
- A good understanding of how card transactions and the online payment industry works as well as data and product management domain.
- Data Quality and Governance must be at the top of the agenda as well as attention to detail and quality.
- Knowledge of Agile Scrum development principles and methodologies, (Scrum / Kanban).
- Participation and active engagement in the defined internal processes, (SDLC).
- Work in a high-growth company with tangible results you're accountable for.
- Enjoy hybrid, remote, and in-office work models.
- Competitive remuneration and benefits, including reduced Gap cover rates. Medical Aid and Group Risk scheme contributions.
- Visionary leadership.
- Seize the opportunity for study leave.
- Access to on-demand learning at your fingertips.
- Experience a friendly, collaborative culture with a team of all-round-lekker humans (it’s true, we surveyed our Employees and they told us so).
- If you find yourself at HQ, coffee on tap and a selection of hot beverages provided by our very own onsite Barista.
