Data Engineer

About the role

Capitec is hiring a Data Engineer, based in Stellenbosch. Infrastructure & DevOps - CI/CD pipeline deployment and environment management across Dev, Test and Prod Data Engineering Support - data model design, transformation logic, architecture standards, technical debt management and stakeholder coordination

Responsibilities

• Design, build and maintain robust, scalable and efficient data pipelines and systems that meet the team's data environment need
• Analyse business and system requirements to build and enhance data platforms
• Provide input to the Data Architect on solution design for new and existing data flows
• Contribute to the design and development of new applications and systems
• Support and maintain data infrastructure to keep it reliable and efficient

Requirements

• Knowledge
• Basic SQL and modelling principles
• Familiarity with batch processing concepts and a basic understanding of stream processing
• Proficiency in at least one programming language (Python preferred) - with knowledge of basic data structures
• Understanding of ETL concepts - able to make minor modifications to established pipelines
• Basic knowledge of cloud services - storage and compute (AWS advantageous)
• Ability to identify simple performance issues and basic query optimisation
• Basics of version control and CI/CD principles
• Basic knowledge of containerisation concepts
• Awareness of infrastructure as code principles (Terraform or AWS CloudFormation advantageous)
• Minimum Experience
• Bachelor's degree in Computer Science, Information Technology or a related field, PLUS at least 3-5yrs relevant experience
• Experience in an entry-level data engineering role
• Experience in projects involving data collection, processing and analysis
• Advantageous
• Exposure to AWS data services - Amazon S3, AWS Glue, Amazon Redshift, Amazon Athena or AWS Lambda
• Familiarity with PySpark or similar big data processing tools
• Exposure to DataOps or DevOps practices
• What the team values
• Strong analytical and problem-solving skills
• Curiosity and a drive to keep learning
• Collaboration with business and technical teams
• Innovation and automation
• Data accuracy, governance and compliance
• Delivering business value through insights
• Education (Minimum)
• Grade 12 National Certificate / Vocational
• Bachelor's Degree in Information Technology or Other
• Education (Ideal or Preferred)
• Honours Degree in Information Technology - Computer Science or Other