Advertise your job vacancies
Subscribe to email job alerts
Recruitment news
LAC deems subjective assessments 'unfair' in retrenchment process
Chloë Loubser, Mbali Mnyandu, and Josua Loots
Data Engineer - Azure
Location: | Johannesburg |
Type: | Permanent |
Reference: | #NG59096 |
Company: | E-Merge IT Recruitment |
A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of data science, data engineering and software engineering have an opening for an Azure Data Engineer to help develop best practices and drive improvements in data engineering across the business and across a wide range of industries such as mining, telco’s, retail and financial services.
Responsibilities:
- Analyse and organise raw data
- Design data engineering solutions to meet business requirements
- Build scalable data pipelines that clean, transform and aggregate data from different sources using appropriate tools and technologies
- Collaborate with data scientists to prepare data sets for analytical modelling
- Identify ways to enhance data quality and reliability
- Manage technical delivery of projects
- Mentor junior data engineers
- Graduate or postgraduate degree in computer science, information technology, statistics, engineering or related technical field.
- 2-6 years of relational SQL database
- Solid understanding of Apache Spark as a distributed data processing framework
- Experience in designing, implementing and performance tuning solutions in Apache Spark
- Experience in complex data warehouse and data lake design
- Experience in building, optimising and managing data pipelines for large and complex datasets
- Experience in Azure Storage / Data Lake, Azure SQL Database, Azure Data Factory, Azure Data bricks, Azure Synapse Analytics to implement data pipelines and analytical solutions
- Experience in Python would be beneficial
Are you ready for a change of scenery? E-Merge IT recruitment is a niche recruitment agency. We offer our candidates options so that we can successfully place the right people with the right companies, in the right roles. Check out the E-Merge IT website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals
Posted on 15 Aug 14:14, Closing date 14 Oct