Senior Data Engineer

A forward-thinking technology solutions company dedicated to delivering cutting-edge digital transformation services to clients worldwide is seeking an experienced Senior Data Engineer (Azure) to join their high-performing data team.

You will work within a team solving complex problems to deliver real business value across a wide range of industries, you will also be required to develop best practices and drive improvements in data engineering across the business.

To be part of this technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value. Apply now!!!!

Requirements:

• 8+ years of relational SQL database
• Solid understanding of Apache Spark as a distributed data processing framework
• Experience in designing, implementing and performance tuning solutions in Apache Spark
• Experience in complex data warehouse and data lake design
• Experience in building, optimising and managing data pipelines for large and complex datasets
• Experience using Azure cloud data platform technologies:
• Azure storage / Data lake
• Azure SQL database
• Azure data factory
• Azure databricks
• Azure synapse analytics to implement data pipelines and analytical solutions
• Experience in Python would be beneficial
• Experience with streaming technologies such as Spark streaming or Kafka would be beneficial
• A relevant data engineering certification would be beneficial

Reference number for this position is MAT60673 which is a remote permanent position offering a salary of up to R1.1m per annum negotiable on experience and ability. Contact Mavis on az.oc.egrem-e@msivam or call her on 011 463 3633 to discuss this and other opportunities.

Are you ready for a change of scenery? The E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the e-Merge website www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!

Posted on 11 Aug 17:50, Closing date 10 Oct