Azure Data Engineer

Salary: £60,000-£75,000 (D.O.E)
Location: Manchester - Hybrid: 2 Days a week in the office Minimum
Type: Permanent

*Must already be eligible to work in the UK and not Dependent on sponsorship*

*Previous recent contracting experience will unfortunately not be considered*

Are you a seasoned Data Engineer passionate about designing, optimizing, and maintaining AI-native data processing pipelines? We are looking for an individual who excels in tackling complex challenges with robust data pipelines from diverse sources, enhancing data quality, and preparing for the challenges of scale.

Key Responsibilities:

• Data Security:
  • Ensure secure handling of data through end-to-end encryption, data isolation, and adherence to best practices for data protection.
• Data Processing & Indexing:
  • Design and implement robust data processing and indexing pipelines that handle large volumes of data across various modalities.
  • Ensure these pipelines are resilient, efficient, and timely.
• Data Ingestion & Management:
  • Curate and manage large-scale data ingestion and indexing pipelines.
  • Focus on maintaining high data quality and implementing effective error handling mechanisms.
• Cloud & Data Infrastructure:
  • Oversee cloud orchestration and data infrastructure.
  • Apply your expertise in various data processing and indexing tools to ensure scalability, reliability, and performance.

Requirements:

• Technical Proficiency:

  • Strong programming and engineering skills, particularly in Python.
  • Proficiency with MS Azure.
  • Experience with data infrastructure tools, including SQL, NoSQL databases, inverted indexes, and vector databases.

• Experience with Scaling:

  • Proven track record of successfully scaling data pipelines to handle large volumes of data continuously.
  • Expertise in managing and optimizing large-scale data pipelines.

Additional Skills & Qualifications:

• Analytical & Problem-Solving:

  • Strong analytical skills and the ability to tackle complex data challenges.
  • Experience with AI and machine learning frameworks is a plus.

• Collaborative Mindset:

  • Ability to work effectively in a hybrid environment, collaborating with teams both on-site and remotely.
  • Excellent communication skills for conveying complex technical concepts to non-technical stakeholders.

• Continuous Improvement:

  • Commitment to continuous improvement and staying updated with the latest industry trends and technologies.
  • Proactive in identifying opportunities for enhancing data processes and systems.

• Innovative Environment:
  • Be part of a forward-thinking team that embraces cutting-edge technology and innovative approaches to data engineering.
• Career Growth:
  • Opportunities for professional development and career advancement within a dynamic and growing organization.
• Competitive Benefits:
  • Competitive salary and comprehensive benefits package.
  • Flexible working arrangements with a hybrid work model to support work-life balance.

Ready to Take the Next Step?

If you are a skilled Data Engineer with a passion for AI-native data processing and a knack for managing large-scale data pipelines, I'd want to hear from you.