49 Data Engineer jobs in Qatar

Experience : 5+ yrs

Job Description:

We seek a talented Data Engineer with AI & ML knowledge to join our team. As a Data Engineer or MLOps Engineer, your primary responsibility will be to develop & integrate ML solutions that focus on technology improvements. Specifically, you will be working on projects involving leveraging AI/ML for Data Management Efficiencies & Query Optimizations.

Responsibilities:

1. Collaborate with cross-functional teams such as Data Scientists, Product Partners, and Partner Team Developers to identify opportunities for Big Data, Query (Spark, Hive SQL, BigQuery, SQL) tuning opportunities that can be solved using machine learning and generative AI.
2. Write clean, high-performance, high-quality, maintainable code.
3. Create backend applications using Python, Docker, Google Cloud & in-house ML frameworks to orchestrate end-to-end applications.
4. Design and develop Big Data Engineering Solutions & generative AI Applications ensuring scalability, efficiency, and maintainability of such solutions.
5. Implement prompt engineering techniques to fine-tune and enhance LLMs for better performance and application-specific needs.
6. Stay abreast of the latest advancements in the field of Generative AI Application Development and actively contribute to the research and development of new Generative AI Applications.

Requirements:

1. Proven experience working as a Big Data & MLOps Engineer, with a focus on Python, Google Cloud, Spark, Spark SQL, BigQuery, and Generative AI Applications.
2. Deep understanding and experience in tuning Dataproc, BigQuery, and Spark Applications.
3. Solid knowledge of software engineering best practices, including version control systems (e.g., Git), code reviews, and testing methodologies.

• Work within a company with a solid track record of success
• Work alongside & learn from best in class talent
• Join a well known brand within IT Services

The Job

You will be responsible for :

• Design, develop, and maintain ETL processes using Informatica PowerCenter and other Informatica tools.
• Implement and manage data quality processes using Informatica Data Quality (IDQ).
• Support data governance initiatives by leveraging Informatica Data Governance solutions.
• Develop data pipelines and workflows to integrate data from multiple sources.
• Optimize performance of data integration processes and troubleshoot issues.
• Collaborate with business analysts and data architects to understand data requirements.
• Ensure compliance with data governance and security policies.
• Perform data profiling, cleansing, and enrichment to improve data accuracy and reliability.
• Document technical solutions and maintain best practices for data engineering.
• Identify, troubleshoot, and resolve issues related to data pipelines, storage, and processing.

The Profile

• Minimum of 5 years of experience in data engineering using Informatica suite.
• Hands-on experience with Informatica Data Management Cloud (IDMC), Informatica Data Quality (IDQ) and Informatica MDM.
• Strong knowledge of ETL development, data integration, and data transformation techniques.
• Experience with SQL and relational databases such as Oracle, SQL Server, or PostgreSQL.
• Familiarity with cloud platforms such as Azure or Oracle Cloud.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.

The Employer

Our client is seeking a skilled Informatica Data Engineer to join our team. The successful candidate will have a minimum of five years of experience in data engineering, with expertise in the Informatica suite, including Informatica Data Governance and Data Quality. The role involves designing, developing, and optimizing data integration workflows, ensuring high-quality data standards, and supporting data governance initiatives.

The Data Engineer handles thedesign, development, and maintenance of data pipelines, ETL processes, anddatabase management to support AI and data science initiatives. This roleinvolves ensuring data quality, scalability, and performance across all dataengineering activities.

• Design, develop, and maintain data pipelines, ETL processes,and database systems to support AI and data science initiatives.
• Collaborate with data scientists, AI/ML engineers, and otherstakeholders to understand data requirements and ensure data availability andquality.
• Implement data governance, security, and regulatorystandards in all data engineering activities.
• Optimize data pipelines and processes for scalability,performance, and cost-efficiency.
• Monitor and ensure the performance and reliability of datasystems, identifying and resolving issues as needed.
• Stay updated with the latest advancements in dataengineering technologies and best practices.
• Provide support and guidance to other team members asneeded.
• Prepare and present data engineering reports anddocumentation to senior management and stakeholders.
• Participate in project planning and contribute to thedevelopment of project timelines and deliverables.
• Perform other duties relevant to the job as assigned by theSr. Data Engineer or senior management.
  

• Bachelor’s degree in Data Engineering, Computer Science, ora related field
• Relevant certifications (e.g., Google Cloud ProfessionalData Engineer, AWS Certified Big Data – Specialty) are preferred
• Minimum of 3 years of experience in data engineering orrelated fields
• Experience in designing and implementing data pipelines, ETLprocesses, and database systems for AI or technology-focused products
• Strong programming skills in languages such as Python, Java,or SQL
• Proficiency in data engineering tools and frameworks (e.g.,Apache Spark, Kafka)
• Excellent problem-solving and analytical skills
• Strong communication and interpersonal skills
• Attention to detail and commitment to quality
• In-depth understanding of data engineering principles, ETLprocesses, and database management
• Familiarity with cloud platforms (e.g., AWS, Azure, GoogleCloud) and their data services
• Knowledge of data governance, security, and regulatorystandards
• Ability to manage multiple tasks and prioritize effectively
• Strong attention to detail and commitment to deliveringhigh-quality work
• Ability to work independently and as part of a team
• Programming languages (e.g., Python, Java, SQL)
• Data engineering tools and frameworks (e.g., Apache Spark,Kafka)
• Data management systems (e.g., SQL, NoSQL databases)
• Collaboration and communication tools (e.g., Slack,Microsoft Teams)
  

We are seeking a skilled Informatica Data Engineer to join our team. The successful candidate will have a minimum of five years of experience in data engineering, with expertise in the Informatica suite, including Informatica Data Governance and Data Quality. The role involves designing, developing, and optimizing data integration workflows, ensuring high-quality data standards, and supporting data governance initiatives.

You will be responsible for:

1. Design, develop, and maintain ETL processes using Informatica PowerCenter and other Informatica tools.
2. Implement and manage data quality processes using Informatica Data Quality (IDQ).
3. Support data governance initiatives by leveraging Informatica Data Governance solutions.
4. Develop data pipelines and workflows to integrate data from multiple sources.
5. Optimize performance of data integration processes and troubleshoot issues.
6. Collaborate with business analysts and data architects to understand data requirements.
7. Ensure compliance with data governance and security policies.
8. Perform data profiling, cleansing, and enrichment to improve data accuracy and reliability.
9. Document technical solutions and maintain best practices for data engineering.
10. Identify, troubleshoot, and resolve issues related to data pipelines, storage, and processing.

1. Minimum of 5 years of experience in data engineering using Informatica suite.
2. Hands-on experience with Informatica Data Management Cloud (IDMC), Informatica Data Quality (IDQ) and Informatica MDM.
3. Strong knowledge of ETL development, data integration, and data transformation techniques.
4. Experience with SQL and relational databases such as Oracle, SQL Server, or PostgreSQL.
5. Familiarity with cloud platforms such as Azure or Oracle Cloud.
6. Strong analytical and problem-solving skills.
7. Excellent communication and collaboration abilities.

1. Work within a company with a solid track record of success.
2. Work alongside & learn from best in class talent.
3. Join a well-known brand within IT Services.