The Data Engineer handles thedesign, development, and maintenance of data pipelines, ETL processes, anddatabase management to support AI and data science initiatives. This roleinvolves ensuring data quality, scalability, and performance across all dataengineering activities.
Responsibilities and Duties
- Design, develop, and maintain data pipelines, ETL processes,and database systems to support AI and data science initiatives.
- Collaborate with data scientists, AI / ML engineers, and otherstakeholders to understand data requirements and ensure data availability andquality.
- Implement data governance, security, and regulatorystandards in all data engineering activities.
- Optimize data pipelines and processes for scalability,performance, and cost-efficiency.
- Monitor and ensure the performance and reliability of datasystems, identifying and resolving issues as needed.
- Stay updated with the latest advancements in dataengineering technologies and best practices.
- Provide support and guidance to other team members asneeded.
- Prepare and present data engineering reports anddocumentation to senior management and stakeholders.
- Participate in project planning and contribute to thedevelopment of project timelines and deliverables.
- Perform other duties relevant to the job as assigned by theSr. Data Engineer or senior management.
Requirements
Bachelor’s degree in Data Engineering, Computer Science, ora related fieldRelevant certifications (e.g., Google Cloud ProfessionalData Engineer, AWS Certified Big Data – Specialty) are preferredMinimum of 3 years of experience in data engineering orrelated fieldsExperience in designing and implementing data pipelines, ETLprocesses, and database systems for AI or technology-focused productsStrong programming skills in languages such as Python, Java,or SQLProficiency in data engineering tools and frameworks (e.g.,Apache Spark, Kafka)Excellent problem-solving and analytical skillsStrong communication and interpersonal skillsAttention to detail and commitment to qualityIn-depth understanding of data engineering principles, ETLprocesses, and database managementFamiliarity with cloud platforms (e.g., AWS, Azure, GoogleCloud) and their data servicesKnowledge of data governance, security, and regulatorystandardsAbility to manage multiple tasks and prioritize effectivelyStrong attention to detail and commitment to deliveringhigh-quality workAbility to work independently and as part of a teamProgramming languages (e.g., Python, Java, SQL)Data engineering tools and frameworks (e.g., Apache Spark,Kafka)Data management systems (e.g., SQL, NoSQL databases)Collaboration and communication tools (e.g., Slack,Microsoft Teams)#J-18808-Ljbffr