Data Engineer at Infinion Technologies

Key Responsibilities

Data Pipeline Development

• Design, build, and maintain scalable ETL/ELT pipelines for batch and real-time data
• Develop parameterized and reusable pipelines using Microsoft Fabric, Azure Data Factory, or Synapse Pipelines
• Optimize large-scale data ingestion and transformation processes using Databricks, PySpark, SQL, and Dataflows

Data Integration & Migration

• Work on data migration projects, moving workloads from on-premises to Azure Cloud or Microsoft Fabric
• Integrate data from multiple sources (databases, APIs, Event Hubs, third-party systems, etc.)
• Implement data partitioning, chunking, and metadata-driven approaches for performance optimization

Data Modeling & Storage

• Design and maintain Lakehouse, Data Warehouse, and Delta Lake structures
• Build and manage semantic models for reporting with Power BI
• Collaborate with analysts and business stakeholders to create efficient data models supporting analytics use cases

Governance, Security & Compliance

• Ensure proper data governance, lineage, and cataloging using Microsoft Purview
• Manage access and security via Microsoft Entra ID (Azure AD), roles, and service principals
• Implement best practices for data quality, integrity, and compliance with organizational and industry standards

Collaboration & Documentation

• Work closely with data analysts, BI developers, and business stakeholders to understand requirements and deliver solutions
• Document technical designs, processes, and best practices for maintainability
• Contribute to knowledge sharing and mentoring within the data team

Required Technical Skills

• Strong experience with Microsoft Fabric, Azure Data Factory, Synapse Analytics, and Power BI
• Proficiency in SQL (T-SQL, query optimization, stored procedures)
• Experience with PySpark, Python, or Databricks-like environments for big data processing

Location

Lagos, Nigeria