Job Category: Data Engineering
Job Type: Full Time
Job Location: Noida
Experience range : 2-4 years
Who we are
Driven by a profound passion for delivering exceptional value, we leverage analytics and AI to become trusted partner of our clients in solving their business challenges. Our team consists of the best of breed analysts and technical experts, who adapt to the state-of-the-art technologies, offering flexibility and agility to meet customer needs. Our product, platform and solution approach utilize cutting-edge techniques and innovation to accelerate value realization.
With our headquarters in Delhi NCR and offices in the US and UK, we operate across key markets to deliver impactful, high-quality solutions. Visit us at: www.aiqmen.com
About the Role
We are seeking a Data Engineer with 2-4 years of experience who possesses strong skills in the Microsoft data stack (Azure Databricks, Data Factory) with exposure to Microsoft Fabric. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, data models, and analytical solutions. A critical part of this role is implementing and managing robust Continuous Integration and Continuous Deployment (CI/CD) processes to ensure our data platform is reliable, automated, and efficient.
What skills you must possess:
- Azure Data Platform:
- Strong hands-on experience with Azure Databricks and Azure Data Factory (ADF).
- Strong with Core Big Data Concepts (Hadoop/Hive/Map-Reduce).
- Must be hands-on with Databricks Magic commands.
- Strong Core Programming & Database Skills:
- Strong proficiency in SQL / PLSQL, Python, and PySpark (or Scala).
- Knowledge of at least one Cloud Database (e.g., Postgres, Azure SQL, or any enterprise database).
- Hands-on with Unix File System commands.
- Data Modelling:
- Good understanding of data modelling concepts (Kimball, Inmon, Data Vault).
- Flexible to work with AWS/GCP as per project needs.
What Skills Are Good to Have:
- Microsoft Fabric:
- Exposure to or familiarity with Microsoft Fabric components is a significant advantage, including:
- One Lake, Lakehouse, and Data Warehouse
- Data Factory (Pipelines / Dataflows Gen2)
- Direct Lake mode and Power BI integration
- Exposure to or familiarity with Microsoft Fabric components is a significant advantage, including:
- Data Governance:
- Experience implementing data governance, data quality, and security best practices (e.g., within Fabric/One Lake or other platforms).
- DevOps & CI/CD:
- CI/CD Expertise: Strong, demonstrable experience implementing CI/CD processes for data solutions.
- DevOps Tools: Proficiency with Azure DevOps (Pipelines, Repos) or GitHub Actions.
Key Responsibilities :
- Data Pipeline Development: Design, build, and optimize end-to-end data pipelines using Azure Data Factory (ADF) for orchestration and Azure Databricks or Spark Notebooks (PySpark/SQL) for large-scale data transformation.
- Data Modeling & Warehousing: Develop and manage modern data platforms such as Data Warehouses (e.g., in Azure Synapse, Azure SQL) and Lakehouse architectures (e.g., in Databricks or Fabric).
- Semantic Layer: Create and maintain Power BI semantic models (formerly datasets) to support self-service BI and reporting.
- CI/CD Automation: Lead the design and implementation of CI/CD pipelines for all data solution artifacts (e.g., Databricks notebooks, ADF pipelines, SQL scripts, etc.).
- DevOps Integration: Utilize Azure DevOps or GitHub Actions to automate the build, testing, and deployment of data solutions across development, test, and production workspaces.
- Source Control: Manage all data solution source code and artifacts using Git integration (e.g., Azure Repos, GitHub) and Databricks Repos.
What you can expect
Life at AiQMEN is characterized by an open culture and a collaborative environment that promotes continuous learning and growth. We offer a rewarding career with ample opportunities for professional development and personal achievement.
Employees benefit from a respectful environment and comprehensive benefits, ensuring well-being and work-life balance. At AiQMEN, you’ll find a supportive team that embraces diversity and inclusion, making it an exciting and fulfilling place to work. Join us and experience a career that’s more than just a job, but a journey towards innovation and excellence. Enjoy a fun and engaging workplace with regular team events, social activities, and celebrations that create lasting memories and camaraderie.
Location :
So, are you the one? Let us know at hr@aiqmen.com
Thank you!
Talent Acquisition @ AiQMEN