Log In
Sign Up
The role:
- In collaboration with the Business Intelligence (BI) Manager, the Data Engineer will undertake the responsibility of executing and managing Azure Data Factory Pipelines. This includes the design and implementation of the Data Lake, as well as the optimization of data refresh performance.
- The role encompasses ownership (both execution and management) of Extract, Transform, Load (ETL) processes, Azure Data Lake, and Data Warehouse. Additionally, the Data Engineer will oversee the Power BI Semantic Data Model, ensuring its efficient operation and maintenance. This position requires a strong understanding of data architecture and cloud-based data services, particularly within the Microsoft Azure platform. The individual will play a critical role in the organization’s data strategy and its implementation.
What You’ll Do:
- Develop and implement data using Azure cloud management solutions.
- Design and manage data storage and data processing solutions in Azure.
- Integrate data sources and build data pipelines for data transformation and ingestion.
- Implement data security and governance measures in Azure.
- Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
- Work together with data scientists and analysts to understand the needs for data and create effective data workflows.
- Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
What You’ll Bring:
- 5+ years of experience in a Data Engineering role
- 4+ years of proven experience building data pipelines using MSFT Azure tools and services (Azure Data Factory, Azure Blob, Azure Databricks, Azure SQL Server, Azure Data Warehouse, Azure Batch)
- Azure Expertise: Proficiency in designing comprehensive Azure solutions, considering infrastructure, apps, data, security, and ETL Development. This includes Azure administration skills and experience with Azure Data Factory for data ingestion and transformation.
- Database Management: Proficiency in managing database systems.
- Analytical Skills: Strong ability to analyze and solve complex problems.
- Data Modeling and Architecture: Expertise in designing data models and architectural frameworks.
- Programming Proficiency: Knowledge of SQL, Python, DAX & M is essential.
- Communication Skills: Effective interpersonal skills and the ability to work well in a team.
- DevOps Expertise: Candidates must be well-versed in DevOps processes.
- IT Operations: Advanced knowledge of IT operations, including networking, virtualization, identity, security, business continuity, disaster recovery, data platform, budgeting, and governance.
- Data Pipeline Construction: Experience in building data pipelines and applying data transformations for batch and real-time messaging systems.
- Data Source Evaluation: Ability to assess the effectiveness and accuracy of new data sources and data-gathering techniques.
- Data Transformation and Modeling: Ability to work on various aspects of data transformations and data modeling.
- Data Collection Enhancement: Experience in enhancing data collection procedures to include information relevant for building analytic systems.
- Best Practices: Ability to follow and document best practices and processes.
- Multitasking: Demonstrated ability to handle multiple assignments in parallel and meet demanding timelines
- Cloud-Based Analytics Tools: Familiarity with Azure cloud-based analytics solutions,
- Experience in Power BI is an advantage
What’s In It for You!
- Work-life-balance: we empower our employees to build a responsible work-life style that reflects the needs of their unique life situations and still enables them to achieve maximum productivity
- Agile environment: we work in a highly agile environment, where you will be working in scrum teams to deliver complex product offerings
- Growth: you will have the ability to learn and evolve at the speed of technology. Our leadership team is focused on performance, growth, engagement, and connection and provides the resources needed to bring you to the next level
- Continuous education/ learning: we assist in the costs of continued education programs, courses and certifications
- Competitive compensation: we ensure that we are in tune with changing market rates. We offer yearly performance reviews, provide pay increases based on performance, and offer generous vacation packages
- Fundraising activity: we have strong connections within our local communities and support many initiatives through employee-led events and fundraising activity
A Bit About Us!
- Procom Labs is building a world-class digital ecosystem of products to find, employ and manage the contingent workforce of today and tomorrow. Our products offer end-to-end solutions in Recruiting Technologies, Workforce Management, and Back-Office Processing. We are a group of people that love to try out creative and sometimes crazy solutions to solve complex problems. We want you to join us in our journey. You can find out more about our mission and products at https://procomservices.com/procom-labs/
