SCOPE OF POSITION
ConeTec is an industry-leading provider of geotechnical and environmental site investigation services, specializing in the testing and reporting of subsurface conditions in unique environments. Headquartered in Burnaby BC, ConeTec is one of the largest geotechnical site investigations company in the Americas.
The Azure Data Developer will be responsible for the implementation, support and maintenance of ConeTec’s Azure data platform. This includes developing and maintaining Azure Data Factory (ADF) pipelines and SQL code, monitoring daily data loads, responding to failure notifications, and creating the alerts that keep the business informed when issues occur. Working closely with the Business Intelligence team, IT and business users, the Azure Data Developer will ensure that data is delivered accurately, securely and on time for reporting and analytics. Successful candidates need a strong background in SQL and Azure data services, with an emphasis on building reliable, well-monitored data pipelines.
ROLES, RESPONSIBILITIES & EXPECTATIONS
- Design, develop, deploy and maintain Azure Data Factory (ADF) pipelines, data flows, linked services and triggers to move and transform data from multiple sources.
- Develop and optimize SQL code, including T-SQL queries, stored procedures, views and functions, in Azure SQL Database and related data stores.
- Monitor daily pipeline runs and respond promptly to failure notifications by troubleshooting issues, identifying root causes, and rerunning or backfilling data as needed.
- Create and maintain alerts in Azure Monitor, Log Analytics and Azure Data Factory so that failures, delays and data issues are detected and communicated early.
- Implement and maintain Azure data resources, including Azure Data Factory, Azure SQL Database, Azure Storage / Data Lake, and Azure Key Vault.
- Manage access, credentials and connections in line with ConeTec’s security and data governance standards.
- Use source control and CI/CD (Azure DevOps or GitHub) to promote changes from development to test and production.
- Monitor the performance and cost of Azure data resources and recommend improvements.
- Contribute to data quality initiatives by building validation checks and addressing data quality issues.
- Collaborate with the Business Intelligence team, IT and business users to gather requirements and deliver reliable data for Power BI reporting and analytics.
- Maintain runbooks and technical documentation for pipelines, data sources and support procedures.
- Communicate incidents, impact and resolutions clearly to both technical and non-technical stakeholders.
SKILLS, QUALIFICATIONS AND EXPERIENCE REQUIRED
Education and Experience:
- Bachelor’s Degree in Computer Science, Information Systems, Data Science or related field, or an equivalent combination of education and experience.
- 3+ years of experience developing and supporting data pipelines and SQL databases, preferably in Microsoft Azure.
Skills & Knowledge
- Strong hands-on experience with Azure Data Factory, including pipelines, activities, parameters, triggers and integration runtimes.
- Advanced SQL skills, including writing and tuning complex queries and stored procedures.
- Knowledge of Azure SQL Database, Azure Storage / Data Lake, and Azure Key Vault.
- Experience monitoring production workloads and configuring alerts using Azure Monitor and Log Analytics.
- Knowledge of data warehousing concepts, data modelling, and ETL/ELT patterns.
- Familiarity with source control and CI/CD using Azure DevOps or GitHub.
- Knowledge of API integration, including RESTful APIs for data integration tasks.
- Strong troubleshooting skills and attention to detail.
- Proficient in handling multiple priorities and responding calmly to production issues.
- Ability to learn quickly.
- Excellent communication skills, both verbal and written.
- Ability to work well both independently and as a part of a team.
- Scripting experience with Python.
- Familiarity with Power BI and how reports depend on upstream data pipelines.
ConeTec is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status, or any other status protected by applicable law.