This position will support the design and delivery of secure, scalable, and traceable data pipelines in Azure, with a focus on integrating and transforming sensitive, public-facing datasets. The candidate will build ingestion workflows and transformation logic to support reporting, analytics, and public transparency initiatives. This role requires experience with Azure-native tools, strong ETL/ELT capabilities, and a strong commitment to data quality, auditability, and responsible data use. The candidate will be working with an existing software development team in an Agile/Scrum environment.
Skill
Required / Desired
At least 3 years of experience building and maintaining ETL/ELT pipelines in enterprise environments using Azure-native tools. | Required | 3 | Years |
Hands-on expertise with Azure Data Factory, Dataflows, Synapse Pipelines, or similar orchestration tools. | Required | 3 | Years |
Proficiency in SQL, Python, or PySpark for transformation logic and data cleansing workflows. | Required | 3 | Years |
Experience with Delta Lake, Azure Data Lake Storage Gen2, JSON, and Parquet formats. | Required | 3 | Years |
Ability to build modular, reusable pipeline components using metadata-driven approaches and robust error handling. | Required | 3 | Years |
Familiarity with public data sources, government transparency datasets, and publishing workflows. | Required | 3 | Years |
Knowledge of data masking, PII handling, and encryption techniques to manage sensitive data responsibly. | Required | 3 | Years |
Experience with data quality frameworks, including automated validation, logging, and data reconciliation methods. | Required | 3 | Years |
Strong grasp of DevOps/DataOps practices, including versioning, testing, and CI/CD for data pipelines. | Required | 3 | Years |
Experience supporting data publishing for oversight, regulatory, or open data initiatives is highly desirable. | Required | 3 | Years |
Certifications such as DP-203 (Azure Data Engineer Associate) or Azure Solutions Architect are a plus. | Highly desired | 3 | Years |
...highest level of customer service towards our clients and theirs at all times. Qualification required: You must be fluent in Spanish You must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge...
...Associate Claims Adjusters handle entry-level insurance claims under close supervision through the life-cycle of a claim including but not limited to: investigation, evaluation and claim resolution. The purpose of this position is to provide service to agents, insureds...
...internship is unpaid and intended solely for students seeking class credit or graduation credit... ...Qualifications:~Current undergraduate college student participating in courses that... ...from the assigned work siteSchedule:Summer, Fall, and Winter interns are expected to...
...Job Description Earthscapes, Inc is expanding and is seeking an experienced and motivated Landscape Designer who is passionate about plants, understanding of design, appreciates quality, and has an excitement to work with a variety of clientele in the Sioux Falls South...
...Now hiring for 2 Full Time CDL Truck Drivers - MANUAL TRANSMISSION (Dump-Trucks, Roll-off Trucks, and/or Hook Trucks) Safely operate Dump-Truck, Hook Truck, and/or Roll-off Truck to transport and deliver roll-off containers following a daily schedule Perform pre...