Note: The job is a remote job and is open to candidates in USA. Citius Healthcare Consulting is hiring a Data Lineage Engineer for a high-visibility program at one of the nation's leading academic medical centers. The role involves building the end-to-end lineage backbone and ensuring data integrity across various cloud environments.
Responsibilities
- Can you trace a single data element from an EHR message, through a streaming pipeline, across two clouds, into the table a researcher queries — at the column level?
- You'll build the end-to-end lineage backbone: defining canonical node identifiers, validating lineage records across clouds, integrating cloud-native lineage (Dataplex, Purview) with custom producers, and publishing how-to guides and sample code that engineering teams across the enterprise will actually use
Skills
- 7+ years in data engineering with 3+ focused on lineage or data observability
- OpenLineage (or equivalent) hands-on experience; column-level lineage a must
- GCP and/or Azure lineage capture — Dataplex, Purview, and custom API ingestion
- Strong SQL and Python; comfort writing producer/consumer sample code and documentation
- Graph data models
- Marquez
- CMDB/ServiceNow integration
Company Overview