Note: The job is a remote job and is open to candidates in USA. uMotif is dedicated to enhancing patient engagement in clinical research through innovative data capture solutions. The Data Engineer will focus on writing, optimizing, and maintaining complex SQL queries to support clinical data infrastructure on AWS, ensuring reliable access to data for clinical and product teams.
Responsibilities
- Write and maintain complex SQL queries across large-scale clinical datasets, including multi-table joins, window functions, CTEs, and subqueries
- Diagnose and tune slow-running queries using execution plans, index analysis, and query profiling tools — delivering measurable performance improvements
- Establish and enforce SQL best practices, coding standards, and review processes across the data team
- Optimize SQL for cost and performance — with a deep understanding of how the complete system handles query execution
- Build and manage indexes, partitioning strategies, and materialized views to support performant analytical and operational queries
- Design and build ELT/ETL pipelines with SQL at their core, leveraging AWS services such as: AWS Aurora for structured data processing, AWS Lambda and Step Functions for orchestration and transformation triggers
- Write transformation logic using dbt, including tests, documentation, and lineage tracking
- Ensure pipelines are performant, reliable, and well-monitored — with clear alerting when things go wrong
- Build clean, well-documented SQL datasets and semantic layers that empower self-serve analytics across clinical and product teams
- Partner with TechOps and clinical stakeholders to translate reporting requirements into robust, reusable SQL data products
- Support dashboard and reporting tools including Grafana and Amazon QuickSight with optimized underlying queries
- Implement SQL-based data quality checks and validation frameworks across critical pipelines
- Support data cataloging, lineage tracking, and access control in line with healthcare data standards
- Assist with compliance requirements for clinical trial data, including audit trails and row-level security where needed
- Participate actively in code reviews, with a particular focus on SQL quality, readability, and performance
- Mentor junior engineers and analysts on SQL patterns, optimisation techniques, and data engineering fundamentals
- Contribute to technical documentation, runbooks, and data engineering best practices
- Drive root cause analysis for data incidents and improve pipeline reliability over time
Skills
- 4+ years of experience in data engineering or a closely related role, with SQL as a core daily skill
- Demonstrable expertise in writing complex, production-grade SQL — including window functions, recursive CTEs, lateral joins, and advanced aggregations
- Proven track record of query optimization: reading execution plans, diagnosing bottlenecks, and delivering significant performance improvements
- Strong hands-on experience with AWS data services, particularly Aurora, Redshift, Athena, and S3
- Experience building ELT/ETL pipelines at scale, with SQL transformation at their core
- Proficiency in dbt for data transformation, testing, and documentation
- Experience with Python for pipeline orchestration and data processing tasks
- Familiarity with workflow orchestration tools such as Apache Airflow or AWS MWAA
- Understanding of data quality principles, access control, and governance (e.g. AWS Lake Formation)
- Experience working in a GitLab or similar CI/CD environment
- Strong analytical mindset, attention to detail, and excellent communication skills
- Experience in healthcare, life sciences, or clinical trials data environments
- Familiarity with healthcare data standards such as HL7 or FHIR
- AWS certifications such as AWS Certified Data Engineer – Associate or AWS Certified Solutions Architect
- Knowledge of Infrastructure as Code using Terraform
- Exposure to streaming data pipelines using AWS Kinesis or Apache Kafka
Company Overview