Data Engineer

We’re looking for a Data Engineer to join Source Meridian. About Source Meridian Source Meridian is a development software company that works to solve the industry’s most challenging problems in healthcare practices. We are laser focused on specific technologies in the healthcare and life science industries: Healthcare technology, artificial intelligence, and healthcare interoperability. About The Role We're looking for a Data Engineer to help build and operate an AWS-native data platform processing healthcare claims data and tokenized identifiers. You'll design and implement Spark-based pipelines that transform, intersect, and enrich tokenized datasets stored primarily as Parquet on S3, queried via Athena and related AWS services. This environment intentionally avoids managed lakehouse platforms (e.g., no Databricks and no Snowflake)—you'll be doing "real" data engineering directly on AWS. What You’ll Do Build and maintain Spark pipelines to process large-scale Parquet datasets on S3. Implement tokenization workflows, including transit token → real token conversion and dataset intersection/join logic. Process and deliver healthcare claims datasets for matched individuals, ensuring accurate identity mapping and data integrity. Orchestrate data pipelines using Airflow and/or AWS-native orchestration tools when appropriate. Develop reliable, testable, and observable ETL/ELT processes (retries, idempotency, monitoring, reprocessing). Optimize performance and cost across Spark jo