Senior Data Engineer

Job description

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time. Position Summary This is a hybrid position. Looking for candidates local to MA, CT, NY, TX If you’re eager to make a real impact in the health care industry through your own meaningful contributions, explore a role in technology with CVS Health. Our journey calls for technical innovators and data visionaries: come help us pave the way. At CVS Health, we possess an extensive repository of healthcare data that spans over 150 million individuals, providing an unparalleled foundation for ambitious Data Engineers. In this role, you will engage with complex business challenges, harnessing modern tools and technologies to securely store, process, transform, and enrich terabyte to petabyte scale healthcare data. Your work will underpin data-driven business decisions and contribute to our mission of delivering industry-best data products / software with a customer-first mindset and team-oriented approach. As a Senior Data Engineer, you will be instrumental in designing, developing, and maintaining optimal data pipelines to assemble large and intricate datasets, catering to the business requirements of various CVS lines of business. Collaborating closely with teams, you will craft tools to provide actionable insights and integrate them with consumer touchpoints. In this role , you will: • Architect and develop robust, scalable ETL/ELT pipelines using Cloud Dataflow, Cloud composer (Airflow), and Pub/Sub for both batch and streaming use cases. Leverage BigQuery as the central data warehouse and design integrations with other GCP services (e.g., Cloud storage, Cloud functions). • Build and optimize analytical data models in BigQuery . Implement partitioning, clustering, and materialized views for performance and cost efficiency. Ensure compliance with data governance, access controls, and IAM best practices. • Develop integrations with external systems (APIs, flat files etc.) using GCP-native or hybrid approaches. Utilize tools like Dataflow or custom Python/Java services on Cloud Functions or Cloud Run to handle transformations and ingestion logic. • Build automated CI/CD pipeline using Cloud Build, GitHub Actions, or Jenkins for deploying data pipeline code and workflows. Set up observability using Cloud Monitoring, Cloud Logging, and Error Reporting to ensure pipeline reliability. • Lead architectural decisions for data platforms and mentor junior engineers on cloud-native data engineering patterns. Promote best practices for code quality, version control, cost optimization, and data security in a GCP environment. Drive initiatives around data democratization, including building reusable datasets and data catalogs via Datap le x or Data Catalog. • Design, develop, and maintain enterprise AI/ML solutions and platforms that address complex business and customer challenges. Integrate Large Language Models (LLMs), generative AI capabilities, and AI agents into products and data ecosystems. Define the technical architecture and infrastructure required for AI applications, and build scalable platforms supporting model training, deployment, monitoring, governance, and lifecycle management while ensuring security, reliability, and operational excellence. As leaders in healthcare, our analytics and engineering teams deliver innovative solutions to business problems by collaborating with cross-functional teams in a dynamic and agile environment. You will be part of a team that values collaboration and encourages innovative thinking at all levels. You will be intellectually challenged to solve problems associated with large scale complex, structured and unstructured data, that will allow you to grow your technical skills and engineering expertise. Required Qualifications • 3-5 + years of e xperience with SQL , NoSQL • 3-5 + years of experience with Python (or a comparable scripting language) • 3 + years of experience with Data warehouses (such as data modeling and technical architectures) and infrastructure components • 3 + years of experience with ETL/ELT, and building high-volume data pipelines • 3 + years of experience with reporting/analytic tools • 3 + years of experience with Query optimization, data structures, transformation, metadata, dependency, and workload management • 3 + years of experience with Big data and cloud architecture • 3+ years of hands-on experience building and managing cloud infrastructure on Google Cloud Platform (GCP), including Cloud Storage, BigQuery, Dataflow, and Dataproc • 3+ years of experience deploying and scaling containerized applications on GCP using Google Kubernetes Engine (GKE), Cloud Run, and Artifact Registry • 3+ years of experience with real-time and streaming data technologies on GCP (i.e. Pub/Sub, Dataflow, Cloud Functions, Apache Kafka, Spark Streaming) • 1+ year ( s ) of soliciting complex requirements a nd managing relationships with key stakeholders • 1+ year(s) of experience independently managing deliverables Preferred Qualifications • Experience in designing and building data engineering solutions in cloud environments (preferably GCP) • Experience with Git, CI/CD pipeline, and other DevOps principles/best practices • Experience with bash shell scripts, UNIX utilities & UNIX Commands • Ability to leverage multiple tools and programming languages to analyze and manipulate data sets from disparate data sources • Knowledge of API development • Exposure to Generative AI • Exposure Large Language Models (GPT, Claude, Gemini, Llama, etc.) • Experience with complex systems and solving challenging analytical problems • Strong