Platform Principal Data Engineer
Mass General Brigham
This job is no longer accepting applications
See open jobs at Mass General Brigham.See open jobs similar to "Platform Principal Data Engineer" MassTech Health IT.
Mass General Brigham relies on a wide range of professionals, including doctors, nurses, business people, tech experts, researchers, and systems analysts to advance our mission. As a not-for-profit, we support patient care, research, teaching, and community service, striving to provide exceptional care. We believe that high-performing teams drive groundbreaking medical discoveries and invite all applicants to join us and experience what it means to be part of Mass General Brigham.
Job Summary
The OpportunityResponsible for Data Engineering Standards CoE, driving automation and best practices to standardize and accelerate development. Responsible for overseeing the design, development, implementation, and maintenance of data solutions within the organization. Support team of data engineers, collaborating with cross-functional teams, data scientists, and business stakeholders to ensure the efficient and reliable management of data.
What You'll Do
-Enhance and administer the DBT and CI/CD platform architecture to improve scalability, performance, and automation.
-Design and build reusable, high-performance data pipelines using technologies like Snowflake, Python, and DBT to support both operational and analytical needs.
-Lead the design, development and automation of CI/CD pipelines for data workflows using Azure DevOps, Git, and orchestration tools.
-Evaluate emerging features in DBT, CI/CD, and related tools; lead POCs, define adoption strategies, and support rollout to development teams.
-Act as an escalation point to troubleshoot and solve technical challenges.
-Leverage Python and cutting-edge AI technologies, including Large Language Models (LLMs), to automate and streamline the data management lifecycle — from intelligent metadata tagging and automated code validation to advanced data profiling and pipeline generation.
-Lead Data Engineering platform collaboration sessions and actively drive standard adoption and technical best practices.
-Proactively identify opportunities to innovate and expand platform capabilities in alignment with strategic goals.
-Champion continuous improvement through agile delivery, platform upgrades, and process innovation.
-Mentor and support engineers at all levels, fostering a strong culture of learning and technical excellence.
Qualifications
What You'll Bring
- Bachelor's Degree Computer Science required or Bachelor's Degree Related Field of Study required
- MGB can consider experience in lieu of a degree
- Experience in professional information technology positions 8-10+ years required and Data warehousing development in large reporting environment(s)
- 5-7 years required and Experience working with data integration tools, ETL frameworks, and workflow management systems (e.g., Apache Airflow) required.
- 2+ years of hands-on experience in DBT tool development and administration. Experience in CI/CD pipeline development using Azure DevOps and Azure Git, including repository management and enforcing best practices. Experience with AI/ML technologies, including LLMs, to support platform automation and innovation. Strong attention to detail and a proactive approach to process improvement and standards development.
- Python experience.
- Highly Preferred: Proficient with DBT tool, comfortable designing, developing, and performing admin tasks. Strong understanding of CI/CD processes using Azure DevOps or Git.
Skills for Success
- Expertise in data engineering principles, data modeling, ETL development, and data warehousing.
- Hands-on experience with DBT, CI/CD pipelines, and cloud data platforms (Azure, Snowflake).
- Strong ability in building data pipelines using Snowflake features ( Snowpipe, SnowSQL, Snow Sight, Data Streams ).
- Proficiency in working with relational databases (e.g., SQL Server, Oracle, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
Additional Job Details (if applicable)
Working Model
- Hybrid required,
- Onsite 1-3x weekly, local or willing to relocate is required for weekly or at least 4x monthly
- M-F Eastern Business Hours required
- Remote work requires stable, secure, quiet, compliant work station
Remote Type
Work Location
Scheduled Weekly Hours
Employee Type
Work Shift
Pay Range
$55.48 - $80.70/Hourly
Grade
8
EEO Statement:
Mass General Brigham Competency Framework
At Mass General Brigham, our competency framework defines what effective leadership “looks like” by specifying which behaviors are most critical for successful performance at each job level. The framework is comprised of ten competencies (half People-Focused, half Performance-Focused) and are defined by observable and measurable skills and behaviors that contribute to workplace effectiveness and career success. These competencies are used to evaluate performance, make hiring decisions, identify development needs, mobilize employees across our system, and establish a strong talent pipeline.
This job is no longer accepting applications
See open jobs at Mass General Brigham.See open jobs similar to "Platform Principal Data Engineer" MassTech Health IT.