Descrição da vaga
Description
Engagement Overview
EMS|MC is seeking an experienced independent contractor to provide data engineering services supporting its Revenue Cycle Management (RCM) data and analytics environment. The engagement will focus on designing, building, and enhancing scalable data pipelines, ETL/ELT processes, data warehouse structures, and governed data workflows that provide reliable, high-quality data to authorized analysts, data scientists, and business stakeholders in accordance with agreed-upon deliverables.
Scope of Services
- Designing, building, and maintaining scalable ETL/ELT pipelines that ingest, transform, and load large volumes of data from relational databases, APIs, and third-party systems.
- Architecting and optimizing data warehouse schemas and data models that support business intelligence, analytics, and reporting requirements.
- Orchestrating and monitoring data workflows using Apache Airflow, including reliable scheduling, dependency management, operational monitoring, and failure recovery.
- Building and maintaining transformation logic using dbt to establish clean, tested, and well-documented data models.
- Maintaining and extending SSIS packages that support legacy and hybrid data integration requirements.
- Monitoring and optimizing data pipeline and database performance to support high data throughput and low-latency requirements.
- Building automation and tooling in Python to streamline data engineering workflows, testing, deployment, and operational monitoring.
- Applying data governance, security, and privacy practices that support data quality, consistency, lineage, and compliance for PHI, PII, healthcare, and financial information, including applicable HIPAA requirements.
- Consulting with designated EMS|MC stakeholders to clarify data requirements and translate business needs into scalable data engineering solutions.
- Collaborating with data scientists, analysts, BI engineers, and other designated resources to define, build, and validate data pipelines and models that enable effective analysis and reporting.
- Identifying and resolving data-related issues by tracing pipeline failures and data discrepancies to root cause and implementing appropriate corrective action.
- Participating in architecture and design reviews and providing recommendations on data modeling, integration, and platform approaches for agreed-upon initiatives.
- Preparing and maintaining technical documentation for data workflows, pipeline architecture, data models, dependencies, and data lineage.
Expected Deliverables
- Production-ready ETL/ELT pipelines that reliably ingest, transform, and load data from agreed-upon source systems.
- Data warehouse schemas and data models optimized for agreed-upon business intelligence, analytics, and reporting use cases.
- Apache Airflow workflows, including scheduling, dependency management, monitoring, and failure-recovery configurations.
- Tested and documented dbt transformation models supporting governed and reusable data assets.
- New or enhanced SSIS packages supporting agreed-upon legacy and hybrid data integration requirements.
- Python-based automation and tooling that improve data engineering workflows, testing, deployment, or operational monitoring.
- Performance improvements resulting from pipeline, query, database, or data-model optimization.
- Validated data outputs, including documented testing of data quality, accuracy, completeness, and pipeline reliability against agreed-upon acceptance criteria.
- Technical documentation covering data workflows, pipeline architecture, data models, dependencies, data lineage, operational guidance, and implementation recommendations.
Requirements
Contractor Qualifications
- Demonstrated professional experience in data engineering or a similar discipline, typically five or more (5+) years, building and supporting production data pipelines.
- Production-proven proficiency in Python for data pipeline development, automation, testing, and tooling.
- Advanced SQL proficiency and hands-on experience with relational databases such as MySQL, PostgreSQL, or SQL Server.
- Hands-on experience with AWS data engineering services, such as Glue, EMR, Redshift, Kinesis, and S3-based data lake patterns.
- Hands-on experience orchestrating production data workflows with Apache Airflow and building data transformation models with dbt.
- Experience building and maintaining SSIS packages for data integration.
- Strong understanding of data modeling techniques, ETL/ELT design, and data warehousing principles.
- Demonstrated experience applying data quality, governance, security, and privacy practices to sensitive healthcare or financial data, including applicable HIPAA requirements.
- Demonstrated ability to independently analyze complex data needs, troubleshoot failures and discrepancies, exercise sound judgment, and deliver reliable solutions with a high degree of ownership and accountability.
- Strong written and verbal communication skills, with the ability to clearly articulate complex data engineering concepts and collaborate effectively with technical and non-technical stakeholders in English.
Additional Experience Preferred
- Familiarity with containerization, orchestration technologies, and CI/CD pipelines, such as Docker and Kubernetes.
- Experience with PySpark for large-scale distributed data processing.
- Experience using AI prompting or AI-assisted tools to accelerate data engineering work while maintaining appropriate review and data protection practices.
Engagement Details
- Services will be performed pursuant to a written Independent Contractor Agreement and applicable Statement(s) of Work.
- Deliverables, priorities, timelines, and other engagement-specific terms will be established by mutual agreement before the applicable services begin.
- Initial Term: The initial engagement is anticipated to continue for up to twelve (12) months. Prior to the conclusion of the initial term, EMS|MC and the contractor may mutually evaluate whether to extend the independent contractor engagement or pursue an employment opportunity, if there is mutual interest.
- Any employment relationship would be subject to a separate offer of employment, successful completion of the Company's hiring process, and execution of all required employment documentation. Nothing in this posting or any resulting agreement guarantees future employment, continued engagement, or an extension of the initial term.
Independent Contractor Engagement
This opportunity is for the provision of professional services by an independent contractor. Nothing in this posting or any resulting agreement is intended to create an employer-employee relationship.