4,409 Data Quality Engineer jobs found with companies that value diversity

Job Description

Job Title: Data Technical Architect

Location: New York, NY / Tampa, FL

Key Responsibilities

As a Technical Data Architect candidate will:

Technically Drive Data Automation Initiatives by Interacting with Customer Stakeholders:

Architectural Vision: Define and champion the strategic architectural vision for end-to-end data automation across our diverse data pipelines, platforms, and consumption layers.

Solution Design: Lead the design and implementation of highly scalable, efficient, and reliable automation frameworks for data ingestion, transformation, validation, and delivery processes.

Stakeholder Engagement: Collaborate directly with internal and external customer stakeholders to understand complex business requirements, translate them into technical specifications, and ensure proposed automation solutions align with strategic objectives and deliver tangible business value.

Technology Evaluation: Continuously evaluate, prototype, and recommend cutting-edge technologies, tools, and methodologies to advance our data automation capabilities and maintain a competitive edge.

Mentor and Coach for Data Quality Engineering Solutioning:

Technical Guidance: Serve as the principal technical mentor and coach for the Data Quality Engineering team, guiding them on architectural patterns, design principles, and best practices for data quality solutioning.

Expertise Dissemination: Provide deep technical expertise in advanced data profiling, data validation, data cleansing, data reconciliation, anomaly detection, and comprehensive data governance strategies.

Capability Building: Foster a culture of technical excellence, continuous learning, and shared ownership for data quality across engineering teams through hands-on guidance, code reviews, and knowledge-sharing sessions.

Problem Solving: Lead complex technical deep-dives, architectural design reviews, and critical problem-solving sessions to ensure the robustness, scalability, and maintainability of data quality solutions.

Drive Automation Efforts for Data Quality Test Automation Tool:

Tool Strategy & Customization: Lead the architectural strategy, selection, customization, and integration of enterprise Data Quality Test Automation tools (e.g., Broadcom CA TDM, Informatica Data Quality, or custom frameworks).

Automation Pipeline Design: Design and oversee the implementation of automated pipelines for data quality test case generation, execution, reporting, and integration with defect management systems.

CI/CD Integration: Develop and implement robust strategies for embedding automated data quality gates directly into CI/CD pipelines, ensuring continuous data integrity throughout the entire software development lifecycle.

Optimization: Ensure the optimal utilization and performance of the data quality test automation tool, maximizing its effectiveness and efficiency across various data domains.

Support Interviews and Related Delivery by Leveraging Strong Big Data Understanding:

Talent Acquisition: Play a critical role in the recruitment process for Data Quality Engineers and other Big Data-focused technical roles, conducting in-depth technical assessments.

Technical Assessment: Evaluate candidates' proficiency in core Big Data technologies (e.g., Apache Spark, Hadoop, Kafka, data warehousing, data lakes, streaming platforms, cloud-native data services).

Delivery Oversight: Provide overarching technical oversight and guidance on project delivery, ensuring architectural soundness, adherence to best practices, and resolution of complex technical impediments.

Hands-on Knowledge and Experience in Advanced SQL, Python:

Technical Prototyping & POCs: Lead by example with hands-on development, prototyping, and proof-of-concepts for complex data quality solutions and automation frameworks.

Advanced SQL: Expert-level proficiency in writing and optimizing complex SQL queries for data analysis, validation, and manipulation across various database systems.

Python Expertise: Deep hands-on experience with Python for data engineering, scripting automation, developing data quality checks, and integrating with Big Data frameworks (e.g., PySpark).

Required Qualifications

Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.

15+ years of progressive experience in software engineering, with at least 5+ years in a Technical Architect, Lead Data Architect, or Principal Data Engineer role, specifically focused on data quality, data governance, or data platform architecture.

Exceptional hands-on proficiency and deep architectural understanding of the Big Data ecosystem:

Apache Spark (PySpark, Scala, or Java): Expert-level experience with Spark SQL, DataFrames/Datasets, streaming, and advanced performance tuning techniques.

Distributed Storage & Processing: Hadoop, HDFS, S3, Delta Lake, Apache Iceberg, or similar data lake technologies.

Streaming Technologies: Apache Kafka, AWS Kinesis, or similar high-throughput messaging systems.

Cloud Data Platforms: Extensive experience designing and implementing solutions on AWS (e.g., EMR, Glue, Redshift, Lambda, Step Functions, S3), Azure (e.g., Databricks, Synapse Analytics, Data Lake Storage), or GCP (e.g., Dataproc, BigQuery, Cloud Storage).

Expert-level hands-on experience with Advanced SQL for complex data analysis, validation, and optimization.

Expert-level hands-on experience with Python for data engineering, automation, and developing robust data quality solutions.

Proven track record of defining, designing, and implementing large-scale data automation frameworks.

Demonstrated expertise in data quality engineering principles, methodologies, and tools (profiling, validation, cleansing, reconciliation, anomaly detection).

Experience in leading and mentoring technical teams, fostering a culture of technical excellence and continuous improvement.

Strong understanding of software development lifecycle (SDLC), DevOps practices, and integrating quality gates into CI/CD pipelines.

Excellent communication, presentation, and interpersonal skills, with the ability to articulate complex technical concepts to diverse audiences, including senior leadership and non-technical stakeholders.

Skills

PRIMARY COMPETENCY : Data Engineering PRIMARY SKILL : Data Analyst PRIMARY SKILL PERCENTAGE : 100

Equal opportunity Employer:

Mphasis is an equal opportunity/affirmative action employer. We provide equal employment opportunities to applicants and existing associates and evaluate qualified candidates without regard to race, gender, national origin, ancestry, age, color, religious creed, marital status, genetic information, sexual orientation, gender identity, gender expression, sex (including pregnancy, breast feeding and related medical conditions), mental or physical disability, medical conditions military and veteran status or any other status or condition protected by applicable federal, state, or local laws, governmental regulations and executive orders.