Hello Professional,
I hope you''re doing well.
We have a very urgent below position, kindly let us know if you are interested.
Title: Lead Data Engineer (Google Cloud Platform & Matillion) Role Overview The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and solutions on Google Cloud Platform (Google Cloud Platform). The role focuses on data ingestion, transformation, orchestration, and governance across enterprise data systems. The engineer will work closely with architects, data analysts, and business stakeholders to implement high-quality, performance-optimized data solutions in BigQuery and related Google Cloud Platform services.
Key Responsibilities:
Design and implement end-to-end data pipelines using Cloud Dataflow (Python/Apache Beam) for batch and streaming data.
Develop, optimize, and maintain BigQuery stored procedures (SPs), SQL scripts, and user-defined functions (UDFs) for complex transformations and business logic implementation.
Build and manage data orchestration workflows using Cloud Composer (Airflow) with appropriate operators and dependencies.
Establish secure and efficient connections to source systems for data ingestion and integration.
Manage data ingestion workflows from on-premise and cloud sources into Google Cloud Storage (GCS) and BigQuery.
Execute history data migration from legacy data warehouses (preferably Snowflake, Teradata, Netezza, Oracle, SQL Server) to BigQuery, ensuring accuracy and performance optimization.
Design and maintain data validation and testing frameworks for ensuring data quality and reliability across pipelines.
Implement data governance practices, including metadata management, lineage tracking, and access control.
Collaborate with data analysts and architects to define scalable and reusable data models, views, and semantic layers in BigQuery.
Troubleshoot data pipeline failures, perform root cause analysis, and implement preventive measures.
Optimize cost and performance of Google Cloud Platform workloads using best practices for BigQuery and Dataflow.
Technical & Soft Skills Required:
Strong hands-on experience in Google Cloud Platform (Google Cloud Platform) with expertise in BigQuery, Dataflow, Cloud Composer, and GCS.
Proficient in Python programming for data engineering (Dataflow pipelines, validation scripts, automation).
Expertise in BigQuery SQL, Stored Procedures, Views, and User Defined Functions (UDFs).
Experience with data migration from on-premise or cloud data warehouses (preferably Snowflake, Teradata, Netezza, Oracle, SQL Server) to BigQuery.
Strong understanding of ETL/ELT frameworks, data modeling, and schema design (Star/Snowflake).
Familiarity with data governance, metadata, and lineage frameworks on Google Cloud Platform.- Knowledge of data validation and testing techniques, including reconciliation, rule-based checks, and automation.
Hands-on experience in workflow orchestration using Cloud Composer (Airflow) with custom operators.
Strong SQL tuning and BigQuery performance optimization skills.
Good communication and collaboration skills to work with cross-functional teams in Agile environments.
Proven ability to troubleshoot, optimize, and enhance complex data workflows at scale.
..., helping over 1,000 businesses thrive since our establishment in 2012. With a team of 200+ certified Growth Gurus, we specialize in SEO, PPC, and social advertising, delivering data-driven strategies that transform online presences. Our commitment to research and development...
...innovative construction services. For over 100 years, Wagner Roofing has been dedicated to preserving iconic buildings, commercial... ...and Virginia. Job Summary We're looking for an experienced Project Manager to join our growing team at Wagner Roofing. In this role you...
...Overview We are seeking a skilled and motivated Sheet Metal Foreman to join our dynamic team in San Antonio, TX. As a Sheet Metal Foreman, you will play a crucial role in overseeing sheet metal fabrication and installation projects, ensuring quality workmanship and adherence...
...Job Title: Dump Truck / CDL Driver Location: Jackson, SC Employment Type: Full-Time CDL: Class A or B (Class A preferred)... ...record and ability to pass DOT drug/alcohol screening. Previous experience driving dump trucks or similar heavy equipment preferred....
...DeliverThat was founded by drivers, for drivers. Our mission is to provide larger commissions... ...a number. DeliverThat is seeking independent contract delivery drivers nationwide to... ...JOB TYPE 1099 Independent Contractor Para completar el registro en espaol...