Job description:

Build and Optimize ELT/ETL Pipelines using BigQuery, GCS, Dataflow, PubSub and Orchestration services Composer/Airflow Hands-On experience in building ETL/ELT Pipelines with developing software code in Python Experience in working with data warehouses, data warehouse technical architectures, reporting/analytic tools Develop and implement data quality and governance procedures to ensure the accuracy and reliability of data Demonstrate extensive skills and success in the implementation of technology projects within a professional environment, with a particular focus on data engineering Eager to learn and explore new services within GCP to enhance skills and contribution to Projects Demonstrated excellent communication, presentation, and problem-solving skills. Prior Experience in ETL tool such as DBT,Talend EtcGood to have skills AI/ML,Gen AI Backgroud IAM, Cloud Logging and Monitoring The Data Engineer coaches the junior data engineering personnel position by bringing them up to speed and help them get better understanding of overall Data ecosystem. Working Experience with Agile methodologies and CI/CD Tools like Terraform/Jenkins Working on Solution deck, IP build, client meetings on requirement gathering

• Key Responsibilities
  1. Develop and maintain complex data models using ca erwin data modeler to support business requirements.
  2. Utilize google bigquery for data storage, querying, and analysis to ensure data accuracy and efficiency.
  3. Implement data pipelines using google dataflow to streamline data processing and transformation tasks.
  4. Write and optimize sql queries to extract and manipulate data for analysis purposes.
  5. Develop and deploy python scripts for automating data related processes and tasks.
  6. Collaborate with cross functional teams to ensure data quality, consistency, and integrity throughout the data lifecycle.
  
  Skill Requirements
  1. Proficiency in google bigquery for data storage, querying, and analysis.
  2. Strong sql skills for data manipulation and querying.
  3. Experience with python for data processing, automation, and script development.
  4. Knowledge of google dataflow for building and managing data pipelines.
  5. Familiarity with ca erwin data modeler for designing and maintaining data models.
  6. Strong analytical and problem-solving abilities.
  7. Excellent communication and collaboration skills to work effectively with diverse teams.
  8. Ability to prioritize tasks and work efficiently in a fast paced environment.
  
  Certifications: Relevant certifications in Google BigQuery, SQL, Python, or CA Erwin Data Modeler are a plus.