Sr. Principal Consultant (Senior Data Engineer, Compliance Engineering & Technology) 3 resources Subcontracting roles Location: Remote & (US-PST time zone)
11 Months Contract Responsibilities
Resources should have experience with AML & KYC.
Work with engineering and product teams to design, develop, and manage scalable ETL pipelines to unblock new product launches.
Create brand new and optimize existing data models and schemas on top of Block data including but not limited to eventing, customer level, and process level data.
Build monitoring to assess the health of the team's infrastructure as well as data quality and lineage.
Participate in on-call rotation, monitor daily execution, diagnose and log issues, and fix business critical pipelines to ensure SLAs are met with internal stakeholders
Work with non-technical partners and product teams to understand their needs, translate business requirements into applicable data requirements, and come up with automated end-to-end solutions.
Standardize business and product metric definitions in curated and optimized datasets and develop data dictionaries and other related documentation.
Teach and encourage others to self-serve by building tools that make it simpler and faster for them to do so.
Should have experience working on below technology
Snowflake
Databricks
Dbt
Github
Airflow
Prefect
Tableau
Qualifications we seek in you! Minimum Qualifications / Skills
B.E/B.TECH/ Any Graduation Equivalent
Preferred Qualifications/ Skills
A minimum of 8 years of related experience with a bachelor's degree; or 6 years and a master's degree; or equivalent experience.
High proficiency in SQL
Working experience with Python, and Terraform
Experience designing medium-to-large data engineering solutions and responsible for the entire lifecycle of projects including scoping, design, development, testing, deployment, and documentation
Experience with ETL scheduling technologies with dependency checking, such as Airflow or Prefect, as well as schema design and dimensional data modeling
Experience with setting up data quality and data lineage monitoring
Experience with financial crimes compliance systems, technologies, and processes is a big plus
Experience driving data-driven decisions for AI initiatives / agent building is a big plus
