Senior Data Engineer- GCP

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Quantiphi

About the Company Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quantifiable business impact. We were founded on the belief that machine learning and artificial intelligence are transformative technologies that will create the next quantum gain in customer experience and unit economics of businesses. We are one of the five global launch partners for Google in Machine Learning and one of the three global launch partners for the Google Cloud Contact Center AI solution. Our signature approach combines ground-breaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. We believe in “Solving What Matters.”

Experience Level 8 to 15 Years

Responsibilities

Bachelor’s degree in Computer Science or similar field or equivalent work experience.

6+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.

Expert with data warehousing concepts, strategies, and tools.

Strong SQL background.

Strong knowledge of relational databases like SQL Server, PostgreSQL, MySQL.

Strong experience in GCP & Google BigQuery, Cloud SQL, Composer (Airflow), Dataflow, Dataproc, Cloud Function and GCS.

Good to have knowledge on SQL Server Reporting Services (SSRS), and SQL Server Integration Services (SSIS).

Knowledge of AWS and Azure Cloud is a plus.

Experience in Informatica Power exchange for Mainframe, Salesforce, and other new-age data sources.

In-depth understanding of database management systems, online analytical processing (OLAP) and ETL (Extract, transform, load) framework, data-warehousing and Data Lakes.

Good understanding of SDLC, Agile and Scrum processes.

Strong problem-solving, multi-tasking, and organizational skills.

Highly proficient in working with large volumes of business data and strong understanding of database design and implementation.

Good written and verbal communication skills.

Demonstrated experience of leading a team spread across multiple locations.

Role & Responsibilities

Work with business users and other stakeholders to understand business processes.

Ability to design and implement Dimensional and Fact tables.

Identify and implement data transformation / cleansing requirements.

Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data Warehouse.

Develop conceptual, logical, and physical data models with associated metadata including data lineage and technical data definitions.

Design, develop and maintain ETL workflows and mappings using the appropriate data load technique.

Provide research, high-level design, and estimates for data transformation and data integration from source applications to end-user BI solutions.

Provide production support of ETL processes to ensure timely completion and availability of data in the data warehouse for reporting use.

Analyze and resolve problems and provide technical assistance as necessary. Partner with the BI team to evaluate, design, develop BI reports and dashboards according to functional specifications while maintaining data integrity and data quality.

Work collaboratively with key stakeholders to translate business information needs into well-defined data requirements to implement the BI solutions.

Leverage transactional information, data from ERP, CRM, HRIS applications to model, extract and transform into reporting & analytics.

Define and document the use of BI through user experience / use cases, prototypes, test, and deploy BI solutions.

Develop and support data governance processes, analyze data to identify and articulate trends, patterns, outliers, quality issues, and continuously validate reports, dashboards and suggest improvements.

Train business end-users, IT analysts, and developers.

Seniority level

Associate

Employment type

Full-time

Job function

Consulting and Information Technology

IT Services and IT Consulting and Software Development

Industries

IT Services and IT Consulting and Software Development

#J-18808-Ljbffr