Senior Data Warehouse Engineer - Hadoop


Apply now


Location

NY-New York (Flatiron)

Classification

Full-Time

Description

The Senior Data Warehouse Engineer will maintain and enhance our Business Intelligence and Analytic systems. This role is a hands-on engineering position who will be responsible for the continued evolution of our data platform.

Essential Functions

• Provide expertise creating new data warehouse being built with Hortonworks Hadoop
• Architecture, design, development, and implementation of data warehouse projects.
• Assist with architecture and design for Business Intelligence and analytics.
• Create and manage data flow into multiple data warehouse systems.
• Handle testing, deployment and ongoing support of data warehouse system.
• Work with our reporting and analytic teams to build marts and tables to optimize reporting performance
• Develop and support ETL and machine learning processes
• Previous MPP solution (Aster data/Netezza) experience is a plus

Qualifications

Proficient in writing scalable, high volume ETL jobs using SQL Server Integration Services (SSIS) for large volume data warehouses. Troubleshoot and resolve data, system issues and performance issues.
• 3 or more years of experience in Hadoop (Pig/Hive) strongly preferred
• Demonstrated experience working with Azure including PowerView , PowerQuery, PowerPivot and HDInsight , Azure Data Warehouse/Data Lake
• Analyze and resolve performance issues with database code involving SSIS and MS SQL server.
• Knowledge of T-SQL, .NET and other languages (C#, Python, Java)
• Knowledge of data warehousing such as dimensional modeling, star and snowflake schemas, data mart and fact, Dimension tables, Slowly Changing Dimensions -Type I & II & III.
• Previous MPP solution (Aster data/Netezza) experience is a plus
• Be ready to contribute as part of a 24 * 7 “On call” rotation
• BA/BS, or equivalent experience, in Computer Science or related technical discipline
• 6+ years of experience doing data warehouse development.
• 4 or more years of ETL and SQL server experience (SSIS/SSAS), real world experience with SSIS (or similar)

 

Apply now

Send to yourself or a friend