Senior Data Warehouse Engineer
The Senior Data Warehouse Engineer will be responsible for overseeing the activities of the junior data warehousing department and personnel as well as designing, developing, and implementing data warehouse technology for the business.
The Senior Data Warehouse Engineer directly affects data warehousing processes through their input. The Senior Data Warehouse Engineer is responsible for the full life-cycle of the back-end development of the business’s data warehouse as well as development of ETL processes, cube development for database and performance administration, and dimensional designing of the table structures.
The Senior Data Warehouse Engineer also work closely with the senior analytics management in ensuring that the data being brought in and managed is accurate, clean, easily available, and complete. He essentially assists the business in ensuring that data warehouse processes are running at an optimum capacity at all times.
Objectives and Responsibilities of the Senior Data Warehouse Engineer
Management: The Senior Data Warehouse Engineer plays a managerial role where he is in charge of maintaining the business’s physical and logical data models, reflective of the current business environments. In this position, the Senior Data Warehouse Manager effectively manages the department’s time and resources, drafting clear time schedules to be applied by the junior Data Warehousing department.
He additionally provides technical assistance in the identification, evaluation, and development of data warehousing systems and procedures. The Senior Data Warehousing Engineer also contributes in interview process alongside senior analytics management and ensuring the successful onboarding of suitable employees in the department.
In this position, the Senior Data Warehouse Engineer also defines and promotes the data warehousing department’s design principles and best practices with regard to architecture and techniques. He is also tasked with leading data-related technical projects for the business across platforms where he participates in project planning and the analysis of the business’s data requirements and solutions.
The Senior Data Warehouse Engineer will also design and support the table schemas and database for new and existent data sources for the business’s data warehouse. He further creates and supports the ETL to facilitate the on-boarding of data into the data warehouse through the use of SSIS and other technologies. In this position, the Senior Data Warehouse Engineer takes initiative to guide and mentor junior data warehousing personnel and contractors on technical standards and procedural data warehousing principles.
Design/Strategy: The Senior Data Warehousing Engineer additionally plays a strategic role where he defines and develops designs that support functional and departmental data marts. In his strategic position, the Senior Data Warehouse Engineer provides input to physical database development and data modeling standards and constantly reviews the database structures of current and impending business projects.
The Senior Data Warehouse Engineer determines the business metadata definitions for all data services supported in the databases, for example, data stores, operational source systems, and data marts. As mentioned, he is also responsible for the development of physical and logical data models that document source data from multiple sources such as Salesforce, external data source, spread sheets, systems, and so forth.
In this capacity, the Senior Data Warehouse Engineer will also develop ETL and SQL in order to target data mapping, including physical names, logical names, volumetrics, data types, corporate meta-data definitions, and domain definitions. The Senior Data Warehouse Engineer also designs review sessions and ensures that all solutions are pre-defined and aligned to architectural specifications. This is in addition to creating and supporting data load processes through database refreshes and SSIS. The Senior Data Warehouse Engineer further creates and updates technical documentation and participates in documenting all ETL and data warehouse flows and processes.
Collaboration: The role of the Senior Data Warehouse Engineer is also highly collaborative and he works closely with all analytical teams for the purpose of ensuring that the business’s data warehouse is able to support all of the business requirements across departments. He also partners with junior data warehousing personnel in the delivery of data warehouse development solutions. The Senior Data Warehouse Engineer additionally works with senior analytics management in the creation and maintenance of specific sets of applications, business intelligence databases, and spanning data warehouse. In this collaboration he also designs the business’s data architecture allowing data services to evolve with the business.
Analytics: The Senior Data Warehouse Engineer also plays an analytical role where he ensures that there is a consistently strong database setup, maintenance, configuration, programming, troubleshooting, debugging, and testing. In this position, the Senior Data Warehouse Engineer maintains the business’s operating systems, architectures, and database environments. He utilizes data warehousing methodology and best practices in creating and supporting analysis service cubes that assist in query performance. In this capacity, he also monitors, troubleshoots, and develops actionable/lasting solutions for data warehouse servers.
Knowledge: It is also the Senior Data Warehouse Engineer’s duty to conduct research and promote new techniques and data warehousing tools that shape the future of the data warehousing in the business. The Senior Data Warehouse Engineer keeps up with industry best practices and trends, incorporating the most suitable practices to improve the business’s data warehousing activities.
Other Duties: The Senior Data Warehouse Engineer performs similar duties as he deems necessary for the proper execution of his duties and duties as delegated by the Head of Analytics, Director Analytics, and Chief Data Officer.
Required Qualifications of the Senior Data Warehouse Engineer
Education: The Senior Data Warehouse Engineer has to have a bachelor’s degree (master’s preferred) in Computer Science, Data Science, Information Technology, Statistics, Information Systems, or any other related field. An equivalent of this requirement in working experience is also acceptable for this position.
Experience: A candidate for this position must have had at least 5 years working in a data warehousing position within a fast-paced and complex business environment, preferably working as a Data Warehouse Engineer. The candidate must also have had experience developing schema data models in a data warehouse environment. The candidate will also have had experience with full implementation of system development lifecycle (SDLC).
He will additionally have demonstrated knowledge of database concepts of data mapping and modeling inclusive of normalization, referential integrity, dimensionality, keys, indexes, metadata, and master data.
The candidate must also have a proven and successful experience working with ETL concepts of data integration, consolidation, enrichment, and aggregation. The candidate will have had experience working with SQL server database administration, integration services, analysis services, and MDX query language. A suitable candidate will also have a strong demonstrated understanding of dimensional modeling and similar data warehousing techniques as well as having experience working with relational or multi-dimensional databases and business intelligence architectures.
Communication Skills: A Senior Data Warehousing Engineer must be an excellent communicator both in written and verbal form. The position is a highly interactive one and good communication skills will enable effective communications between the Senior Data Warehouse Engineer and all collaborating departments and personnel. The Senior Data Warehouse Manager also oversees functions of the junior data warehousing team and, as such, he must be highly effective in communicating information and instructions down the line, which will ensure equally efficient execution of duties by the junior data warehousing personnel.
The Senior Data Warehouse Engineer will also be regularly required to draft data designs and tables, which can be quite technical. For these to be clear, engaging, and easily understandable even by non-technical personnel, the Senior Data Warehouse Engineer will need to employ top-notch communication skills in tailoring the material.
Computer Skills/Ms Office/Software: The Senior Data Warehouse Engineer must additionally possess excellent computer skills and be highly proficient in the use of Ms Word, PowerPoint, Ms Excel, MS Project, MS Visio, and MS Team Foundation Server, which will all be useful in the creation of visually and verbally engaging data designs and tables and the communication of data warehousing processes for use across the business. As a bonus, the candidate for this position will demonstrate proficiency in data visualization tools.
Analytical Skills: As expected, a candidate for the position will have passion as well as skill in research and analytics as well as a passion for data management tools and technologies. The candidate must have an ability to perform detailed data analyses, for example, in determining the content, structure, and quality of data through the examination of data samples and source systems. He will additionally have the ability to troubleshoot data warehousing issues and quickly resolve them.
The candidate will also have extensive knowledge of SQL, a deep understanding of database full life-cycle designing, and application development. The Senior Data Warehouse Engineer must additionally have high-level development skills in SQL, SSIS, and PowerShell scripting as well as SQL Server Clustering, Analysis Services, Reporting Services, and Replication.
Interpersonal Skills: A candidate for this position will additionally have a demonstrated ability to work in a collaborative setting, be self-motivated and proactive working under minimal supervision and going beyond his call of duty, have an ability to work independently as well as with a team, have an ability to work on multiple tasks prioritize and meet tight deadlines, be a creative and strategic thinker, have an insatiable thirst for knowledge, be an innovative problem-solver, and demonstrate calmness and composure in times of uncertainty and stress.
People Skills: The Senior Data Warehousing Engineer must be an approachable and likable person who inspires trust, confidence, and a feeling of dependability. This will ensure that junior data warehousing personnel, senior analytics management, and collaborating personnel/departments readily accept his insights and directives, ensuring smooth execution of his duties.