Data Warehousing Specialists
15-1243.01
Design, model, or implement corporate data warehousing activities. Program and configure warehouses of database information and provide support to warehouse users.
Sample of reported job titles: Data Warehouse Analyst, Data Warehouse Solution Architect
Occupation-Specific Information
Tasks
- Develop data warehouse process models, including sourcing, loading, transformation, and extraction.
- Verify the structure, accuracy, or quality of warehouse data.
- Map data between source systems, data warehouses, and data marts.
- Develop and implement data extraction procedures from other systems, such as administration, billing, or claims.
- Design and implement warehouse database structures.
- Develop or maintain standards, such as organization, structure, or nomenclature, for the design of data warehouse elements, such as data architectures, models, tools, and databases.
- Provide or coordinate troubleshooting support for data warehouses.
- Write new programs or modify existing programs to meet customer requirements, using current programming languages and technologies.
- Design, implement, or operate comprehensive data warehouse systems to balance optimization of data access with batch loading and resource utilization factors, according to customer requirements.
- Perform system analysis, data analysis or programming, using a variety of computer languages and procedures.
- Create supporting documentation, such as metadata and diagrams of entity relationships, business processes, and process flow.
- Create or implement metadata processes and frameworks.
- Review designs, codes, test plans, or documentation to ensure quality.
- Create plans, test files, and scripts for data warehouse testing, ranging from unit to integration testing.
- Select methods, techniques, or criteria for data warehousing evaluative procedures.
- Implement business rules via stored procedures, middleware, or other technologies.
- Prepare functional or technical documentation for data warehouses.
- Test software systems or applications for software enhancements or new products.
Technology Skills
- Analytical or scientific software - IBM SPSS Statistics π₯; SAS π₯; StataCorp Stata; The MathWorks MATLAB π₯
- Application server software - Oracle WebLogic Server
- Backup or archival software - Veritas NetBackup
-
Business intelligence and data analysis software -
IBM Cognos Impromptu; Microsoft Power BI
; MicroStrategy; Oracle Business Intelligence Enterprise Edition; Qlik Tech QlikView; Tableau ; TIBCO Spotfire
- Cloud-based data access and sharing software - Microsoft SharePoint π₯
- Cloud-based management software - IBM WebSphere; Jitterbit; Splunk Enterprise π₯
- Clustering software - Aster Data nCluster; VMware
- Communications server software - IBM Domino
- Configuration management software - Perforce Helix software
- Content workflow software - Atlassian JIRA π₯
- Customer relationship management CRM software - Blackbaud The Raiser's Edge
- Data base management system software - Amazon DynamoDB π₯; Apache Cassandra π₯; Apache Flume; Apache Hadoop π₯; Apache HBase; Apache Oozie; Apache Pig; Apache Solr; Apache Sqoop; CodeFutures dbShards; Greenplum Database; InterMine; Kalido Information Engine; MongoDB π₯; NoSQL π₯; Oracle PL/SQL π₯; ParAccel Analytic Database; Relational database management software; SAND; SAP Adaptive Server Enterprise; SAP IQ; Talend Big Data Integration; TalendForge; Teradata Database π₯
- Data base reporting software - IBM Netezza TwinFin; Microsoft SQL Server Reporting Services SSRS π₯; Oracle Business Intelligence Discoverer; Oracle SQL Loader; SAP Crystal Reports
-
Data base user interface and query software -
Amazon Elastic Compute Cloud EC2 π₯; Amazon Redshift π₯; Amazon Web Services AWS software ; Apache Hive π₯; Cloudera Impala; Microsoft Access π₯; Microsoft SQL Server π₯; MySQL π₯; Oracle Database π₯; Structured query language SQL ; Teradata BTEQ; Transact-SQL π₯
- Data mining software - Rapid-I RapidMiner; SAP NetWeaver BW; Teradata FastLoad; Teradata Parallel Transporter; Teradata Tpump
- Desktop publishing software - Microsoft Publisher
-
Development environment software -
Adeptia ETL Suite; Apache Kafka π₯; C π₯; CloverETL; Common business oriented language COBOL; Eclipse IDE π₯; Integrated development environment IDE software; Microsoft .NET Framework π₯; Microsoft Azure software ; Microsoft Visual Basic π₯; Microsoft Visual Basic Scripting Edition VBScript; Microsoft Visual Studio π₯
- Document management software - Teradata FastExport
- Electronic mail software - Microsoft Outlook π₯
- Enterprise application integration software - Extensible markup language XML π₯; IBM InfoSphere DataStage; Microsoft SQL Server Integration Services SSIS π₯; SMSi Twister Data Integrator; Talend Open Studio
- Enterprise resource planning ERP software - IBM Clarity Systems Clarity; Microsoft Dynamics π₯; NetSuite ERP; Oracle Fusion Applications; Oracle Hyperion; Oracle JD Edwards EnterpriseOne; Oracle PeopleSoft π₯; SAP Business Objects; SAP software π₯
- File versioning software - Apache Subversion SVN π₯
- Financial analysis software - Oracle E-Business Suite Financials
- Geographic information system - ESRI ArcGIS software π₯
- Human resources software - Human resource management software HRMS
- Information retrieval or search software - Apache Avro
-
Metadata management software -
Adaptive Metadata Manager; Altova MapForce; Apatar; Coglin Mill RODIN; Embarcadero ER/Studio XE; Flat File Checker; HiT Software Allora; Informatica PowerCenter; Informatica software ; Oracle Warehouse Builder; Pentaho Kettle; Quest Erwin Data Modeler; SAP PowerDesigner; SAS Data Integration Server; Scriptella; Talend Data Fabric; WisdomForce DatabaseSync System
- Network monitoring software - Nagios
-
Object or component oriented development software -
Advanced business application programming ABAP; Apache Spark π₯; C# π₯; C++ π₯; Objective C π₯; Oracle Java π₯; Perl π₯; Python ; R π₯; Scala π₯
- Object oriented data base management software - PostgreSQL π₯
-
Office suite software -
Microsoft Office software
- Operating system software - Apple macOS π₯; Bash π₯; Hewlett Packard HP-UX; Job control language JCL; KornShell; Linux π₯; Microsoft Windows π₯; Oracle Solaris; Red Hat Enterprise Linux; Shell script π₯; Ubuntu; UNIX π₯; UNIX Shell π₯
- Portal server software - Apache HTTP Server
-
Presentation software -
Microsoft PowerPoint
- Process mapping and design software - Microsoft Visio π₯
- Project management software - Microsoft Project π₯
- Requirements analysis and system architecture software - Unified modeling language UML
-
Spreadsheet software -
Microsoft Excel
- Storage networking software - Amazon Simple Storage Service S3 π₯
- Transaction security and virus protection software - McAfee; NortonLifeLock cybersecurity software
- Transaction server software - Customer information control system CICS
- Web platform development software - Ruby on Rails π₯
- Word processing software - Microsoft Word π₯
Occupational Requirements
Work Activities
- Getting Information - Observing, receiving, and otherwise obtaining information from all relevant sources.
- Monitoring Processes, Materials, or Surroundings - Monitoring and reviewing information from materials, events, or the environment, to detect or assess problems.
- Identifying Objects, Actions, and Events - Identifying information by categorizing, estimating, recognizing differences or similarities, and detecting changes in circumstances or events.
- Inspecting Equipment, Structures, or Materials - Inspecting equipment, structures, or materials to identify the cause of errors or other problems or defects.
- Estimating the Quantifiable Characteristics of Products, Events, or Information - Estimating sizes, distances, and quantities; or determining time, costs, resources, or materials needed to perform a work activity.
- Judging the Qualities of Objects, Services, or People - Assessing the value, importance, or quality of things or people.
- Processing Information - Compiling, coding, categorizing, calculating, tabulating, auditing, or verifying information or data.
- Evaluating Information to Determine Compliance with Standards - Using relevant information and individual judgment to determine whether events or processes comply with laws, regulations, or standards.
- Analyzing Data or Information - Identifying the underlying principles, reasons, or facts of information by breaking down information or data into separate parts.
- Making Decisions and Solving Problems - Analyzing information and evaluating results to choose the best solution and solve problems.
- Thinking Creatively - Developing, designing, or creating new applications, ideas, relationships, systems, or products, including artistic contributions.
- Updating and Using Relevant Knowledge - Keeping up-to-date technically and applying new knowledge to your job.
- Developing Objectives and Strategies - Establishing long-range objectives and specifying the strategies and actions to achieve them.
- Scheduling Work and Activities - Scheduling events, programs, and activities, as well as the work of others.
- Organizing, Planning, and Prioritizing Work - Developing specific goals and plans to prioritize, organize, and accomplish your work.
- Performing General Physical Activities - Performing physical activities that require considerable use of your arms and legs and moving your whole body, such as climbing, lifting, balancing, walking, stooping, and handling materials.
- Handling and Moving Objects - Using hands and arms in handling, installing, positioning, and moving materials, and manipulating things.
- Controlling Machines and Processes - Using either control mechanisms or direct physical activity to operate machines or processes (not including computers or vehicles).
- Operating Vehicles, Mechanized Devices, or Equipment - Running, maneuvering, navigating, or driving vehicles or mechanized equipment, such as forklifts, passenger vehicles, aircraft, or watercraft.
- Working with Computers - Using computers and computer systems (including hardware and software) to program, write software, set up functions, enter data, or process information.
- Drafting, Laying Out, and Specifying Technical Devices, Parts, and Equipment - Providing documentation, detailed instructions, drawings, or specifications to tell others about how devices, parts, equipment, or structures are to be fabricated, constructed, assembled, modified, maintained, or used.
- Repairing and Maintaining Mechanical Equipment - Servicing, repairing, adjusting, and testing machines, devices, moving parts, and equipment that operate primarily on the basis of mechanical (not electronic) principles.
- Repairing and Maintaining Electronic Equipment - Servicing, repairing, calibrating, regulating, fine-tuning, or testing machines, devices, and equipment that operate primarily on the basis of electrical or electronic (not mechanical) principles.
- Documenting/Recording Information - Entering, transcribing, recording, storing, or maintaining information in written or electronic/magnetic form.
- Interpreting the Meaning of Information for Others - Translating or explaining what information means and how it can be used.
- Communicating with Supervisors, Peers, or Subordinates - Providing information to supervisors, co-workers, and subordinates by telephone, in written form, e-mail, or in person.
- Communicating with People Outside the Organization - Communicating with people outside the organization, representing the organization to customers, the public, government, and other external sources. This information can be exchanged in person, in writing, or by telephone or e-mail.
- Establishing and Maintaining Interpersonal Relationships - Developing constructive and cooperative working relationships with others, and maintaining them over time.
- Assisting and Caring for Others - Providing personal assistance, medical attention, emotional support, or other personal care to others such as coworkers, customers, or patients.
- Selling or Influencing Others - Convincing others to buy merchandise/goods or to otherwise change their minds or actions.
- Resolving Conflicts and Negotiating with Others - Handling complaints, settling disputes, and resolving grievances and conflicts, or otherwise negotiating with others.
- Performing for or Working Directly with the Public - Performing for people or dealing directly with the public. This includes serving customers in restaurants and stores, and receiving clients or guests.
- Coordinating the Work and Activities of Others - Getting members of a group to work together to accomplish tasks.
- Developing and Building Teams - Encouraging and building mutual trust, respect, and cooperation among team members.
- Training and Teaching Others - Identifying the educational needs of others, developing formal educational or training programs or classes, and teaching or instructing others.
- Guiding, Directing, and Motivating Subordinates - Providing guidance and direction to subordinates, including setting performance standards and monitoring performance.
- Coaching and Developing Others - Identifying the developmental needs of others and coaching, mentoring, or otherwise helping others to improve their knowledge or skills.
- Providing Consultation and Advice to Others - Providing guidance and expert advice to management or other groups on technical, systems-, or process-related topics.
- Performing Administrative Activities - Performing day-to-day administrative tasks such as maintaining information files and processing paperwork.
- Staffing Organizational Units - Recruiting, interviewing, selecting, hiring, and promoting employees in an organization.
- Monitoring and Controlling Resources - Monitoring and controlling resources and overseeing the spending of money.
Detailed Work Activities
- Develop models of information or communications systems.
- Evaluate data quality.
- Develop diagrams or flow charts of system operation.
- Develop procedures for data management.
- Create databases to store electronic data.
- Troubleshoot issues with computer applications or systems.
- Modify software programs to improve performance.
- Design software applications.
- Write computer programming code.
- Analyze data to identify trends or relationships among variables.
- Document operational procedures.
- Evaluate project designs to determine adequacy or feasibility.
- Develop testing routines or procedures.
- Develop performance metrics or standards related to information technology.
- Test software performance.