Skip to content

Senior Data Engineer

  • Department:
  • Knowledge Mangement
  • Location:
  • Hybrid in Tampa, FL

Summary of Duties & Responsibilities

The BST AI & Analytics product team delivers data-driven business analytic solutions leveraging artificial intelligence (AI), Big Data architecture and machine learning expertise to deliver business intelligence (BI) and analytics insight for the professional consulting market.

The Senior Data Engineer is a key member of the AI & Analytics team, providing domain expertise and leadership to deliver data-related products, features, and functionality that serves business and technical leaders.

The Senior Data Engineer must have a thorough knowledge of Microsoft Big Data solutions. This individual will be responsible for defining high-volume data processing pipelines in a multi-tenant environment, verifying data integrity and curating data for consumption by data warehouse, third-party data analytics tools and machine learning models.

The ideal candidate is an exceptional critical thinker with strong business acumen that is adept at solving complex problems and creating elegant business solutions. You will be involved in the design and development efforts for our big data solutions including data lake, Business Intelligence Solutions, Machine Learning, Data Pipeline and cloud-based data warehouse products.

Essential Functions

  • Strong analytical skills, able to translate complex business requirements into sound data management and data governance solutions
  • Work with clients to understand data analytics requirements. Analyze data to ensure it meets specific data management, data governance,  and data quality assurance requirements before processing the data within the Data Lake and data warehouse
  • Work with the Product Managers, Database Architect or BI Architect to understand data pipeline and data life cycle processing requirements and patterns
  • Install and configure data sources for use by the data pipelines
  • Work with the Database Architect to define data management, data governance, and data quality assurance requirements to manage the entire data processing life cycle
  • Acts as a key contributor to all phases of the design and development lifecycle of analytic applications utilizing Microsoft Azure and BI technology platforms
  • Curates data for analyses, business reviews, and operational data analysis demands
  • Use an agile approach to define requirements, design and develop data pipeline solutions to enable near real-time change data capture (CDC) and data consumption
  • Proficient in applying data management, data governance, and data quality processes and tools to correlate disparate sources

Skills & Competencies

  • Strong business acumen and proven experience in solving complex problems and creating elegant business solutions
  • Adept at using large data sets to find opportunities for product and process optimization and using models to test the effectiveness of different courses of action
  • Advanced SQL development skills, broad exposure to all language constructs
  • Experience with Microsoft On-premise SQL Server (2017 or higher) and Azure SQL Server technologies including broad experience with SQL Server capabilities and tools (e.g., CDC, Columnstore Index, In-memory Table, SSAS Tabular, DAX, T-SQL, SSIS)
  • Experience in Power BI, Power BI Embedded, Power BI Services, Power BI Gateway, and Power BI Dataflow
  • Experience with Azure products and services including Azure Data Lake Gen2, Azure Databricks, Azure Databricks Unity Catalog, Databricks API, Databricks Row-level security, Databricks error logging, Azure SQL Server, and Azure Analysis Services.
  • Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence
  • Experience with data integration through APIs, Web Services, SOAP, and/or REST services
  • Experience with Lakehouse architecture and design for multi-tenant, OLTP data modeling, dimensional data modeling, composite modeling, data transformation, row-level security, and designing the most optimal analytical data structures for near real-time data analytics
  • Additional programming experience is a plus (preferably.NET) or other languages such as Python, Scala, R.

Education or Prior Work Experience

  • Bachelor’s degree in CS
  • 10+ years of experience with designing and developing complex data analytics solutions
  • 5+ years of experience with Microsoft Big Data solutions

Reports to

Manager, Software Engineering

Number Supervised

0

Travel

Upto 15%

Classification

Exempt

Work Environment

This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines.

Physical Demands

While performing the duties of this job, the employee is regularly required to talk or hear. The employee frequently is required to stand; walk; use hands to finger, handle or feel; and reach with hands and arms. Position may require remote work across different time zones.

BST Global Applicant and Worker Privacy Notice

Join Our Team

Start the application process by telling us a little bit about yourself.

Senior Data Engineer