Senior Data Engineer, Data Insights & Analytics
AlixPartners
- Detroit, MI
- Permanent
- Full-time
- Design and implement scalable data architectures, ensuring efficient data flow and storage. This involves working with technologies like Azure Data Lake, Data Bricks PySpark, and Data Bricks SQL Pro
- Develop and optimize ETL processes including extracting data from source systems, transforming it into a usable format, and loading it into the target storage.
- Create and maintain data pipelines that facilitate the flow of data from various sources to Data Lake or other storage systems.
- Implement process to ensuring data quality and integrity. Responsibilities include validating and cleansing data to maintain its quality and integrity.
- Work closely with cross-functional teams, including business analysts, quality assurance, report developers, administrators, and stakeholders to identify and address data-related issues.
- Troubleshoot and resolve issues with Data Lake, Pipelines, Reports, and related infrastructure; escalate to other technology support resources as needed.
- Schedule, communicate, perform, and monitor both regular and ad hoc pipeline activities in accordance with defined policies and procedures.
- Participate in the creation (or modification) of documentation activities related to system design, configuration, and operation, support policies and compliance procedures.
- Adhere to and perform against internal SLAs to the business.
- Additional responsibilities as identified. This description is not designed to encompass a comprehensive listing of required activities, duties, or responsibilities.
- Bachelors' degree preferred.
- Minimum three (3) years of data engineering experience is required.
- Experience using Data Bricks and PySpark.
- Experience in Microsoft Azure Cloud Services.
- Experience in a 24x7 service delivery model supporting mission-critical business operations.
- Demonstrated interpersonal skills; proven ability to work effectively with various personnel styles; ability to effectively convey and obtain buy-in for holistic strategies at all levels and functions in the organization.
- Excellent written and verbal communication skills in English.
- Willingness to work outside of normal U.S. business hours, and as unique projects/needs arise.
- Ability to work full time in an office and remote environment; physically able to sit/stand at a computer and work in front of a computer screen for significant portions of the workday.
- Must become familiar with, and promote and abide by, our Core Values as defined by the AlixPartners'