Senior Data Engineer - Fandango
NBCUniversal
- Orlando, FL
- Permanent
- Full-time
- Contribute to and help lead team in design, build, testing, scaling, and maintaining data pipelines from a variety of source systems and streams (Internal, third party, cloud based, etc.), according to business and technical requirements.
- Continually work on improving the codebase and have active participation and oversight in all aspects of the team, including agile ceremonies.
- Collaborate with business leaders, engineers, and product managers to understand data needs.
- Become a subject matter expert for data engineering related technologies and designs.
- Develop and champion best practices, striving towards excellence and raising the bar within the department.
- Troubleshoot and fix production issues as they occur.
- Mentor team members with complex technical and design issues.
- BA/BS degree in Computer Science, Computer Engineering or related technical field or equivalent practical experience.
- 9+ years of applied experience in Data Engineering, including but not limited to building Data Pipelines, Orchestration, Data Modeling & Data Lake.
- Programming skills in one or more of the following: Python, Java, Scala, SQL, and experience in writing reusable/efficient code to automate analysis and data processes.
- Experience in Data Warehousing (Relational and dimensional data modeling).
- Strong working experience with variety of data sources such as APIs, real-time feeds, structured and semi structured file formats.
- Experience with processing large datasets and building code using SQL, Python, pySpark & Apache Airflow / Amazon MWAA.
- Experience of near Real Time & Batch Data Pipeline development.
- Experience with AWS data management (S3, Redshift, DynamoDB) and related tools (Athena, EMR, Glue, Lambda).
- Experience working with Terraform.
- Experience working in an agile/scrum environment.
- Experience with Talend, Informatica, or other off-the-shelf ETL tools.
- Familiar with software build, release, deployment and monitoring tools and practices.
- Strong Test-Driven Development background, with understanding of levels of testing required to continuously deliver value to production.
- Team-oriented and collaborative approach with a demonstrated aptitude, enthusiasm, and willingness to learn new methods, tools, practices, and skills.
- Ability to work effectively across functions, disciplines, and levels