Senior Software Engineer / Databricks / Terraform / AWS
Motion Recruitment
- Chicago, IL
- Contract
- Full-time
As a Data Engineer, you will play a critical role onboarding new users to Databricks and providing technical support to troubleshoot issues. The ideal candidate will have a strong background in data engineering, with a focus on Databricks, and possess comprehensive knowledge of Terraform, CI/CD, DevOps Practices, and AWS services. This individual will collaborate closely with cross-functional teams to ensure seamless integration of Databricks within our infrastructure and drive continuous improvement initiatives.
We encourage you to apply for this exciting opportunity and be part of a company that values sustainability, social responsibility, community engagement, innovation, and growth. Required Skills & Experience
- Bachelor's degree in Computer Science, Engineering, or a related field; or equivalent work experience.
- Proven experience as a Data Engineer with a focus on Databricks, including setup, configuration, and optimization.
- Strong proficiency in Terraform for infrastructure as code (IaC) and automation.
- Experience with CI/CD pipelines, version control systems (e.g., Git), and related tools (e.g., Jenkins, CircleCI).
- In-depth knowledge of DevOps principles and practices, with hands-on experience in deploying and managing applications on AWS.
- Familiarity with cloud-native architectures, services, and security best practices in AWS.
- Excellent problem-solving skills and the ability to troubleshoot complex technical issues independently.
- Strong communication and collaboration skills, with the ability to effectively interact with cross-functional teams and stakeholders.
- Proactive attitude towards learning and professional development, with a passion for staying abreast of industry trends and advancements.
- Lead the onboarding process for new users to Databricks, including setup, configuration, and customization according to specific requirements.
- Provide technical expertise and support to troubleshoot and resolve Databricks-related issues, ensuring minimal disruption to operations.
- Develop and maintain automated deployment pipelines using Terraform and CI/CD tools to streamline Databricks infrastructure provisioning and management.
- Collaborate with DevOps teams to optimize Databricks environments for performance, scalability, and reliability.
- Implement and maintain best practices for security, monitoring, and governance within Databricks, adhering to compliance standards and regulatory requirements.
- Contribute to the design and implementation of data pipelines, ETL processes, and data integrations leveraging Databricks and other related technologies.
- Stay updated on emerging trends and advancements in Databricks, Terraform, CI/CD, DevOps, and AWS, and evaluate their potential impact on our infrastructure and processes.
- Drive knowledge sharing and mentorship initiatives to empower team members with Databricks expertise and foster a culture of continuous learning.
- XX% Red Hat Linux
- XX% Windows Server 2010
- XX% Hands On
- XX% Management Duties
- XX% Team Collaboration
- Bonus OR Commission eligible
- Medical, dental, vision, and life insurance plans
- Paid time off (PTO) and 6 company holidays per year
- Automatic 6% 401(k) company contribution each pay period
- Employee discounts, parental leave, 3:1 match on donations and tuition reimbursement
- A comprehensive set of emotional, financial, physical and social wellbeing programs