Sr Data Engineer - Databricks

Category

Location

Remote

Type

Full Time

Salary (USD)

Non disclosed

Job Description

Posted on June 29, 2023

At TeamStation AI, we are on a mission to bring together the brightest minds to solve tomorrow’s toughest technology challenges. Our work is about more than just AI—it’s about building the future through collaboration and innovation. We believe that the key to solving the world’s most complex problems lies in aligning diverse talents and perspectives. Our AI-powered platform enables cutting-edge scientific and technical teams to work smarter, faster, and together. By joining us, you’ll help unlock new technological breakthroughs and drive innovation where it matters most.

Join the Mission at TeamStation AI!

Where do we come from? We are seeking visionaries, innovators, and problem solvers who thrive in fast-paced, collaborative environments. If you’re passionate about AI, technology, and solving critical challenges, we want to hear from you. Come be part of a team where your ideas can drive the future.


Ideal Skillset

  • Databricks
  • DBT
  • Prefect
  • U.S. Client Facing

Nice to Have

  • Microsoft SQL Server + SSIS
  • DevOps Experience (i.e., Terraform)
  • Continuous Integration + Continuous Deployment

Main Responsibilities

  • Design and build data pipelines: Develop and implement data ingestion pipelines from multiple sources using tools like Azure Databricks, DBT, and Prefect
  • Data analysis and support data-driven decision-making: Perform data analysis using BigQuery, SQL, or other tools to support data-driven decision-making within the organization.
  • Collaborate with cross-functional teams: Work closely with various teams to identify and prioritize data needs, ensuring efficient communication and collaboration.
  • Manage and optimize data warehouse processes: Oversee and improve data warehouse processes, including extraction, transformation, and consolidation of data stored in different SQL databases.
  • Develop scalable and reusable frameworks: Create scalable and reusable frameworks for ingesting data sets, managing data pipelines, and maintaining data quality and consistency

Job Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Proficiency in Databricks, DBT, and Prefect
  • Experience with Microsoft SQL Server, SSIS, and DevOps tools like Terraform is a plus
  • Strong analytical and problem-solving skills
  • Excellent communication and collaboration skills
  • Ability to work independently and as part of a team
  • As a Data Engineer, you will be responsible for designing and building data pipelines, analyzing data to support data-driven decision making, collaborating with cross-functional teams, managing and optimizing data warehouse processes, and developing scalable and reusable frameworks. You will work with tools like Databricks, DBT, and Prefect to create efficient data pipelines and support the organization's data needs. Your expertise in Microsoft SQL Server, SSIS, and DevOps tools like Terraform will be an added advantage. Your strong analytical, problem-solving, and communication skills will be essential in this role.
Apply now

Our easy-to-use application process makes it simple to submit your resume. Just click on the "Apply Now" button and follow the instructions.

About TeamStation

We are inspired by the spirit of exploration and innovation, much like the NASA Space Program. At the core of every technological advance lies a team of bright minds driven to accomplish the impossible. The challenge of sending humans to space and safely returning them to Earth is a marquee example of what can be achieved when a joint mission drives us.

About Us

Copyright Job Board 2024 - Powered By TeamStation