Sr Data Engineer – Python Spark

At TeamStation AI, we are on a mission to bring together the brightest minds to solve tomorrow’s toughest technology challenges. Our work is about more than just AI—it’s about building the future through collaboration and innovation. We believe that the key to solving the world’s most complex problems lies in aligning diverse talents and perspectives. Our AI-powered platform enables cutting-edge scientific and technical teams to work smarter, faster, and together. By joining us, you’ll help unlock new technological breakthroughs and drive innovation where it matters most.

Join the Mission at TeamStation AI!

Where do we come from? We are seeking visionaries, innovators, and problem solvers who thrive in fast-paced, collaborative environments. If you’re passionate about AI, technology, and solving critical challenges, we want to hear from you. Come be part of a team where your ideas can drive the future.

Data Engineer – Python Spark Architect for Global Data Systems (Senior Level)

Location: Mexico | Remote

Let’s talk about your current situation. Is your life a constant cycle of fixing broken ETL scripts written by someone who quit six months ago? Are you babysitting cron jobs that fail silently? Are you spending more time patching up ancient data lakes than you are building new, robust systems? If your current job is just maintenance, you will be deeply unsatisfied here.

We are looking for an engineer who wants to design the next generation of data infrastructure, not just patch the last one.

Here is the reality of our TeamStation AI Partner: Our AI and ML models run on data. A colossal amount of data. This data is the complex, messy truth of the Out-of-Home (OOH) media industry, including massive geospatial, behavioral, and transactional datasets. If the data is late, wrong, or slow, the AI fails, and our global platform stops delivering value. You are the one responsible for the integrity, performance, and scalability of the entire data ecosystem. Without you, the Data Scientists are just looking at pretty pictures.

What You’ll Do

• Design and Build the Future: Architect, construct, and optimize highly scalable, fault-tolerant ETL/ELT pipelines for massive batch and streaming data workloads.
• Master Big Data Tools: UtilizeApache Sparkand theDatabricksplatform extensively to ingest, transform, and serve data efficiently across the organization.
• Ensure Data Quality: Implement robust data validation, monitoring, and testing frameworks to guarantee data integrity—because garbage in means garbage out, and we don't sell garbage.
• Model for Performance: Design and maintain optimized data models (e.g., dimensional, normalized) in data warehouses likeSnowflakeorAWS Redshift.
• Infra as Code: Work withAWSservices (Glue, EMR, S3) and infrastructure tools like Terraform to ensure our environment is reproducible and stable.

Tech Stack & Tools

• Languages:Python, AdvancedSQL
• Big Data Processing:Apache Spark,Databricks
• Orchestration:Apache Airflow
• Cloud Platform:AWS(Glue, EMR, S3, Kinesis)
• Warehousing:SnowflakeorAWS Redshift
• Version Control:Git

Requirements

• 6+ years of professional experience in Data Engineering or a related high-scale distributed systems role.
• Expert-level proficiency inPythonand AdvancedSQLfor complex data manipulation and performance tuning.
• Mandatory hands-on experience designing and implementing large-scale data pipelines usingApache Sparkand theDatabricksplatform.
• Proven expertise with cloud infrastructure, particularlyAWSdata services.
• Experience with data modeling techniques (e.g., Kimball).
• Fluent in English.

Nice-to-Have (Bonus Points!)

• Experience with Infrastructure as Code (Terraform).
• Knowledge of real-time data streaming technologies (Kafka, Kinesis).
• Experience with geospatial data handling and processing.

What’s in It for You?

• Competitive Compensation: Top-tier rates for the engineers who build the bedrock of our company.
• Fully Remote Work: Mexico only. No commute, no suit—just ship reliable data.
• Career Growth: Lead the technical direction of our data platform.
• Real Impact: Your pipelines feed the AI that is transforming a global industry.

Learn more about TeamStation AI Careers!