Data Engineer Python, SQL, PySpark

Job description

Join to apply for the Data Engineer - Python, SQL, PySpark role at Terminal

Join to apply for the Data Engineer - Python, SQL, PySpark role at Terminal

Get AI-powered advice on this job and more exclusive features.

About Sourcemap
Sourcemap is a pioneer of supply chain transparency and traceability software that spun out of MIT research started in 2008.

Since then major traders, manufacturers, and brands have adopted Sourcemap's full-suite solution for assurance on the raw materials-to-finished goods supply chain, including ongoing monitoring for production, quality, sustainability, and risks such as deforestation and forced labor.

About Sourcemap
Sourcemap is a pioneer of supply chain transparency and traceability software that spun out of MIT research started in 2008.

Since then major traders, manufacturers, and brands have adopted Sourcemap's full-suite solution for assurance on the raw materials-to-finished goods supply chain, including ongoing monitoring for production, quality, sustainability, and risks such as deforestation and forced labor.
About The Role
Company Overview Sourcemap is the leading provider of supply chain mapping, traceability, and transparency software.

We are the only full suite supply chain transparency and traceability solution on the market.

Our clients include category-leading global brands, manufacturers and suppliers across the food & agriculture, fashion, beauty, manufacturing and electronics industries.

We turn these clients into best-in-class responsible sourcing organizations.

We seek committed individuals who will join our team to support our award-winning, values-led work and to tackle important supply chain challenges in a dynamic startup environment.

About the Job: Sourcemap is seeking an experienced Data Engineer to join their growing engineering team.

You would be joining an enthusiastic and collaborative team of engineers in a fully remote position.

This role has a strong hands-on component as you would be building and deploying new features to their platform.

You would also take part in the development and mentorship of junior team members by sharing best practices and prior experiences.
What You’ll Do

• Development and maintenance of ETL pipelines and ELT pipelines
• Data Warehouse/Data Lake Development and management
• API Development
• Assembling large, complex sets of data that meet non-functional and functional business requirements
• Optimizing data delivery
• Automating Manual data processing procedures
• Working with stakeholders including data scientist, design, product teams, assisting them with data-related technical issues
• Excellent analytic skills associated with working with unstructured datasets
  

• 5+ years writing production-ready Data Pipelines (Python, SQL, Scala etc)
• 3+ years with relational SQL and NoSQL databases
• 2+ years of experience using geospatial tools, data and techniques(ESRI, QGIS, GDAL, Geopandas, handling multiple geometry types, coordinate transformations etc)
• A successful history of manipulating, processing and extracting value from large disconnected datasets
• Architecture experience (Microservice, AWS management, etc)
• Experience using Big Data Tools such as Databricks, Snowflake, Spark etc
• Project Management
• Other experience: Node, Javascript, GO, Git, Debugging
• Comfortable with Data Visualization & Web Mapping concepts Other Skills & Qualifications:
• Effective listening, verbal and written communication skills.
  
  Demonstrates openness to others’ ideas.
  
  
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  
  
• Ability to adapt fast and be agile in a fast-moving environment
• Enjoys working in a collaborative environment
• Goal-oriented and a self-starter
• Ability to multitask, prioritize and manage time effectively in order to meet demanding deadlines
• A natural leader; enjoys mentoring and guiding junior developers
• Enthusiastic and positive team player

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at Terminal by 2x

Sign in to set job alerts for “Data Engineer” roles.

Bogota, D.C., Capital District, Colombia 2 weeks ago

Bogota, D.C., Capital District, Colombia 20 hours ago

Bogota, D.C., Capital District, Colombia COP4,500,000.00-COP6,000,000.00 4 hours ago

Bogota, D.C., Capital District, Colombia $24,000.00-$36,000.00 6 days ago

Bogota, D.C., Capital District, Colombia 6 days ago

Bogota, D.C., Capital District, Colombia 1 week ago

Bogota, D.C., Capital District, Colombia 20 hours ago

Software Engineer (Python) Career Opportunities at Dev.Pro - 01

Bogota, D.C., Capital District, Colombia 4 weeks ago

Bogota, D.C., Capital District, Colombia 1 week ago

Bogota, D.C., Capital District, Colombia 3 months ago

Bogota, D.C., Capital District, Colombia 1 day ago

We’re unlocking community knowledge in a new way.

Experts add insights directly into each article, started with the help of AI.

Required Skill Profession

Bases De Datos, Analítica Y Bi