Data Engineer III

Job description

Who We Are
At Twilio, we're shaping the future of communications, all from the comfort of our homes.

We deliver innovative solutions to hundreds of thousands of businesses and empower millions of developers worldwide to craft personalized customer experiences.

Our dedication to remote-first work, and strong culture of connection and global inclusion means that no matter your location, you're part of a vibrant team with diverse experiences making a global impact each day.

As we continue to revolutionize how the world interacts, we're acquiring new skills and experiences that make work feel truly rewarding.

Your career at Twilio is in your hands.

See yourself at Twilio
Join the team as Twilio's next Data Engineer on Twilio's Enterprise Data & Analytics team.

About The Job
We are seeking a creative and savvy Data Engineer to join our growing data platform team to develop data infrastructure to support our next generation products and data initiatives.

In this group, you will be responsible for building, operationalizing and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.

You should be a skillful data pipeline builder and data wrangler who has experience of optimizing data systems and building them from the ground up.

You are expected to support our software developers, database architects, data analysts and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects.

You must have excellent communication skills, have a strong sense of ownership, be self-directed and comfortable supporting the data needs of multiple cross-functional teams.

This is a hands-on role and requires prior programming experience working with data on cloud.

Responsibilities
In this role, you'll:

• Be involved into Data Pipeline Building, Optimization and Operationalization
• Create and maintain optimal data pipeline architecture,
• Assemble large, complex data sets that meet functional / non-functional business requirements.
  
  
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability,
• Operationalize, improving the quality and reliability of data pipelines (monitoring, retry, failure detection) Data Platform and Self-serving Data Infrastructure
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using various data tools and cloud services.
  
  
• Design and build abstractions that hide the complexity of the underlying big data processing and execution stack and that allow data consumers/partners to focus on their strengths: product, data modeling, data analysis, search, information retrieval, and machine learning.
  
  
• Build processes and infrastructure to manage lifecycle of datasets: data structures, metadata, dependency and workload management.
  
  
• Building internal services and tools to help in-house partners implement, deploy and analyze datasets with a high level of autonomy and limited friction.
  
  

Qualifications
Twilio values diverse experiences from all kinds of industries, and we encourage everyone who meets the required qualifications to apply.

If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio.

We are always looking for people who will bring something new to the table

Required

• Related degree or comparable formal training, certification, or work experience
• 3-5 years of experience working in data engineering using Python on Cloud platforms like AWS.
  
  Proficient in programming in Python.
  
  With experience of S3, Glue, Snowflake, REST API
• Experience with Tableau dashboards and Looker as visualization tools
• Expert in SQL programming and experience working with relational databases, as well as working familiarity with Redshift.
  
  
• Experience building and optimizing 'big data' data pipelines, architectures and data sets.
  
  
• Strong analytic skills related to working with unstructured datasets.
  
  A successful history of manipulating, processing and extracting value from large, disconnected datasets.
  
  
• Strong problem-solving skills to understand complex structured and/or unstructured datasets and their relationships to find issues and provide programmatic solutions.
  
  
• Working experience in data analytics (data wrangling, integration, visualization), and reporting using BI (Business Intelligence) tools
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  
  
• Strong project management and organizational skills.
  
  Strong sense of ownership.
  
  
• Collaborative personality with experience supporting and working with cross-functional teams in a dynamic environment.
  
  

Desired

• MS or BS in CS, Engineering, Math, Statistics, or a related field or equivalent practical experience in data engineering.
  
  
• Proficiency in other high-level programming languages (Go, Java, Scala, or equivalent)
• Experience with Technologies like Kubeflow, EKS, Docker
• Experience with machine learning algorithms
• Data-driven approach to problem solving
• The ability to visualize and communicate complex concepts

Location
This role will be remote, and based in Colombia.

Travel
We prioritize connection and opportunities to build relationships with our customers and each other.

For this role, you may be required to travel occasionally to participate in project or team in-person meetings.

What We Offer
Working at Twilio offers many benefits, including competitive pay, generous time off, ample parental and wellness leave, healthcare, a retirement savings program, and much more.

Offerings vary by location.

Twilio thinks big.

Do you?
We like to solve problems, take initiative, pitch in when needed, and are always up for trying new things.

That's why we seek out colleagues who embody our values — something we call Twilio Magic.

Additionally, we empower employees to build positive change in their communities by supporting their volunteering and donation efforts.

So, if you're ready to unleash your full potential, do your best work, and be the best version of yourself, apply now If this role isn't what you're looking for, please consider other open positions.

Twilio is proud to be an equal opportunity employer.
We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics.

We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.

Additionally, Twilio participates in the E-Verify program in certain locations, as required by law.

Required Skill Profession

Other General