Data Engineer

Company Overview:

Promise helps utilities and government agencies create flexible and affordable solutions for customers struggling to pay off their debt. Our intuitive approach to payment plans and relief distribution leads to increased customer enrollment and a 95%+ recovery rate on scheduled payments. As a result, customers pay off debt sooner and with fewer penalties, and our partners reduce delinquencies and increase revenue.

The Promise team strives to treat people who are struggling with dignity and provide them with the tools and resources they need to succeed. Our expertise spans sectors: we are technology experts from companies like Google, Stripe, and Palantir, as well as accomplished government leaders. We have raised over $50 million and we’re backed by leading investors such as Kapor Capital, XYZ Ventures, Bronze Investments, First Round Capital, Y Combinator, The General Partnership (formerly Sweat Equity Ventures), Howard Schultz, and others. We're proud to have recently been chosen as one of Fast Company's "World's Most Innovative Companies of 2022" (#39).

Role Overview:

This role will work as part of our Analytics and Engineering teams to build scalable, reliable, resilient data pipelines to move data throughout our systems. The ingestion and delivery of data is critical to ensuring a top-notch experience for our customers and the overall success of our business. You’ll be the primary architect and builder of pipelines for both batch and streaming data, making sure the data is where it needs to be for analysts, engineers, and everyone they serve.

What You'll Do:

• Design and build data pipelines that are scalable, fault-tolerant, resilient, self-healing, and highly observable - covering both data ingestion (batch, streaming, and logging) and transformation
• Automate checks of our data throughout its lifecycle to add metadata, quality checks, and auditability
• Make sure that PII and other sensitive data is secure and only available in contexts where it’s needed
• Partner with Engineering, Product, and Ops to understand their data needs and identify places where the data pipeline can be improved
• Select best-of-breed tools to meet our data processing needs today and into the future

You’re a Great Fit for the Role if You Are:

• Experienced (3+ years) with using scripting and programming languages (Python / Scala / Java) to build production data pipelines
• Deeply familiar with batch processing and orchestration tools like AirFlow, Luigi, NiFi, and dbt
• An expert in building out data pipelines, designing ELT/ETL processes, and maintaining these systems
• Capable of writing efficient transformation code in SQL, Spark and/or Python
• Comfortable in ambiguity: you’ve worked in a startup environment or something similar where there often wasn’t perfect clarity about what you should do next.
• An excellent communicator, in both written and verbal contexts. You’re articulate and can get to the point quickly but kindly.
• An expert multitasker: you can triage in the moment, juggling a wide variety of things that need to be fixed. You can quickly sort out priorities from noise.
• Self-motivated and resourceful: you’ll jump in to do whatever needs doing to get the job done. You love collaborating, but are also happy to jump right in and do things yourself.
• Excited about our mission: You think that improving the way governments interact with their constituents is critical. You want to prove that moving away from punitive approaches to non-payment and treating people with dignity can be a win for everyone.

Additional Skills/Experiences That Are Great:

• Experience building streaming pipelines using open-source tools like Kafka/Flink or PaaS tools like AWS Kinesis and GCP Pub/Sub
• Familiarity with Typescript and/or Java (or willingness to learn them) so that you can write the code in our apps that receives data from our pipelines
• Experience with legacy systems and/or civic technologies

Promise is an equal opportunity employer and does not discriminate against any applicant or employee because of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, genetic information, age, or military or veteran status. In addition, the Company complies with applicable state and local laws governing non‐discrimination in employment in every jurisdiction in which it maintains facilities and is committed to diversity and inclusion in the workplace. Promise also provides reasonable accommodations to qualified individuals with disabilities, pregnant individuals, and individuals with sincerely held religious beliefs, in accordance with applicable laws.
Due to our work with the US government, we can only hire US citizens. Candidates living in other countries need not apply.