Join to apply for the Senior Software Engineer, Data Platform role at Jobright.ai
3 days ago Be among the first 25 applicants
Join to apply for the Senior Software Engineer, Data Platform role at Jobright.ai
Parafin is dedicated to supporting small businesses by providing them with essential financial tools through innovative technology. The Senior Software Engineer for the Data Platform will lead the development of a reliable and scalable data infrastructure, collaborating with various teams to enhance data-driven decision-making and product development.
Responsibilities:
• Design and build robust, highly scalable data pipelines and lakehouse infrastructure with PySpark, Databricks, and Airflow on AWS.
• Improve the data platform development experience for Engineering, Data Science, and Product by creating intuitive abstractions, self‑service tooling, and clear documentation.
• Own and maintain core data pipelines and models that power internal dashboards, ML models, and customer-facing products.
• Own the Data & ML platform infrastructure using Terraform, including end‑to‑end administration of Databricks workspaces: manage user access, monitor performance, optimize configurations (e.g., clusters, lakehouse settings), and ensure high availability of data pipelines.
• Lead projects to improve data quality, testing, observability, and cost efficiency across existing pipelines and backend systems (e.g., migrating Databricks SQL pipelines to dbt, scaling data ingestion, improving data-lineage tracking, and enhancing monitoring).
• Work closely with backend engineers and data scientists to design performant data models and support new product development initiatives.
• Share best practices and mentor other engineers working on data-centric systems.
Qualifications:
Required:
• 4+ years of experience in software engineering with a strong background in data infrastructure, pipelines, and distributed systems.
• Advanced proficiency in Python and SQL.
• Expertise with modern cloud data stacks—AWS (S3, RDS), Databricks, and Airflow—and lakehouse architectures.
• Hands-on experience with foundational data-infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms), Delta Lake/Iceberg, and distributed query engines like Trino/Presto.
• Familiarity with ingestion frameworks, developer-experience tooling, and best practices for data versioning, lineage, partitioning, and clustering.
• Strong problem-solving skills and a proactive attitude toward ownership and platform health.
• Excellent communication and collaboration skills, especially in cross-functional settings.
Preferred:
• Experience with AWS infrastructure using Terraform.
• Familiarity with observability tools (e.g., Datadog) and cost tracking in cloud environments.
• Experience with financial systems or building platforms in a fintech setting.
• Prior work on ML infrastructure: Feature stores (e.g., Tecton), ML model lifecycle (training, deployment, monitoring, retraining), real-time inference.
• Contributions to internal tooling or open-source projects in the data ecosystem.
Company:
Parafin is a financial infrastructure company that offers pre-built financial services programs to support small businesses. Founded in 2020, the company is headquartered in San Francisco, California, USA, with a team of 51-200 employees. The company is currently Growth Stage. Parafin has a track record of offering H1B sponsorships.
Referrals increase your chances of interviewing at Jobright.ai by 2x
Medical insurance
Vision insurance
401(k)
Get notified about new Software Engineer jobs in San Francisco, CA .
San Francisco, CA $160,000.00-$180,000.00 2 weeks ago
San Francisco, CA $130,000.00-$238,000.00 2 weeks ago
San Francisco, CA $150,000.00-$250,000.00 2 weeks ago
San Francisco, CA $120,000.00-$180,000.00 1 month ago
San Francisco, CA $150,000.00-$230,000.00 3 months ago
San Francisco, CA $150,000.00-$176,000.00 3 months ago
San Francisco, CA $120,000.00-$190,000.00 9 months ago
San Francisco, CA $57.00-$61.00 2 days ago
San Francisco, CA $57.00-$61.00 2 days ago
San Francisco, CA $125,000.00-$175,000.00 2 months ago
San Francisco, CA $163,200.00-$223,200.00 2 weeks ago
San Francisco, CA $150,000.00-$180,000.00 5 days ago
San Francisco, CA $57.00-$61.00 2 days ago
San Francisco, CA $57.00-$61.00 2 days ago
San Francisco, CA $165,000.00-$165,000.00 2 years ago
San Francisco, CA $120,000.00-$200,000.00 2 years ago
Alameda, CA $130,000.00-$160,000.00 2 months ago
San Francisco, CA $140,000.00-$280,000.00 8 months ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr...Clinical Pharmacist Make an impact in healthcare from the comfort of your home. We're seeking a detail-oriented Clinical Pharmacist who is passionate about improving... ...experience in a related setting Experience working in a remote/work-from-home environment Strong...
...time to join our clinical team! We are currently hiring Full-Time and Part-Time Therapists to join our team! Providers may work a hybrid schedule that includes providing telehealth from a home office. Locations: Arlington, Auburn, Boston, Brookline,...
Kaiser Permanente seeks a Licensed Social Worker to deliver compassionate, patient-centered care within our Healthcare & Medical Services department. In this role, you will conduct psychosocial assessments, develop care and discharge plans, provide counseling and crisis...
...mission. Join our talented Culinary team today as our new Bartender ! A few details about the role: Prepare and serve bar... ...Two to three years of experience as bartender in a hotel or restaurant preferred. Certification as a bartender preferred. Must...
...Job Description Job Description Seeking Experienced plumbers for Service. DFWP, Insurance Benefits We are seeking a highly skilled and motivated Experienced Service Plumber to join our team. In this role, you will be responsible for diagnosing, repairing, and maintaining...