Senior Data Engineer

{
  "content_hash": "ebd8e4fd179e32d108ac230e31f0f510c38aa0cc6d1df8ef883da6a3b1bd8043",
  "source_hash": "63655c33550dc18f394afd3365e2c5b0d36177cd30c67bbf4b26e56f151a9038",
  "last_changed_at": "2026-06-03T12:30:29.573Z",
  "active_status": "deleted"
}

{
  "language": "en",
  "location": {
    "raw": "San Francisco, California",
    "city": "San Francisco",
    "region": "CA",
    "country": "United States",
    "is_remote": false,
    "confidence": 0.85
  },
  "salary_max": 180000,
  "salary_min": 150000,
  "inferred_at": "2026-06-01T11:05:35.268Z",
  "launch_scope": {
    "reason": "english_us_canada",
    "included": true,
    "language": "en",
    "location": {
      "raw": "San Francisco, California",
      "city": "San Francisco",
      "region": "CA",
      "country": "United States",
      "is_remote": false,
      "confidence": 0.85
    },
    "countries": [
      "United States"
    ]
  },
  "remote_policy": "hybrid",
  "salary_period": "year",
  "workplace_type": "hybrid",
  "salary_currency": "USD"
}

{}

{
  "lists": [
    {
      "text": "Role Description",
      "content": "<div>\n<p style=\"margin-top: 12pt; margin-bottom: 12pt;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">We are seeking a highly skilled Senior Data Engineer to join our growing team. In this role, you will design and implement scalable and efficient data architectures to support our business needs. You will collaborate closely with data scientists, analysts, and other cross-functional teams to build and optimize data pipelines, ensuring that data is accessible, secure, and well-structured for analytics and reporting.</span></p>\n<p style=\"margin-top: 12pt; margin-bottom: 12pt;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">A key part of this role involves developing and maintaining data models, databases, and data lakes, while implementing robust data governance and quality assurance practices. You will drive the development of scalable data infrastructure aligned with company architecture standards and best practices.</span></p>\n<p style=\"margin-top: 12pt; margin-bottom: 12pt;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">This role also requires curiosity and a commitment to building and maintaining production data lake pipelines that transform raw time-series data into ML-ready features, training datasets, and batch predictions. This includes ensuring data quality, reproducibility, and reliable retraining so ML outputs—such as forecasts and risk scores—can be trusted by downstream systems.</span></p>\n</div>"
    },
    {
      "text": "Problems You Will Solve",
      "content": "<div>\n\n<li><span style=\"font-size: 11pt;\">Turning messy operational data into reliable signals by building pipelines that transform noisy, incomplete, and high-volume time-series data into trusted datasets for analytics, product features, and ML workflows</span></li>\n<li style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">\n<p style=\"margin-top: 0pt; margin-bottom: 0pt;\"><span style=\"font-size: 11pt;\">Design a resilient lakehouse platform by architecting a scalable Databricks-based platform that support both streaming and batch workloads while ensuring governance, observability, and reliability</span></p>\n</li>\n<li style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">\n<p style=\"margin-top: 0pt; margin-bottom: 0pt;\"><span style=\"font-size: 11pt;\">Enable production-ready ML pipelines by creating reproducible workflows, reliable feature datasets, and batch prediction pipelines that downstream systems can depend on</span></p>\n</li>\n<li style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">\n<p style=\"margin-top: 0pt; margin-bottom: 0pt;\"><span style=\"font-size: 11pt;\">Enable self-service analytics and ML by building infrastructure and abstractions that allow analysts, engineers, and data scientists to independently explore and use data</span></p>\n</li>\n<li style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">\n<p style=\"margin-top: 0pt; margin-bottom: 12pt;\"><span style=\"font-size: 11pt;\">Scale a platform for product and analytics by designing systems that support operational product features, internal reporting, and ML use cases without compromising performance or data quality</span></p>\n</li>\n\n</div>"
    },
    {
      "text": "Core Responsibilities",
      "content": "<div>\n\n<li><span style=\"font-size: 11pt;\">Architect and evolve a Databricks-based data platform that serves as the scalable foundation for product features, internal reporting, and ML workflows.</span></li>\n<li><span style=\"font-size: 11pt;\">Set technical standards for modeling raw data into clean, reliable datasets, ensuring high integrity and point-in-time accuracy for both BI and ML applications.</span></li>\n<li><span style=\"font-size: 11pt;\">Build and maintain self-service tooling and infrastructure abstractions that improve the developer experience for data producers, analysts, and data scientists.</span></li>\n<li><span style=\"font-size: 11pt;\">Design and optimize high-performance ETL/ELT pipelines using Delta Live Tables and Structured Streaming to handle seamless ingestion from diverse data sources.</span></li>\n<li><span style=\"font-size: 11pt;\">Own platform observability, testing, and proactive monitoring to ensure the performance and reliability of critical data delivery and pipeline health.</span></li>\n<li><span style=\"font-size: 11pt;\">Architect and enforce data security, compliance, and access controls by implementing Unity Catalog and IAM (Identity and Access Management) best practices across the enterprise.</span></li>\n<li><span style=\"font-size: 11pt;\">Build and maintain production-grade pipelines that transform raw data into ML-ready features, training datasets, and reliable batch predictions.</span></li>\n<li><span style=\"font-size: 11pt;\">Lead Infrastructure as Code (IaC) initiatives using Terraform and improve team productivity by identifying technical debt and automating complex deployment workflows.</span></li>\n<li><span style=\"font-size: 11pt;\">Partner with Engineering, Product, and Business teams to resolve ambiguities and ensure shipped data features are impactful, reliable, and aligned with business outcomes.</span></li>\n<li><span style=\"font-size: 11pt;\">Build and maintain a self-service data lake environment, empowering non-data engineers and stakeholders to discover, explore, and analyze data independently.</span></li>\n<li><span style=\"font-size: 11pt;\">Promote engineering excellence through code reviews, documentation, and technical standards for orchestration and testing.</span></li>\n\n</div>"
    },
    {
      "text": "Minimum Qualifications",
      "content": "\n<li><span style=\"font-size: 11pt;\">Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.</span></li>\n<li><span style=\"font-size: 11pt;\">6+ years in data engineering, platform development, or large-scale data systems.</span></li>\n<li><span style=\"font-size: 11pt;\">Hands-on experience with Databricks or modern lakehouse platforms and cloud platforms (AWS, GCP, or Azure).</span></li>\n<li><span style=\"font-size: 11pt;\">Experience building scalable ETL/ELT pipelines using Spark and SQL.</span></li>\n<li><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Proficiency in SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB).</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Strong understanding of data modeling, schema design, and performance optimization.</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Experience building reliable, production-grade data pipelines with a focus on data quality and observability.</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Experience supporting analytics and/or ML workflows, including preparing ML-ready datasets.</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Working knowledge of data governance, security, and access control frameworks.</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Familiarity with Infrastructure as Code (IaC) and automated deployment workflows (e.g., Terraform).</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Proven ability to collaborate across teams and contribute to technical direction.</span></li>\n"
    },
    {
      "text": "Preferred Qualifications",
      "content": "<div>\n\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Experience working with time-series, IoT, or high-volume telemetry data systems.</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Familiarity with EV charging ecosystems, including OCPP (Open Charge Point Protocol).</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Domain experience in electric vehicles (EV), energy systems, or distributed energy resources (DERs).</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Experience building ML feature pipelines, training datasets, or batch inference workflows.</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Experience designing self-service data platforms for analysts and data scientists.</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Background in event-driven or real-time data architectures.</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Solid software engineering experience, including writing maintainable production code, testing, and applying engineering best practices to data systems.</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt; font-family: 'Proxima Nova', sans-serif;\">Solid software engineering experience, including writing maintainable production code, testing, and applying engineering best practices to data systems.</span></li>\n<li style=\"line-height: 1.2;\"><span style=\"font-size: 11pt;\">Proven ability to influence technical direction and collaborate across teams.</span></li>\n\n</div>"
    }
  ],
  "country": "US",
  "createdAt": 1774228250136,
  "updatedAt": null,
  "categories": {
    "team": "Software",
    "location": "San Francisco, California",
    "commitment": "Full-time",
    "department": "Technology",
    "allLocations": [
      "San Francisco, California",
      "Remote - Toronto, Ontario, Canada"
    ]
  },
  "salaryRange": {
    "max": 180000,
    "min": 150000,
    "currency": "USD",
    "interval": "per-year-salary"
  },
  "workplaceType": "hybrid"
}