Senior Databricks Engineer

{
  "content_hash": "009f84ed69c63b8402306e3910a9134a62d23f150b4302757a4d3fe2295559b1",
  "source_hash": "7e756ca1a9556ec5a2c7dfaeaf057ecfb8af354fcf1258ed9717d807ba2bced1",
  "last_changed_at": "2026-06-20T07:57:31.719Z",
  "active_status": "active"
}

{
  "dedupe": null,
  "language": "en",
  "location": {
    "raw": "United States",
    "city": null,
    "region": null,
    "country": "United States",
    "is_remote": true,
    "confidence": 0.95
  },
  "salary_max": 119000,
  "salary_min": 91000,
  "inferred_at": "2026-06-21T07:57:19.244Z",
  "launch_scope": {
    "reason": "english_us_canada",
    "included": true,
    "language": "en",
    "location": {
      "raw": "United States",
      "city": null,
      "region": null,
      "country": "United States",
      "is_remote": true,
      "confidence": 0.95
    },
    "countries": [
      "United States"
    ]
  },
  "remote_policy": "remote",
  "salary_period": "year",
  "workplace_type": "remote",
  "salary_currency": "USD"
}

{}

{
  "lists": [
    {
      "text": "Information Security Responsibilities",
      "content": "<li>Promote and enforce awareness of key information security practices, including acceptable use of information assets, malware protection, and password security protocols</li><li>Identify, assess, and report security risks, focusing on how these risks impact the confidentiality, integrity, and availability of information assets</li><li>Understand and evaluate how data is stored, processed, or transmitted, ensuring compliance with data privacy and protection standards (GDPR, CCPA, etc.)</li><li>Ensure data protection measures are integrated throughout the information lifecycle to safeguard sensitive information</li>"
    },
    {
      "text": "Role and Responsibilities:",
      "content": "<div>\n\n<li><span data-contrast=\"auto\"><span data-ccp-parastyle=\"List Bullet\">Architect, build, and&nbsp;</span><span data-ccp-parastyle=\"List Bullet\">maintain</span><span data-ccp-parastyle=\"List Bullet\">&nbsp;scalable ETL/ELT pipelines on the Databricks Lakehouse Platform using&nbsp;</span><span data-ccp-parastyle=\"List Bullet\">PySpark</span><span data-ccp-parastyle=\"List Bullet\">, Spark SQL, and Delta Lake.</span></span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Design and implement medallion (bronze/silver/gold) data architectures and enforce data quality, governance, and lineage standards.</span> </li>\n<li><span data-contrast=\"auto\"><span data-ccp-parastyle=\"List Bullet\">Optimize</span><span data-ccp-parastyle=\"List Bullet\">&nbsp;Spark jobs and cluster configurations for performance and cost, including partitioning, caching, and autoscaling strategies.</span></span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Implement and manage Unity Catalog for access control, data governance, and cross-workspace asset sharing.</span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Build and orchestrate workflows using Databricks Workflows, Delta Live Tables, and CI/CD pipelines.</span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Collaborate with data scientists, analysts, and business stakeholders to translate requirements into reliable data products.</span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Establish engineering best practices, conduct code reviews, and mentor junior data engineers.</span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Monitor production pipelines, troubleshoot failures, and drive root-cause analysis and continuous improvement.</span><span data-ccp-props=\"{&quot;335559685&quot;:360,&quot;335559991&quot;:360}\">&nbsp;</span></li>\n\n</div>"
    },
    {
      "text": "Required Qualifications:",
      "content": "<div>\n\n<li><span data-contrast=\"auto\"><span data-ccp-parastyle=\"List Bullet\">5+ years of data engineering experience, with 3+&nbsp;</span><span data-ccp-parastyle=\"List Bullet\">years</span><span data-ccp-parastyle=\"List Bullet\"> building production solutions on Databricks and Apache Spark.</span></span></li>\n<li><span data-contrast=\"auto\"><span data-ccp-parastyle=\"List Bullet\">Expert </span><span data-ccp-parastyle=\"List Bullet\">proficiency</span><span data-ccp-parastyle=\"List Bullet\">&nbsp;in Python (</span><span data-ccp-parastyle=\"List Bullet\">PySpark</span><span data-ccp-parastyle=\"List Bullet\">) and advanced SQL.</span></span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Deep hands-on experience with Delta Lake, Unity Catalog, and the medallion architecture pattern.</span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Strong experience with at least one major cloud platform (AWS, Azure, or GCP) and its core data services.</span> </li>\n<li><span data-contrast=\"auto\"><span data-ccp-parastyle=\"List Bullet\">Proven </span><span data-ccp-parastyle=\"List Bullet\">track record</span><span data-ccp-parastyle=\"List Bullet\">&nbsp;</span><span data-ccp-parastyle=\"List Bullet\">optimizing</span><span data-ccp-parastyle=\"List Bullet\">&nbsp;Spark performance and managing cluster cost.</span></span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Experience with data modeling, warehousing concepts, and building dimensional/analytics-ready datasets.</span> </li>\n<li><span data-contrast=\"auto\"><span data-ccp-parastyle=\"List Bullet\">Proficiency</span><span data-ccp-parastyle=\"List Bullet\">&nbsp;with Git-based version control, CI/CD, and infrastructure-as-code.</span></span> </li>\n<li><span data-contrast=\"auto\"><span data-ccp-parastyle=\"List Bullet\">Bachelor's degree in Computer Science</span><span data-ccp-parastyle=\"List Bullet\">, Engineering, or equivalent practical experience.</span></span><span data-ccp-props=\"{&quot;335559685&quot;:360,&quot;335559991&quot;:360}\">&nbsp;</span></li>\n\n</div>"
    },
    {
      "text": "Preferred Qualifications ",
      "content": "<div>\n<div>\n\n<li><span data-ccp-parastyle=\"List Bullet\">Databricks certification (Data Engineer Associate/Professional).</span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Experience with Delta Live Tables, structured streaming, and real-time data processing.</span> </li>\n<li><span data-contrast=\"auto\"><span data-ccp-parastyle=\"List Bullet\">Familiarity with </span><span data-ccp-parastyle=\"List Bullet\">MLflow</span><span data-ccp-parastyle=\"List Bullet\">&nbsp;and supporting machine learning workflows in production.</span></span> </li>\n<li><span data-contrast=\"auto\"><span data-ccp-parastyle=\"List Bullet\">Experience with orchestration tools (Airflow, </span><span data-ccp-parastyle=\"List Bullet\">dbt</span><span data-ccp-parastyle=\"List Bullet\">) and data observability platforms.</span></span> </li>\n<li><span data-contrast=\"auto\"><span data-ccp-parastyle=\"List Bullet\">Exposure to</span><span data-ccp-parastyle=\"List Bullet\">&nbsp;data governance, security, and compliance frameworks (e.g., GDPR, HIPAA, SOC 2).</span></span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Hands-on experience using AI coding assistants (e.g., Claude Code, GitHub Copilot, Cursor) to accelerate development, refactoring, and code review.</span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Familiarity with large language model APIs and SDKs (e.g., Anthropic Claude, OpenAI) and prompt engineering for data and analytics use cases.</span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Experience integrating GenAI capabilities into data pipelines or applications, including retrieval-augmented generation (RAG) and vector search.</span> </li>\n<li><span data-ccp-parastyle=\"List Bullet\">Awareness of responsible AI practices, including evaluation, guardrails, and cost/latency trade-offs when deploying LLM-based solutions.</span><span data-ccp-props=\"{&quot;335559685&quot;:360,&quot;335559991&quot;:360}\">&nbsp;</span></li>\n\n</div>\n<div>\n<p><span data-ccp-props=\"{}\">&nbsp;</span></p>\n</div>\n</div>"
    }
  ],
  "country": "US",
  "createdAt": 1781927925574,
  "updatedAt": null,
  "categories": {
    "team": "Data & Analytics: Data Engineering",
    "location": "United States",
    "commitment": "Full Time",
    "department": "Data & AI & Cloud",
    "allLocations": [
      "United States"
    ]
  },
  "salaryRange": {
    "max": 119000,
    "min": 91000,
    "currency": "USD",
    "interval": "per-year-salary"
  },
  "workplaceType": "remote"
}