bluedoor data·Job Postings API·bluedoor.sh ↗

HomeCompaniesBespoketechincData Engineer

Data Engineer

Bespoketechinc · Remote · Active · JazzHR / ApplyToJob

Job facts

FieldValue
CompanyBespoketechinc
TitleData Engineer
Normalized title-
Department / team-
Location-
Work modelRemote / Remote
Employment type-
Salary-
Statusactive
ATS providerJazzHR / ApplyToJob
Posted / first seen / 2026-05-30
Changed / last seen2026-05-30 / 2026-06-06

Related slices

PageWhat it containsOpen
Company jobsActive postings from Bespoketechinc.Open
Company breakdownsRole, location, ATS, and work model facets for this company.Open
ATS provider jobsActive postings observed through JazzHR / ApplyToJob.Open
Provider filtered searchThe same provider as a filtered job collection.Open
Work model jobsActive Remote postings.Open
Lifecycle eventsOpen, update, close, and reopen events for this posting.Open
Original postingCanonical source or apply URL captured from the ATS.Open

Linked records

CompanyBespoketechinc
Source3e77311b-f024-4489-a8ab-e03c3bc92b56
ATS providerJazzHR / ApplyToJob

Description

BT-296 – Data Engineer Location: McLean , VA (fully on-site, no remote option) **Please do NOT apply if you do not have an active Poly clearance. Those without a Poly will not be considered.** Technical Requirements The Candidate team shall: Ensure that all development and modifications to existing Sponsor applications comply with Sponsor’s security and architectural policies and regulations. Work with a variety of individuals, including key stakeholders and other development teams in adjacent organizations. However, the Sponsor Project Manager (PM) will manage priorities. Communicate technical concepts to non-technical audiences. Be responsible for identifying, documenting, and communicating risks and mitigations across the designed system. Review the existing and designed system to identify gaps and minimize overlaps, analyze project needs for alternative solutions, and identify needed layers and modules and how they work together for the system. Review technical implementation strategies and plans, identifies inconsistencies and opportunities for improvement and communicates those results to the Sponsor PM. Document and maintain code and workflows such as version control systems/code repositories, task management tools, and open source-style contribution models and issue tracking. Manage, with Sponsor oversight, the developed systems’ lifecycle (to include operating system upgrades, updates, patches, security scans, and configuration changes) and other duties requiring in-depth knowledge of server hardware and software technologies. Be responsible for setting user permissions (including roles) and troubleshooting permission issues. Provide operations and maintenance of applications in the cloud infrastructure. Support Sponsor’s representatives in cloud environment provisioning, engineering, and architecture related activities as applicable to applications. With Sponsor concurrence, implement changes to current applications and data pipelines based on Sponsor requirements. Provide support to manage the Sponsor Software Development Lifecycle (SDLC) process. Continuously evaluate progress and evaluate incoming information to ensure the schedules are met. Assist the Sponsor’s product owner with the assessment of program requirements. Assist the Sponsor’s product owner with mitigating or avoiding risks. Use a Sponsor-approved tracking system for issues and problems. Assist the Sponsor’s product owner in alleviating program issues. Interface with stakeholders to ensure user stories are recorded. Coordinate stakeholder engagements, such as user requirements sessions and training. Prepare meeting agendas and meeting minutes. Track work requirements and action items to meet program deadlines. Support tasks requiring collecting, compiling, evaluating, and publishing information and statistical data included in documents, records, forms, reports, plans, policies, and regulations. Deliver development requirements as requested by the Sponsor. Provide applications development and programming support to develop software to implement system-level requirements. Maintain and enhance software solutions based on changing partner requirements, legislation, and policy. Stay current with emerging technologies and industry best practices. Conduct functionality testing for existing applications. Create and maintain an automated test environment in the Sponsor’s AWS environment using technologies such as Selenium or comparable testing tools. Assist in the technical documentation of and design for meeting security requirements, ensuring compliance with Sponsor A&A processes. Develop applications and modifications to existing and new Sponsor applications in compliance with the Sponsor’s architectural guidelines and Authorization and Accreditation (A&A) process. Critical Core Competencies The Candidate shall provide the following Critical Core Competencies and ensure they are not single-threaded by an individual contributor for the duration of this contract.  These competencies represent specialized skills, experience and institutional knowledge deemed vital to executing contract requirements.   Cloud Services Deploys, operates and maintains web services within the Sponsor’s AWS cloud environment (and potentially other cloud service providers in the future). Demonstrated experience with infrastructure as code (IaC) technologies including AWS Cloud Formation. Web Application Programming Strong problem-solving skills including debugging, testing, and troubleshooting complex web applications; Develops modern web applications using JavaScript/TypeScript frameworks (Angular, React, or Vue); Strong understanding of web application security best practices and usability principles. Scripting Shell scripting such as Bash. Database Technologies Using SQL and database technologies such as MySQL, DynamoDB, or SQL server. Operating Systems Experienced with Linux operating systems. Required Skills and Demonstrated Experience The Candidate shall ensure, for the duration of the contract, that candidate personnel assigned to work under this contract maintain institutional knowledge and competency level necessary for all required skills, to include demonstrated on-the-job experience. The Candidate team shall possess and provide the following required skills and demonstrated experience: Demonstrated experience with Agile/Scrum development methodologies in a fast-paced, collaborative team environment. Demonstrated experience working effectively in high-performing, cross-functional teams with multiple concurrent projects. Demonstrated experience working directly with stakeholders to gather requirements, understand needs, and translate them into technical solutions with minimal oversight. Demonstrated experience in self-directed work with a strong ownership mentality and commitment to code quality, testing, and documentation. Demonstrated experience context-switching between projects and systems as priorities demand. The Candidate shall possess and provide the following required skills and demonstrated experience: Data Engineering Demonstrated experience building production data pipelines and ETL/ELT workflows at scale. Demonstrated experience with Apache Spark and PySpark for distributed data processing. Demonstrated experience with advanced Python programming skills including data manipulation libraries (Pandas, NumPy) and data engineering best practices. Demonstrated experience understanding data security, privacy, governance, and compliance principles. Demonstrated experience with workflow orchestration tools such as Step Functions and Airflow. Demonstrated experience with containerization such as Docker or Podman, and deploying data applications in cloud environments. Demonstrated experience with AWS services (in particular S3, Lambda, and Step Functions). Demonstrated experience with PostgreSQL and MySQL in production environments, including performance tuning and schema design. Demonstrated experience with SQL and query optimization for complex analytical workloads. Demonstrated experience with version control (Git) and CI/CD practices for data pipelines. Demonstrated experience working with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight. Demonstrated experience with strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks. Desired Skills and Demonstrated Experience Data Engineering Demonstrated experience with data lakehouse architectures using Apache Iceberg. Demonstrated experience configuring, deploying, and integrating data platform components: Apache Ranger (access control and data governance) Trino (distributed SQL query engine) Data catalogs (Unity Catalog OSS, Apache Polaris, etc.) Apache Superset (data visualization and dashboarding) Demonstrated experience with Bash scripting for automation and data processing tasks. Demonstrated experience with Infrastructure as Code (Terraform or CloudFormation) for data infrastructure. Demonstrated experience with tracking data lineage and associated tooling such as OpenLineage. Demonstrated experience with Java. Demonstrated experience with data quality frameworks, testing methodologies, and validation strategies. Demonstrated experience or background with large-scale data migrations or platform modernization efforts. Demonstrated experience integrating AI/ML services and models (translation, OCR, speech-to-text, NLP, language detection, topic modeling), LLMs, and RAG (retrieval-augmented generation) pipelines. Demonstrated experience with geospatial data processing (H3, PostGIS, or similar). Demonstrated experience Contributing to data engineering documentation, best practices, or design patterns. Demonstrated experience with NoSQL databases (DynamoDB, etc.). Demonstrated experience with excellent written and verbal communication skills with both technical and non-technical audiences.

Full job record

Job ID6643ea3f684b888f75943016d0d16c2f47d71ed6
Org ID9aa8d635-3a81-4bf3-a3bd-670c46f510bb
Source ID3e77311b-f024-4489-a8ab-e03c3bc92b56
Board ID3e77311b-f024-4489-a8ab-e03c3bc92b56
Providerjazzhr
Provider Job KeyGMcY138qtK
TitleData Engineer
Normalized Title
Statusactive
Activeyes
Location Text
Department
Team
Employment Type
Workplace Typeremote
Remote Policyremote
Country
Region
City
Salary Raw
Salary Min
Salary Max
Salary Currency
Salary Period
Source URLhttps://bespoketechinc.applytojob.com/apply/GMcY138qtK/Data-Engineer
Apply URLhttps://bespoketechinc.applytojob.com/apply/GMcY138qtK/Data-Engineer
First Seen At2026-05-30 05:46:48Z
Last Seen At2026-06-06 20:01:17Z
Last Checked At2026-06-06 20:01:17Z
Last Changed At2026-05-30 05:46:48Z
Inactive At
Source Posted At
Source Updated At
Raw Payload Uris3://job-postings-prod-raw-590183727216/raw/provider=jazzhr/board=bespoketechinc/date=2026-06-06/2026-06-06T20-01-15-528Z-3d84047eaa6395f1468b8ea728e534262187aadbb0945ddbdcc0f2da5d3f6dd0.json
Event Fields
{
  "content_hash": "cf429118c45d085caa0390a76d4bc06f4678e77f767785d6cf8f6b9630dc1ad2",
  "source_hash": "318a51b25e5b79bd272aa669f3b904587585d74acddaa1f5476ae7a4c879c4b2",
  "last_changed_at": "2026-05-30T05:46:48.549Z",
  "active_status": "active"
}
Parsed Structured
{
  "language": "en",
  "location": {
    "raw": null,
    "city": null,
    "region": null,
    "country": null,
    "is_remote": true,
    "confidence": null
  },
  "salary_max": null,
  "salary_min": null,
  "inferred_at": "2026-06-06T20:01:17.958Z",
  "launch_scope": {
    "reason": "jazzhr_production_catalog",
    "included": true,
    "location": {
      "raw": null,
      "city": null,
      "region": null,
      "country": null,
      "is_remote": true,
      "confidence": null
    },
    "countries": []
  },
  "remote_policy": "remote",
  "salary_period": null,
  "workplace_type": "remote",
  "salary_currency": null
}
Extensions
{}
Native Structured
{
  "detail": {
    "url": "https://bespoketechinc.applytojob.com/apply/jobs/details/GMcY138qtK?&",
    "heading": "Data Engineer",
    "html_title": "JazzHR » Job Listings",
    "canonical_url": "https://bespoketechinc.applytojob.com/apply/GMcY138qtK/Data-Engineer",
    "description_html": "<div class=\"job_description\">\n\t\t\t\t\t<p><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><b>BT-296 &#8211; Data Engineer</b></span></span><br><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Location: McLean</span></span><span style=\"font-size:12pt;\"><span style=\"line-height:normal;\"><span style=\"font-family:Aptos, sans-serif;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">, VA</span></span></span></span></span><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"> (fully on-site, no remote option)</span></span><br><br>&#160;</p><strong><u>**Please do NOT apply if you do not have an active Poly clearance. Those without a Poly will not be considered.**</u></strong><br><br><br><br><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><b><u>Technical Requirements</u></b></span></span><br><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">The Candidate team shall:</span></span><ol><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Ensure that all development and modifications to existing Sponsor applications comply with Sponsor&#8217;s security and architectural policies and regulations.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Work with a variety of individuals, including key stakeholders and other development teams in adjacent organizations. However, the Sponsor Project Manager (PM) will manage priorities.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Communicate technical concepts to non-technical audiences.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Be responsible for identifying, documenting, and communicating risks and mitigations across the designed system.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Review the existing and designed system to identify gaps and minimize overlaps, analyze project needs for alternative solutions, and identify needed layers and modules and how they work together for the system.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Review technical implementation strategies and plans, identifies inconsistencies and opportunities for improvement and communicates those results to the Sponsor PM.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Document and maintain code and workflows such as version control systems/code repositories, task management tools, and open source-style contribution models and issue tracking.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Manage, with Sponsor oversight, the developed systems&#8217; lifecycle (to include operating system upgrades, updates, patches, security scans, and configuration changes) and other duties requiring in-depth knowledge of server hardware and software technologies.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Be responsible for setting user permissions (including roles) and troubleshooting permission issues.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Provide operations and maintenance of applications in the cloud infrastructure.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Support Sponsor&#8217;s representatives in cloud environment provisioning, engineering, and architecture related activities as applicable to applications.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">With Sponsor concurrence, implement changes to current applications and data pipelines based on Sponsor requirements.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Provide support to manage the Sponsor Software Development Lifecycle (SDLC) process.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Continuously evaluate progress and evaluate incoming information to ensure the schedules are met.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Assist the Sponsor&#8217;s product owner with the assessment of program requirements.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Assist the Sponsor&#8217;s product owner with mitigating or avoiding risks.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Use a Sponsor-approved tracking system for issues and problems.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Assist the Sponsor&#8217;s product owner in alleviating program issues.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Interface with stakeholders to ensure user stories are recorded. </span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Coordinate stakeholder engagements, such as user requirements sessions and training.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Prepare meeting agendas and meeting minutes.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Track work requirements and action items to meet program deadlines.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Support tasks requiring collecting, compiling, evaluating, and publishing information and statistical data included in documents, records, forms, reports, plans, policies, and regulations.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Deliver development requirements as requested by the Sponsor.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Provide applications development and programming support to develop software to implement system-level requirements.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Maintain and enhance software solutions based on changing partner requirements, legislation, and policy.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Stay current with emerging technologies and industry best practices.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Conduct functionality testing for existing applications.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Create and maintain an automated test environment in the Sponsor&#8217;s AWS environment using technologies such as Selenium or comparable testing tools.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Assist in the technical documentation of and design for meeting security requirements, ensuring compliance with Sponsor A&amp;A processes.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Develop applications and modifications to existing and new Sponsor applications in compliance with the Sponsor&#8217;s architectural guidelines and Authorization and Accreditation (A&amp;A) process.</span></span></li></ol><br><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><b><u>Critical Core Competencies</u></b></span></span><br><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">The Candidate shall provide the following Critical Core Competencies and ensure they are not single-threaded by an individual contributor for the duration of this contract.&#160; These competencies represent specialized skills, experience and institutional knowledge deemed vital to executing contract requirements.</span></span><br>&#160;<ul><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><i>Cloud Services</i></span></span><ul style=\"list-style-type:circle;\"><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Deploys, operates and maintains web services within the Sponsor&#8217;s AWS cloud environment (and potentially other cloud service providers in the future).</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with infrastructure as code (IaC) technologies including AWS Cloud Formation.</span></span></li></ul></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><i>Web Application Programming</i></span></span><ul style=\"list-style-type:circle;\"><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Strong problem-solving skills including debugging, testing, and troubleshooting complex web applications; Develops modern web applications using JavaScript/TypeScript frameworks (Angular, React, or Vue); Strong understanding of web application security best practices and usability principles.</span></span></li></ul></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><i>Scripting </i></span></span><ul style=\"list-style-type:circle;\"><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Shell scripting such as Bash.</span></span></li></ul></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><i>Database Technologies</i></span></span><ul style=\"list-style-type:circle;\"><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Using SQL and database technologies such as MySQL, DynamoDB, or SQL server.</span></span></li></ul></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><i>Operating Systems</i></span></span><ul style=\"list-style-type:circle;\"><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Experienced with Linux operating systems.</span></span></li></ul></li></ul><br><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><b><u>Required Skills and Demonstrated Experience</u></b></span></span><ul><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">The Candidate shall ensure, for the duration of the contract, that candidate personnel assigned to work under this contract maintain institutional knowledge and competency level necessary for all required skills, to include demonstrated on-the-job experience.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">The Candidate team shall possess and provide the following required skills and demonstrated experience:</span></span><ul style=\"list-style-type:circle;\"><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with Agile/Scrum development methodologies in a fast-paced, collaborative team environment.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience working effectively in high-performing, cross-functional teams with multiple concurrent projects.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience working directly with stakeholders to gather requirements, understand needs, and translate them into technical solutions with minimal oversight.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience in self-directed work with a strong ownership mentality and commitment to code quality, testing, and documentation.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience context-switching between projects and systems as priorities demand.</span></span></li></ul></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">The Candidate shall possess and provide the following required skills and demonstrated experience: </span></span></li></ul><br><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><b>Data Engineering</b></span></span><ul><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience building production data pipelines and ETL/ELT workflows at scale.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with Apache Spark and PySpark for distributed data processing.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with advanced Python programming skills including data manipulation libraries (Pandas, NumPy) and data engineering best practices.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience understanding data security, privacy, governance, and compliance principles.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with workflow orchestration tools such as Step Functions and Airflow.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with containerization such as Docker or Podman, and deploying data applications in cloud environments.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with AWS services (in particular S3, Lambda, and Step Functions).</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with PostgreSQL and MySQL in production environments, including performance tuning and schema design.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with SQL and query optimization for complex analytical workloads.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with version control (Git) and CI/CD practices for data pipelines.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience working with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks.</span></span></li></ul><br><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><b><u>Desired Skills and Demonstrated Experience</u></b></span></span><br><br><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\"><b>Data Engineering</b></span></span><ul><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with data lakehouse architectures using Apache Iceberg.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience configuring, deploying, and integrating data platform components:</span></span><ul style=\"list-style-type:circle;\"><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Apache Ranger (access control and data governance)</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Trino (distributed SQL query engine)</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Data catalogs (Unity Catalog OSS, Apache Polaris, etc.)</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Apache Superset (data visualization and dashboarding)</span></span></li></ul></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with Bash scripting for automation and data processing tasks.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with Infrastructure as Code (Terraform or CloudFormation) for data infrastructure.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with tracking data lineage and associated tooling such as OpenLineage.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with Java.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with data quality frameworks, testing methodologies, and validation strategies.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience or background with large-scale data migrations or platform modernization efforts.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience integrating AI/ML services and models (translation, OCR, speech-to-text, NLP, language detection, topic modeling), LLMs, and RAG (retrieval-augmented generation) pipelines.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with geospatial data processing (H3, PostGIS, or similar).</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience Contributing to data engineering documentation, best practices, or design patterns.</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with NoSQL databases (DynamoDB, etc.).</span></span></li><li style=\"margin-left:8px;\"><span style=\"font-size:11pt;\"><span style=\"font-family:Calibri, sans-serif;\">Demonstrated experience with excellent written and verbal communication skills with both technical and non-technical audiences.</span></span></li></ul>",
    "description_text": "BT-296 – Data Engineer\n Location: McLean , VA (fully on-site, no remote option)\n **Please do NOT apply if you do not have an active Poly clearance. Those without a Poly will not be considered.**\n Technical Requirements\n The Candidate team shall: Ensure that all development and modifications to existing Sponsor applications comply with Sponsor’s security and architectural policies and regulations.\n Work with a variety of individuals, including key stakeholders and other development teams in adjacent organizations. However, the Sponsor Project Manager (PM) will manage priorities.\n Communicate technical concepts to non-technical audiences.\n Be responsible for identifying, documenting, and communicating risks and mitigations across the designed system.\n Review the existing and designed system to identify gaps and minimize overlaps, analyze project needs for alternative solutions, and identify needed layers and modules and how they work together for the system.\n Review technical implementation strategies and plans, identifies inconsistencies and opportunities for improvement and communicates those results to the Sponsor PM.\n Document and maintain code and workflows such as version control systems/code repositories, task management tools, and open source-style contribution models and issue tracking.\n Manage, with Sponsor oversight, the developed systems’ lifecycle (to include operating system upgrades, updates, patches, security scans, and configuration changes) and other duties requiring in-depth knowledge of server hardware and software technologies.\n Be responsible for setting user permissions (including roles) and troubleshooting permission issues.\n Provide operations and maintenance of applications in the cloud infrastructure.\n Support Sponsor’s representatives in cloud environment provisioning, engineering, and architecture related activities as applicable to applications.\n With Sponsor concurrence, implement changes to current applications and data pipelines based on Sponsor requirements.\n Provide support to manage the Sponsor Software Development Lifecycle (SDLC) process.\n Continuously evaluate progress and evaluate incoming information to ensure the schedules are met.\n Assist the Sponsor’s product owner with the assessment of program requirements.\n Assist the Sponsor’s product owner with mitigating or avoiding risks.\n Use a Sponsor-approved tracking system for issues and problems.\n Assist the Sponsor’s product owner in alleviating program issues.\n Interface with stakeholders to ensure user stories are recorded.\n Coordinate stakeholder engagements, such as user requirements sessions and training.\n Prepare meeting agendas and meeting minutes.\n Track work requirements and action items to meet program deadlines.\n Support tasks requiring collecting, compiling, evaluating, and publishing information and statistical data included in documents, records, forms, reports, plans, policies, and regulations.\n Deliver development requirements as requested by the Sponsor.\n Provide applications development and programming support to develop software to implement system-level requirements.\n Maintain and enhance software solutions based on changing partner requirements, legislation, and policy.\n Stay current with emerging technologies and industry best practices.\n Conduct functionality testing for existing applications.\n Create and maintain an automated test environment in the Sponsor’s AWS environment using technologies such as Selenium or comparable testing tools.\n Assist in the technical documentation of and design for meeting security requirements, ensuring compliance with Sponsor A&A processes.\n Develop applications and modifications to existing and new Sponsor applications in compliance with the Sponsor’s architectural guidelines and Authorization and Accreditation (A&A) process.\n Critical Core Competencies\n The Candidate shall provide the following Critical Core Competencies and ensure they are not single-threaded by an individual contributor for the duration of this contract.  These competencies represent specialized skills, experience and institutional knowledge deemed vital to executing contract requirements.\n  Cloud Services Deploys, operates and maintains web services within the Sponsor’s AWS cloud environment (and potentially other cloud service providers in the future).\n Demonstrated experience with infrastructure as code (IaC) technologies including AWS Cloud Formation.\n Web Application Programming Strong problem-solving skills including debugging, testing, and troubleshooting complex web applications; Develops modern web applications using JavaScript/TypeScript frameworks (Angular, React, or Vue); Strong understanding of web application security best practices and usability principles.\n Scripting Shell scripting such as Bash.\n Database Technologies Using SQL and database technologies such as MySQL, DynamoDB, or SQL server.\n Operating Systems Experienced with Linux operating systems.\n Required Skills and Demonstrated Experience The Candidate shall ensure, for the duration of the contract, that candidate personnel assigned to work under this contract maintain institutional knowledge and competency level necessary for all required skills, to include demonstrated on-the-job experience.\n The Candidate team shall possess and provide the following required skills and demonstrated experience: Demonstrated experience with Agile/Scrum development methodologies in a fast-paced, collaborative team environment.\n Demonstrated experience working effectively in high-performing, cross-functional teams with multiple concurrent projects.\n Demonstrated experience working directly with stakeholders to gather requirements, understand needs, and translate them into technical solutions with minimal oversight.\n Demonstrated experience in self-directed work with a strong ownership mentality and commitment to code quality, testing, and documentation.\n Demonstrated experience context-switching between projects and systems as priorities demand.\n The Candidate shall possess and provide the following required skills and demonstrated experience:\n Data Engineering Demonstrated experience building production data pipelines and ETL/ELT workflows at scale.\n Demonstrated experience with Apache Spark and PySpark for distributed data processing.\n Demonstrated experience with advanced Python programming skills including data manipulation libraries (Pandas, NumPy) and data engineering best practices.\n Demonstrated experience understanding data security, privacy, governance, and compliance principles.\n Demonstrated experience with workflow orchestration tools such as Step Functions and Airflow.\n Demonstrated experience with containerization such as Docker or Podman, and deploying data applications in cloud environments.\n Demonstrated experience with AWS services (in particular S3, Lambda, and Step Functions).\n Demonstrated experience with PostgreSQL and MySQL in production environments, including performance tuning and schema design.\n Demonstrated experience with SQL and query optimization for complex analytical workloads.\n Demonstrated experience with version control (Git) and CI/CD practices for data pipelines.\n Demonstrated experience working with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight.\n Demonstrated experience with strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks.\n Desired Skills and Demonstrated Experience\n Data Engineering Demonstrated experience with data lakehouse architectures using Apache Iceberg.\n Demonstrated experience configuring, deploying, and integrating data platform components: Apache Ranger (access control and data governance)\n Trino (distributed SQL query engine)\n Data catalogs (Unity Catalog OSS, Apache Polaris, etc.)\n Apache Superset (data visualization and dashboarding)\n Demonstrated experience with Bash scripting for automation and data processing tasks.\n Demonstrated experience with Infrastructure as Code (Terraform or CloudFormation) for data infrastructure.\n Demonstrated experience with tracking data lineage and associated tooling such as OpenLineage.\n Demonstrated experience with Java.\n Demonstrated experience with data quality frameworks, testing methodologies, and validation strategies.\n Demonstrated experience or background with large-scale data migrations or platform modernization efforts.\n Demonstrated experience integrating AI/ML services and models (translation, OCR, speech-to-text, NLP, language detection, topic modeling), LLMs, and RAG (retrieval-augmented generation) pipelines.\n Demonstrated experience with geospatial data processing (H3, PostGIS, or similar).\n Demonstrated experience Contributing to data engineering documentation, best practices, or design patterns.\n Demonstrated experience with NoSQL databases (DynamoDB, etc.).\n Demonstrated experience with excellent written and verbal communication skills with both technical and non-technical audiences.",
    "jsonld_jobposting": null
  },
  "list_job": {
    "id": "GMcY138qtK",
    "title": "Data Engineer",
    "detailUrl": "https://bespoketechinc.applytojob.com/apply/jobs/details/GMcY138qtK?&"
  },
  "detail_errors": []
}
Get this page with API

Rendered from the bluedoor Job Postings API. Reproduce it:

GET https://api.bluedoor.sh/job-postings/v1/jobs/6643ea3f684b888f75943016d0d16c2f47d71ed6?include=descriptionJSON
GET https://api.bluedoor.sh/job-postings/v1/orgs/9aa8d635-3a81-4bf3-a3bd-670c46f510bbJSON
GET https://api.bluedoor.sh/job-postings/v1/sources/3e77311b-f024-4489-a8ab-e03c3bc92b56JSON
GET https://api.bluedoor.sh/job-postings/v1/jobs/6643ea3f684b888f75943016d0d16c2f47d71ed6/eventsJSON