# Data Engineer

**Company:** [Black Canyon Consulting](https://hotfix.jobs/companies/blackcanyonconsulting)
**Location:** Bethesda, MD
**Role:** Data Engineering
**Skills:** Python, Ms Sql Server, Linux, Bash, Xml, JSON, CI/CD, AWS, GCP, Ngs, Bwa, Gatk, Galaxy, REST APIs, GitHub
**Posted:** 2026-02-20

> Develops and maintains software for NCBI's biomedical databases like PubMed and GenBank, implementing bioinformatic algorithms and cloud pipelines for large-scale genetic data. Requires Python proficiency, SQL expertise, Linux scripting, and experience with big data handling.

## Job Description

## Responsibilities
- Design, develop, test, and maintain programs for NCBI's biomedical data resources (PubMed, GenBank, SRA, ClinicalTrials.gov).
- Implement efficient bioinformatic algorithms.
- Develop cloud-ready tools and pipelines to improve performance and scalability for searching and submitting genetic sequence data.

## Required Skills
- Proficiency in **Python**
- Experience with **MS SQL Server** and relational database design/optimization
- Programming in **Linux** environment and **BASH** shell scripts
- Handling large amounts of data
- Working with structured documents (**XML**, **JSON**)
- **CI/CD pipelines**, unit/integration/regression testing

## Desired Skills
- Cloud technologies: **AWS** (EC2, S3, Lambda), **GCP** (GKE, Google Storage, Cloud Functions)
- 5+ years with genetic/biological data
- **NGS** tools/formats (**BWA**, **GATK**, **Galaxy**)
- Open source involvement (**GitHub**)
- Managing production workflows for online public databases
- **RESTful API** design

## Similar roles

- [Data Analytics](https://hotfix.jobs/jobs/b8dd4634-fd75-4c54-8f56-f1c6d2ca6b99) - OnePay - Remote - $130k – $170k/yr
- [Forward Deployed Data Engineer (Integration)](https://hotfix.jobs/jobs/2c2de93d-e128-430e-a6c1-c51b1b338a8a) - Hilbert - San Francisco, CA
- [Software Engineer, Data Infrastructure](https://hotfix.jobs/jobs/a8009f18-5785-47c4-a091-169beaee14fd) - The Voleon Group - Remote - $235k – $300k/yr
- [Client Delivery Specialist](https://hotfix.jobs/jobs/6fa1ca24-291c-4451-862b-4e20168ad45b) - Hinge Health - San Francisco, CA - $80k – $120k/yr
- [Software Engineer](https://hotfix.jobs/jobs/8bf697ae-8d3c-4693-b178-f1f9771d729a) - xAI - Palo Alto, CA - $125k – $400k/yr

**Apply:** https://hotfix.jobs/jobs/59ab9427-080a-4196-a1b5-d288734d0542
**Canonical:** https://hotfix.jobs/jobs/59ab9427-080a-4196-a1b5-d288734d0542