Bespoke Technologies, Inc.

Data & Software Engineer

McLean, VA - Full Time

BT-338 – Data & Software Engineer
Skill Level: Mid-SME
Location: McLean, VA (fully on-site, no remote option)



**Please do NOT apply if you do not have an active Poly clearance. Those without a Poly will not be considered.**



The Data & Software Engineer works with a small team to build complex data flows for a custom application. Successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale.

Candidate must have experience:
  • Building end-to-end data pipelines leveraging Python
  • Using orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
  • Containerizing and deploying applications in cloud environments like AWS.
  • Working with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads.
  • Leveraging industry standard tools for code control (Git, IaaC control, etc.)
  • Working with data catalogs, tracking data lineage  and handling a variety of data formats, including Geospatial.
  • Using Bash scripting for automation and data processing tasks
  • Integrating Al/ML services and models
 
Responsibilities:
  • Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight
  • Leverage strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks
  • Leverage a background in large-scale data migration or platform modernization efforts
  • Contribute to data engineering documentation, best practices, and design patterns.

Required Skills:
Minimum of 5 years' experience with:
  • Apache Spark & PySpark
  • Advanced Python skills (including Pandas & NumPy)
  • Docker, Podman
  • AWS S3, Lambda & Step functions
  • Apache Iceberg, Airflow, etc.
  • SQL (with Trino)
  • NoSQL, DynamoDB
  • Unity Catalog OSS, Apache Polaris
  • Apache Superset
  • Terraform or CloudFormation
  • OpenLineage
  • H3, PostGIS
Apply: Data & Software Engineer
* Required fields
First name*
Last name*
Email address*
Phone number*
Resume*

Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or paste resume

Paste your resume here or attach resume file

Are you a US citizen?*
Will you now or in the future require employment visa sponsorship?*
Do you live within Virginia, Maryland, or DC area?*
Do you have an active Poly security clearance?*
What is your Poly Type?*
When was your Poly security clearance granted?*
There is no option for remote work and all support is fully on-site. Which location do you prefer?*
When was your last BI?*
Human Check*