Bespoke Technologies, Inc.

BT-275 – Data Engineer
Location: Tysons, VA (fully on-site, no remote option)

 

• The Candidate Team shall identify and facilitate the collection and monitoring of system performance, availability metrics, and travel data parsing metrics, as well as other pertinent usage metrics required by the organization, to determine the usage and value of the application.
• The Candidate Team shall ensure that database and software maintenance activities, including those related to travel data parsing, are completed, and that application performance, especially in the context of processing travel data, does not degrade over time.
• The Candidate Team shall monitor storage allocation and usage against planned data growth, including travel data, to ensure current and future storage needs are identified and allocated by appropriate system maintenance personnel in order to prevent any operational impacts related to travel data integration.
• The Candidate Team shall continue parsing data for external partners.
• The Candidate Team shall recommend changes or upgrades, including enhancements for travel data parsing capabilities, that need to be made to handle increased loads of data, growth of the user base, or other changes over the life of the application.
• The Candidate Team shall recommend termination or integration of functionality, including aspects related to travel data processing, with other applications to maximize the use of limited resources effectively.
• The Candidate Team shall coordinate with additional offices (when applicable) to track expirations and support renewals of hardware and software licenses used by organization applications.
• The Candidate Team shall monitor expirations of server and application-level certificates to ensure continuity of operations and take action to ensure they are renewed as necessary.

• The Candidate Team shall conduct thorough and rapid investigation of high priority software trouble tickets and reports to determine the cause and severity of system issues. This effort includes the review of system and application logs and the review of system fault alerts and messages.
• The Candidate Team shall attempt to replicate system issues in development, integration and test environments using operational data where appropriate.
• The Candidate Team shall coordinate high priority software bug fixes and patches with any external application providers, vendors, and other partner organizations as necessary.

• The Candidate Team shall, at direction and approval, be responsible for supporting the transition of operational travel applications. This transition is part of a comprehensive and systematic approach to consolidating travel data capabilities within the existing ecosystem. The transition will adhere to deadlines and timelines at the discretion of the organization.
• The Candidate Team shall develop software transition plans (i.e., deployment procedures) and data validation and migration plan and support the execution of those plans.
• The Candidate Team shall prepare and present briefings to seek approval from partners and Group management.
• The Candidate Team shall set up and conduct project meetings with other divisions as necessary to coordinate work and integrate schedules.
• The Candidate Team shall develop technical approaches, validate design plans, and conduct feasibility studies.
• The Candidate Team shall perform lessons learned sessions for management and project teams
• at appropriate intervals.
• The Candidate Team shall perform assessment and accreditation activities in support of existing systems in accordance with the Assessment and Authorization (A&A) process.

• Demonstrated experience building and managing data pipelines.
• Demonstrated experience with Python.
• Demonstrated experience with cloud computing using AWS services.
• Demonstrated experience processing data using Apache Spark.
• Demonstrated experience with an RDBMS (Relational Database Management System) (Postgres, Oracle, MySQL) and writing SQL queries.
• Demonstrated experience with Linux and shell scripting.
• Demonstrated experience analyzing data in different file formats like csv, xml, json, avro, parquet, etc.
• Demonstrated experience writing and validating unit tests.

• Demonstrated experience in NiFi, Apache AirFlow, or an equivalent solution or tool for orchestrating data pipelines.
• Demonstrated experience with Java or Scala.
• Demonstrated experience administering an EMR/Spark cluster.
• Demonstrated experience conducting performance tuning of a spark job.
• Demonstrated experience supporting Hive, Iceberg, or another technology providing SQL access to data.
• Demonstrated experience developing cloud-based security solutions.
• Demonstrated experience following a configuration management process to review and deploy code as part of releases.