Software Engineer L3 - #492

About the role

polygraph within 7 years required

LCAT Description: The Software Engineer designs, develops, tests, deploys, documents, maintains, and enhances complex and diverse software systems based upon documented requirements. These systems might include, but are not limited to, processing­ intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time systems, business management information systems, and systems which incorporate data repositories, data transport services, and application and systems development and monitoring. Works individually or as part of a team. Reviews and tests software components for adherence to the design requirements and documents test results. Resolves software problem reports. Utilizes software development and software design methodologies appropriate to the development environment. Provides specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of Open Source Software (OSS) and/or Commercial Off­The-Shelf (COTS) Government Off-The-Shelf (GOTS) software in place of new development, and requirements analysis and synthesis from system level to individual software components. Experience developing in Unix. Ability to perform shell scripting. Working knowledge of Configuration Management (CM) tools and Web Services implementation. 3 Qualifications: Master’s degree in computer science or related discipline from an accredited college or university, plus five (5) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity. OR Bachelor’s degree in computer science or related discipline from an accredited college or university, plus seven (7) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity OR Nine (9) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.

position description

The Software Engineer shall possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing. In this role, the Software Engineer shall be responsible for designing, implementing, and optimizing data ingress/egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads.

Qualifications

Position Required Skills

• -Experience using the Linux CLI and Linux tools
• -Experience developing Bash scripts to automate manual processes
• -Recent software development experience using Python and Java
• -Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
• -Experience with Distributed Big Data processing engines including Apache Spark
• -Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
• -Experience using Jupyter Notebook
• -Experience with data wrangling and preprocessing using tools such as pandas, NumPy
• -Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
• -Familiarity with data quality concepts, data validation, and anomaly detection
• -Experience with Git Source Control System Position Desired Skills
• -Familiar with HPC Job Scheduling tools including Slurm
• -Experience using the Atlassian Tool Suite (JIRA, Confluence)

Clearance: TS/SCI w/Poly