Shield Consulting SolutionsExternal listing

NiFi Platform Engineer

TS/SCI w/ PolyLinthicum, MD· Onsite· full-time· $225k – $235k

Experience required

  • Bachelor's: 8+ years

About the role


Telework: None

  • Bachelor’s degree in a technical field.
  • 8 years of applicable professional experience.

Responsibilities

  • As part of the Secure the Enterprise initiative, develop capabilities to shift from the current manual system security evaluation and authorization process to a new model that emphasizes automation, streamlined processes and approvals, continuous monitoring and assessment, and network data gathering across the entire life cycle of a project.
  • Integrate data with tools such as Amazon S3, MongoDB, Apache Spark, and Elasticsearch, ensuring seamless data movement and processing.
  • Optimize NiFi cluster architecture, performance tuning, and strategize data pipelines.
  • Design, implement, and troubleshoot dataflows using Apache NiFi, including working with processors, connections, and templates.
  • Deploy and managing NiFi in cloud environments (e.g., AWS, Azure, GCP) and using cloud-native tools for data processing.
  • Facilitate infrastructure management, continuous integration, environment configuration and deployment as well as supporting the project’s compliance and security posture.
  • Focus on delivering the automation that enables all the other teams to operate smoothly.
  • Experience tracking work through JIRA workflows.
  • Linux system administration (Centos7, RedHat8)
  • Experience with administering a NiFi cluster
  • Experience with Docker
  • Experience with Terraform code
  • Configuring, deploying and administrating NiFi and associated NiFi flows
  • Proficiency in Apache NiFi: Hands-on experience designing, implementing, and troubleshooting dataflows using Apache NiFi, including working with
  • processors, connections, and templates.
  • Expertise in NiFi Expression Language: Strong understanding of leveraging NiFi Expression Language to create dynamic and efficient dataflows.
  • Data Integration and Big Data Tools: Experience integrating data with tools such as Amazon S3, MongoDB, Apache Spark, and Elasticsearch, ensuring
  • seamless data movement and processing.
  • Performance Optimization: Knowledge of NiFi cluster architecture, performance tuning, and strategies for optimizing high-throughput data pipelines.
  • Cloud Integration: Expertise in deploying and managing NiFi in cloud environments (e.g., AWS, Azure, GCP) and using cloud-native tools for data
  • processing.
  • Scripting and Automation: Proficiency in scripting languages like Python, Groovy, or Bash to extend NiFi capabilities and automate workflows.
  • Cloud hosting and automation
  • Experience working in Agile environment

Compensation

Posted Annualized Salary: $225,000 – $235,000