What are the responsibilities and job description for the Apache Nifi Engineer position at United Software Group Inc?
Job Title: Apache NIFI Lead (Engineer/Admin)
Location : Remote work accepted from anywhere in US
Duration : 12 Months Contract
Teams Meeting Interview
Job Description:
The Senior Apache NiFi Engineer is responsible for the design, development, administration, and operational support of Apache NiFi based data integration platforms in enterprise production environments. The role focuses on delivering secure, scalable, and high performance data ingestion and real time processing solutions, including support for industrial and IoT data integration use cases
.
Key Responsibiliti
- esAdminister, operate, and support Apache NiFi clusters in production environmen
- tsDesign, develop, and maintain NiFi data flows, processors, queues, templates, and controller servic
- esPerform NiFi upgrades, patching, and configuration manageme
- ntMonitor system performance including throughput, latency, and failure rat
- esTroubleshoot flow failures, back pressure conditions, and node level issu
- esImplement and manage NiFi security including TLS, user access, policies, and certificat
- esConduct root cause analysis for outages and performance degradati
- onEnsure high availability, node health, fault tolerance, and data integri
- tyCollaborate with architects, data engineers, and stakeholders to deliver reliable data integration solutio
ns
Required Skills & Experie
nce
Apache NiFi & Data Integra
- tion
Strong hands on experience designing, developing, and deploying Apache NiFi data - flowsIn depth knowledge of NiFi processors, controller services, templates, and reporting
- tasksExperience with data ingestion, transformation, routing, and system integr
- ationFamiliarity with data formats such as JSON, XML, CSV, Avro, and Pa
- rquetSolid understanding of batch and real time data processing architec
turesIoT & Industrial Data Proce
- ssing
Experience ingesting and processing data from industrial sensors, PLCs, SCADA systems, and ICS d - evicesFamiliarity with industrial communication protocols such as MQTT, OPC UA, Modbus, DNP3, and Ether
- Net/IPExperience handling high volume, low latency telemetry data s
- treamsUnderstanding of industrial and ICS security requirements, including network segmentation and secure communi
cationProgramming, Platform &
- DevOps
Proficiency in Groovy, Python, or Shell scripting; Java knowledge pr - eferredExperience working in Linux/Unix environments, with knowledge of networking fundamentals and
- SSL/TLSExposure to Kafka, Hadoop, Spark, or similar big data and streaming technologies (pre
- ferred)Experience with NiFi monitoring, logs, provenance data, and
- metricsFamiliarity with Git and CI/CD pipelines for deploying and managing NiF