What are the responsibilities and job description for the Elasticsearch Engineer position at Nam Info Inc?
Job Role : Elasticsearch Engineer
Location: Miami FL
Core Responsibilities
Pipeline Engineering: Design and maintain scalable log ingestion pipelines using OpenTelemetry (OTel), Fluent Bit, or Logstash to process high-velocity telecom data.
Telecom-Specific Analytics: Implement Piped Processing Language (PPL) to query complex datasets and identify network issues like jitter, packet loss, or dropped calls.
Compliance & Security: Manage automated reporting for industry regulations (e.g., GDPR, SOX, PCI) and ensure long-term log retention strategies for audit trails.
Advanced Monitoring: Build OpenSearch Dashboards to visualize Key Performance Indicators (KPIs) and configure Anomaly Detection to proactively catch service outages.
Cluster Management: Optimize OpenSearch cluster performance, including shard management and storage tiering (e.g., integrating with Amazon S3) to handle "massive amounts" of data cost-effectively.
Technical Skills
Search Technologies: Deep expertise in OpenSearch or Elasticsearch (ELK Stack).
Domain Tools: Experience with telecom-specific protocols like SNMP or SSH for network monitoring.
Infrastructure: Proficiency in AWS OpenSearch Service and container orchestration with Kubernetes.
Automation: Strong scripting skills in Python or Bash and Infrastructure as Code (IaC) using Terraform.