What are the responsibilities and job description for the Elasticsearch, ELK Stack Engineer position at Siri InfoSolutions, Inc.?
Job Description
Job Role: Elasticsearch (ELK Stack) Engineer
Location: Miami, FL
Core Responsibilities:
Pipeline Engineering: Design and maintain scalable log ingestion pipelines using OpenTelemetry (OTel), Fluent Bit, or Logstash to process high-velocity telecom data.
Telecom-Specific Analytics: Implement Piped Processing Language (PPL) to query complex datasets and identify network issues like jitter, packet loss, or dropped calls.
Compliance & Security: Manage automated reporting for industry regulations (e.g., GDPR, SOX, PCI) and ensure long-term log retention strategies for audit trails.
Advanced Monitoring: Build OpenSearch Dashboards to visualize Key Performance Indicators (KPIs) and configure Anomaly Detection to proactively catch service outages.
Cluster Management: Optimize OpenSearch cluster performance, including shard management and storage tiering (e.g., integrating with Amazon S3) to handle "massive amounts" of data cost-effectively.
Technical Skills:
Search Technologies: Deep expertise in OpenSearch or Elasticsearch (ELK Stack).
Domain Tools: Experience with telecom-specific protocols like SNMP or SSH for network monitoring.
Infrastructure: Proficiency in AWS OpenSearch Service and container orchestration with Kubernetes.
Automation: Strong scripting skills in Python or Bash and Infrastructure as Code (IaC) using Terraform.
Required Skills: ELK, ElasticSearch, OpenSearch, SNMP, SSH, AWS OpenSearch