Splunk Observability & APM Integration Specialist

Job title: Splunk Observability & APM Integration Specialist
Location : Warren, NJ - 3 days a week on-site is a must
Contract : 6 month assignment with the option to extend. Full-time is possible in the future as well.
Rate : Open and will be commensurate with experience.




Must have the following: Advanced Splunk administration, expert SPL, OpenTelemetry, APM and distributed tracing, Splunk APM/SignalFx, Dynatrace, synthetic monitoring, shell scripting, PowerShell, LogicMonitor, AutoSys, enterprise observability, logs, metrics, traces, SLOs, alerting, and dashboard development.

We're looking for a senior hands-on Observability Architect/Engineer who has actually designed and built enterprise monitoring platforms using Splunk/OTel/APM/Cribl, can integrate logs, metrics, and traces across Windows, Linux, and AIX, build alerting and synthetic monitoring, automate onboarding, and personally troubleshoot the platform in production.

Responsibilities:
Our client is seeking a hands-on Splunk Observability & APM Integration Specialist to help build an enterprise monitoring and observability framework from the ground up. This contract-to-hire consultant will establish Splunk as the central analytics and dashboarding platform while integrating existing monitoring tools, application telemetry, infrastructure data, batch pipelines, and messaging platforms.

• Build Splunk dashboards, correlation searches, and SPL-based operational views that support a single-pane monitoring model.
• Integrate LogicMonitor, AutoSys, OpenTelemetry, and custom data collectors into Splunk.
• Establish practical APM capabilities, including distributed tracing using an OpenTelemetry-first approach.
• Assess and advise on buy-versus-build decisions across Splunk APM/SignalFx and Dynatrace.
• Design synthetic monitoring for critical user journeys, including SLOs, alerting, escalation workflows, and PagerDuty routing.
• Develop automation using shell scripting and PowerShell across Windows and Linux environments.
• Assess applications to identify meaningful logging, metric, and tracing opportunities.
• Build tactical dashboards for immediate operational visibility and strategic dashboards for long-term support and incident response needs.
• Create architecture documentation, implementation patterns, operational runbooks, and knowledge-transfer materials.
• Develop telemetry solutions for legacy, custom, unconventional, or unsupported platforms.
• Partner with technical and operational stakeholders to deliver measurable monitoring outcomes.

Requirements:

• Advanced Splunk administration experience with expert-level SPL skills.
• Strong background in log observability, operational monitoring design, and enterprise dashboard development.
• Hands-on APM, application instrumentation, and distributed tracing experience.
• Strong knowledge of OpenTelemetry, including Collector, OTLP, telemetry pipelines, and instrumentation patterns.
• Experience with Splunk APM/SignalFx and Dynatrace, including synthetic monitoring capabilities.
• Strong shell scripting and PowerShell automation skills.
• Experience with LogicMonitor and AutoSys, or comparable monitoring and workload automation platforms.
• Solid understanding of logs, metrics, traces, SLOs, alerting, incident response, and modern observability practices.
• Ability to instrument difficult-to-monitor platforms and normalize telemetry into a unified observability framework.
• Strong application assessment skills, including identifying logging opportunities and translating findings into dashboards and monitoring strategies.
• Clear verbal and written communication skills with a collaborative approach to documentation and knowledge transfer.
• Ability to work effectively with engineering, infrastructure, operations, and support stakeholders.
• Experience with PagerDuty, fintech platforms, regulated environments, or enterprise incident-response dashboards is preferred.