Demo

Principal Engineer - Network Tools and Observability

Wells Fargo
Wells Fargo Salary
Chandler, AZ Full Time
POSTED ON 12/17/2025
AVAILABLE BEFORE 1/16/2026
At Wells Fargo, we are looking for talented individuals who put our customers at the center of everything we do. Help us build a better Wells Fargo. It all begins with outstanding talent. It all begins with you.

Learn more about the career areas and lines of business at wellsfargojobs.com .

About This Role

We are hiring a Principal Engineer - Network Tooling and Observability within the Cyber Security organization's Innovation and Transformation team. In this role, you will lead the evolution of the bank's network tooling ecosystem, ensuring it delivers actionable insights, automation, and resilience across hybrid environments.

Key Responsibilities

  • Strategy & Roadmap: Advise leadership on multi-year strategy for network tools and observability (NPMD, telemetry pipelines, topology, synthetic monitoring), aligned with SRE, Security, and Cloud initiatives.
  • Architecture: Design and evolve the observability stack, selecting tools and technologies (e.g., SNMP, flow/IPFIX, syslog, streaming telemetry/gNMI, OpenTelemetry, APM/NPM, log analytics, time-series DB) for scalability across on-prem, cloud, and branch environments.
  • Delivery Leadership: Oversee implementation and integration with ITSM/CMDB, CI/CD, configuration compliance, and ITIL-based incident/problem/change workflows.
  • Cross-Functional Collaboration: Partner with NetOps, SRE, SecOps, Cloud, and Lines of Business to translate requirements into architecture and measurable outcomes.
  • Blueprints & Standards
    • Define baselines for telemetry and data collection:
      • SNMP polling and SNMP traps
      • Syslog ingestion and correlation
      • Flow data (NetFlow, sFlow, IPFIX, etc.)
      • Packet capture tools for deep traffic analysis
      • Integration with vendor-based controllers and SaaS platforms
    • Define tooling standards across platforms such as:
      • Spectrum, DX NetOps, NFA
      • Big Switch / DMF, CVP / CVaaS / DCNM
      • DNAC / CatC, NetScout / GigaMon
      • Prime / Airwave / CV-Cue
  • Enterprise Impact:
    • Lead resolution of complex challenges requiring deep evaluation across multiple domains.
    • Translate strategic business objectives and enterprise technology landscape into engineering solutions.
    • Provide vision and technical direction to leadership for innovative, large-scale solutions.
  • Operational Excellence:
    • Optimize processes and drive robust automation.
    • Identify inefficiencies and promote continuous improvement.
  • Leadership & Mentorship:
    • Align stakeholders through clear technical communication.
    • Mentor teams and deliver knowledge transfers to upskill SMEs.
    • Present technical concepts to senior leaders.
Required Qualifications:

  • 7 years of Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 7 years in large-scale network engineering/operations, with 5 years focused on tooling and observability.

Desired Qualifications:

  • Expert knowledge of enterprise networks (L2/L3, BGP/EVPN, DC fabrics, SD-WAN, SASE, firewalls, LB, DNS/DHCP/IPAM) and cloud networking (Azure/AWS/GCP: VNet/VPC, Transit, Direct Connect/ExpressRoute).
  • Deep experience with telemetry & tooling: SNMP, NetFlow/IPFIX/sFlow, syslog, streaming telemetry (gNMI/NETCONF/RESTCONF), synthetic monitoring, path analytics, and topology.
  • Hands-on experience with tools such as ThousandEyes, AppDynamics, Splunk/Elastic, Prometheus/Grafana, ServiceNow.
  • Automation and integration skills: Python, Ansible, Terraform, CI/CD, REST APIs, webhooks, event pipelines.
  • Strong grasp of SRE principles (SLIs/SLOs/error budgets), reliability and resilience (RTO/RPO, DR, chaos engineering).
  • 5 years of technical design experience.
  • 5 years of network or network security design experience.
  • Strong knowledge of end-to-end network architecture and protocols.
  • Excellent communication and technical writing skills.
  • Ability to define business requirements and align them with tooling strategy.
  • Ability to translate complex technical needs into clear, actionable collaboration.
  • Proven leadership and mentoring capabilities.

Job Expectations:

  • Ability to travel up to 20% of the time

Posting End Date:

4 Dec 2025

  • Job posting may come down early due to volume of applicants.

We Value Equal Opportunity

Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.

Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements.

Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.

Applicants With Disabilities

To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo .

Drug and Alcohol Policy

Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy to learn more.

Wells Fargo Recruitment And Hiring Requirements

  • Third-Party recordings are prohibited unless authorized by Wells Fargo.
  • Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.

Reference Number

R-503842-2

Salary.com Estimation for Principal Engineer - Network Tools and Observability in Chandler, AZ
$149,241 to $173,910
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Principal Engineer - Network Tools and Observability?

Sign up to receive alerts about other jobs on the Principal Engineer - Network Tools and Observability career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$131,611 - $156,576
Income Estimation: 
$141,102 - $168,742
Income Estimation: 
$194,188 - $238,415
Income Estimation: 
$121,346 - $138,513
Income Estimation: 
$108,098 - $130,480
Income Estimation: 
$131,611 - $156,576
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Wells Fargo

  • Wells Fargo FAIRBANKS, AK
  • Why Wells Fargo: Are you looking for more? Find it here. At Wells Fargo, we're more than a financial services leader – we’re a global trailblazer committed... more
  • 13 Days Ago

  • Wells Fargo Anchorage, AK
  • Why Wells Fargo Are you looking for more? Find it here. At Wells Fargo, we're more than a financial services leader - we're a global trailblazer committed ... more
  • 13 Days Ago

  • Wells Fargo Anchorage, AK
  • Why Wells Fargo Are you looking for more? Find it here. At Wells Fargo, we're more than a financial services leader - we're a global trailblazer committed ... more
  • 13 Days Ago

  • Wells Fargo Burlington, VT
  • About This Role Wells Fargo is seeking a Branch Support Manager in Wealth and Investment Management as part of Wells Fargo Advisors. Learn more about the c... more
  • 13 Days Ago


Not the job you're looking for? Here are some other Principal Engineer - Network Tools and Observability jobs in the Chandler, AZ area that may be a better fit.

  • Discount Tire Scottsdale, AZ
  • Overview Here at Discount Tire, we celebrate the spirit of our people with extraordinary pride and enthusiasm. Our business has been growing for more than ... more
  • 2 Days Ago

  • Amazon Tempe, AZ
  • Description Are you passionate about automating processes and simplifying work? Is the opportunity to contribute toward Amazon's ability to scale operation... more
  • 19 Days Ago

AI Assistant is available now!

Feel free to start your new journey!