What are the responsibilities and job description for the Senior Data Engineer (Databricks, AWS) position at SilverSearch, Inc.?
Job Details
** This requires ONSITE interview - NJ office **
Senior Data Engineer
We are looking for a Senior Data Engineer who will play a significant role in the creation and rollout of a centralized data hub that supplies refined client-service data at an enterprise level. This is a hands-on role focused on building scalable data pipelines, shaping enterprise data models, and enabling analysts, data scientists, applications, and business units to access high-quality, trusted data.
Key Responsibilities
- Lead the architecture and development of a service data hub supporting enterprise-wide consumption.
- Build and maintain scalable data pipelines primarily in Databricks for both structured and unstructured data.
- Develop enterprise data models for data lakes, warehouses, and analytics solutions.
- Define and implement data ingestion strategies (APIs, streaming, batch, replication).
- Conduct source data analysis and ensure data quality, governance, lineage, and metadata.
- Collaborate with source system owners, architects, and engineering teams across the organization.
- Mentor developers and contribute to best practices for data engineering.
- Support internal business units with standardized, consumption-ready service data.
Required Experience
- 8 years in data engineering, including proven hands-on experience with Databricks.
- Hands-on experience building enterprise data lakes and pipelines
- Strong AWS expertise; Azure experience a plus.
- Proficiency in Python, SQL, PySpark, and cloud-native ETL/ELT frameworks.
- Strong understanding of data modeling, data lakes, streaming, APIs, JSON, and real-time ingestion.
- Experience with RDBMS (Oracle, SQL Server) and familiarity with NoSQL (MongoDB).
- Hands-on experience with GitHub, JIRA, Confluence, CI/CD, Terraform, and Jenkins.
- Strong communication, problem-solving, and analytical skills.
- Strong troubleshooting ability and experience supporting multiple business units.
- Relevant certifications preferred
Salary : $80 - $90