What are the responsibilities and job description for the Senior Data Engineer position at Software Methods, Incorporated?
Software Methods is seeking a full-time Senior Data Engineer to assist our client in the Media or West Chester, PA areas. This is 100% on-site.
The Senior Data Engineer is responsible for the administration, support, and enhancement of the enterprise data platform. In fulfilling those duties, this role will work with the Analytics team to understand requirements, validate architectural design decisions, and seek general direction on work to be accomplished. The Senior Data Engineer will also work with the Data Operations team to establish proper operational controls and monitoring of the platform and its pipelines while providing support for all data flowing through the platform. As a senior resource, this role will be expected to act as an expert in the field of data engineering that helps define standard patterns for development, provides support to analytics engineers, and provides significant input into the ongoing roadmap for the platform. This role is a hands-on role that will be expected to build and maintain data pipelines and integrations with other systems. In addition, the Senior Data Engineer will assist in the development and maintenance of in-house Java based application.
Responsibilities:
- Develop, maintain, and support key data pipelines related to ingestion of internal source data and externally provided partner data.
- Modeling and development of core data assets used throughout the organization.
- Ownership of orchestration and monitoring for all production data assets.
- Development of APIs, as needed to support data integration.
- Configuration of AWS services, as needed.
- Documentation of all aspects of the data platform.
- Regular maintenance of application databases.
- Establish and maintain core data operations best practices including development standards, code deployment, and recovery procedures.
- Management and administration of all data platform components.
Required Experience:
- Information Technology Bachelor’s degree or preferred
- Minimum 5 years of experience with the following: Snowflake, DBT, Glue, FiveTran (nice to have)
- Working knowledge configuring AWS services: RDS, Lambda, S3, Glue, Kubernetes
- Minimum 5 years’ experience with the following programming languages: Python, SQL, Java Script, HTML/CSS, Coffee script (nice to have)
- Experience with data modeling
- Familiarity with MDM concepts and techniques
- Familiarity with RBAC concepts
- Strong troubleshooting and problem-solving skills.
- Excellent written and oral communication skills.
- Ability to multi-task and handle consistent workflow.
- Time management and prioritization skills.
- Computer, email, and MS Office competency.
If this sounds like you, please contact us today!
Unable to sponsor visas for this position. Please encourage those authorized, to work in the U.S. without a visa, to apply!
No third parties please.