What are the responsibilities and job description for the PySpark Engineer position at M1 Technology LLC?
Looking for a PySpark developer to support a backend development team focused on middleware and backend services.
Clearance Requirement : TS/SCI with Polygraph
Required Qualifications
Clearance Requirement : TS/SCI with Polygraph
Required Qualifications
- Demonstrated experience utilizing big data technologies such as SPARK or PYSPARK.
- Demonstrated hands on experience in Solr or Elastic such as running an index, spinning up a Solr cluster and loading an index onto the cluster, and/or making Solr/Elastic schema changes, etc.
- Demonstrated experience performing data quality analysis.
- Demonstrated experience with Regular Expressions (RegEx).
- Demonstrated experience programming using languages such as Java, JavaScript, Bash, and Python.
- Demonstrated experience working with several AWS services.
- Demonstrated experience writing Java 8 (we will be upgrading to Java 17 later this year)
- Demonstrated experience with JIRA and GITHUB.
- Demonstrated experience with Spring Boot and RESTful APIs
- Demonstrated experience with Linux operating systems such as CENTOS.
- Demonstrating experience designing, developing, and deploying middleware and/or backend code to a production system
- Engage in meaningful, mission-oriented work with national impact
- Collaborate with top-tier professionals in a high-performance environment
- Work on cutting-edge projects with the latest technology
- Enjoy a culture of innovation, integrity, and technical excellence