Company DescriptionAt Fannie Mae, futures are made. The inspiring work we do helps make a home a possibility for millions of homeowners and renters. Every day offers compelling opportunities to use tech to tackle housing’s biggest challenges and impact the future of the industry. You’ll be a part of an expert team thriving in an energizing, flexible environment. Here, you will grow your career and help create access to fair, affordable housing finance.Job DescriptionAs a valued colleague on our team, you will contribute to developing data infrastructure and pipelines to capture, integrate, organize, and centralize data while testing and ensuring the data is readily accessible and in a usable state, including quality assurance.THE IMPACT YOU WILL MAKEThe Senior Data Engineer role will offer you the flexibility to make each day your own, while working alongside people who care so that you can deliver on the following responsibilities:Identify customer needs and intended use of requested data in the development of database requirements and support the planning and engineering of enterprise databases.Maintain comprehensive knowledge of database technologies, complex coding languages, and computer system skills.Support the integration of data into readily available formats while maintaining existing structures and govern their use according to business requirements.Analyze new data sources and monitor the performance, scalability, and security of data.Create an initial analysis and deliver the user interface (UI) to the customer to enable further analysis. QualificationsTHE EXPERIENCE YOU BRING TO THE TEAMMinimum Required Experiences:2 years with Big Data Hadoop cluster (HDFS, Yarn, Hive, MapReduce frameworks), Spark, AWS EMR2 years of recent experience with building and deploying applications in AWS (S3, Hive, Glue, AWS Batch, Dynamo DB, Redshift, AWS EMR, Cloudwatch, RDS, Lambda, SNS, SWS etc.)2 years of Python, SQL, SparkSQL, PySparkExcellent problem-solving skills and strong verbal & written communication skillsAbility to work independently as well as part of an agile team (Scrum / Kanban)Desired Experiences:Bachelor degree or equivalentKnowledge of Spark streaming technologies Experience in working with agile development teamsFamiliarity with Hadoop / Spark information architecture, Data Modeling, Machine Learning (ML)Knowledge of Environmental, Social, and Corporate Governance (ESG)SkillsSkilled in cloud technologies and cloud computingProgramming including coding, debugging, and using relevant programming languagesExperience in the process of analyzing data to identify trends or relationships to inform conclusions about the dataSkilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDBSkilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or InformaticaExperience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphereWorking with people with different functional expertise respectfully and cooperatively to work toward a common goalCommunication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.ToolsSkilled in AWS Analytics such as Athena, EMR, or GlueSkilled in AWS Database products such as Neptune, RDS, Redshift, or AuroraSkilled in SQLSkilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECSSkilled in Amazon Web Services (AWS) offerings, development, and networking platformsSkilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems ManagerSkilled in Python object-oriented programmingAdditional InformationThe future is what you make it to be. Discover compelling opportunities at careers.fanniemae.com.Fannie Mae is an Equal Opportunity Employer, which means we are committed to fostering a diverse and inclusive workplace. All qualified applicants will receive consideration for employment without regard to race, religion, national origin, gender, gender identity, sexual orientation, personal appearance, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation in the application process, email us at [email protected]. The hiring range for this role is set forth on each of our job postings located on Fannie Mae's Career Site. Final salaries will generally vary within that range based on factors that include but are not limited to, skill set, depth of experience, certifications, and other relevant qualifications. This position is eligible to participate in a Fannie Mae incentive program (subject to the terms of the program). As part of our comprehensive benefits package, Fannie Mae offers a broad range of Health, Life, Voluntary Lifestyle, and other benefits and perks that enhance an employee’s physical, mental, emotional, and financial well-being. See more here.