Back

Senior Engineer - Hadoop/Spark

Get Referred

Job Description

“You Lead the Way. We’ve Got Your Back. 

At American Express, we know that with the right backing, people and businesses have the power to progress in incredible ways.  Whether we’re supporting our customers’ financial confidence to move ahead, taking commerce to new heights, or encouraging people to explore the world, our colleagues are constantly redefining what’s possible - and we’re proud to back each other every step of the way. When you join #TeamAmex, you become part of a diverse community of over 60,000 colleagues, all with a common goal to deliver an exceptional customer experience every day.”
 

Function Description:

Privacy is about the fair, legal and transparent collection, use, sharing, deleting or otherwise ‘processing’ of personal data. The Mission of Enterprise Privacy Choice (Capabilities) is to empower customers and prospects to make choices around how we process and use their personal data; and then honor that choice.

Our Engineers that join our Technologies team will be responsible for development and management of business critical platforms. You will be part of a fast-paced, entrepreneurial team responsible for delivering projects platform supporting our global customer base. You will be challenged with identifying innovative ideas and proof of concept to deliver against the existing and future needs of our customers. Our Software Engineers not only understand how technology works, but how that technology intersects with the people who count on it every day. Today, innovative ideas, insight and new perspectives are at the core of how we create a more powerful, personal and fulfilling experience for all our customers.

Responsibilities:

  • Lead through the full life cycle of DevOps projects: from requirements gathering through white-boarding, infrastructure automation design, tool selection, system design, coding, delivery, support and enhancements.
  • Work as a hands-on member of the Infrastructure team in leading and defining a DevOps roadmap for American Express IT Infrastructure for cloud, infrastructure and application automation.
  • Work directly and collaboratively with engineering teams, architects to deliver infrastructure automation solutions.
  • Responsible for design, implementation and maintenance of cloud-based systems including administration, performance tuning, optimization, scripting and automation.
  • Work as an active participant in an Agile development environment.
  • Work to oversee, design, implement, and manage DevOps capabilities using CI/CD toolsets and automation.
  • Closely collaborate with software engineers to make it easy for them to roll out new code and test new features.
  • Partner closely across engineering and service Operations teams to establish best practice, improve deployment methodology and ensure robust back out/ contingency plans.
  • Drive continuous improvement to reduce MTTR (Mean Time to Recovery) and MTTD (Mean Time to Detection) on production impacts. Proactively address gaps with stability issues across infrastructure environment.
  • Establish application monitoring KPIs to measure performance and identify system bottlenecks/failure points.
  • Partner closely with engineering and service operations teams to enable a robust and quality driven, development and production delivery environment.
 

Minimum Qualifications

Minimum Qualifications:

  • 5+ years of related experience.
  • Bachelors Degree; Advance Degree preferred.
  • Required Skills: Hadoop, pySpark, Spark, SQL, Scala, Sqoop, Kafka.
  • Additional Skills Highly Valued: Spring Boot, Spring Data, Spring Batch, Redis, Elastic Search, Kibana, Mockito, Couchbase, Postgres, DB2, HashiCorp Vault, REST API’s, Jenkins, Git, Sonar Cube, Openshift Cloud, Mainframe (hands on)

Employment eligibility to work with American Express in the U.S. is required as the company will not pursue visa sponsorship for these positions.

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability status, age, or any other status protected by law.

 


ReqID: 21010188
Schedule (Full-Time/Part-Time): Full-time
Date Posted: May 6, 2021, 11:20:21 AM