Log In
Sign Up
As a Lead Data Engineer, you will lead design and development of enhanced data services and cloud enablement for Data and Services. You will push the limits of the state of the art with best-in-class data product enablement in the cloud and will design the roadmap develop data & analytics solutions that sit atop vast datasets. Your will enable a frictionless customer and developer experience, exposing data components for direct to customer use or as components for new product constructs. You will have the opportunity to create high performance analytic and ML solutions based on data sets measured in the billions of transactions and front-end visualizations to unleash the value of big data.
Responsibilities As the Lead Data Engineer, you will: • Lead the design of new data capabilities and infrastructure related to accessing and using MA, third party, and partner data to power Mastercard data products and solutions. • Design required new data pipes, data transfers, and compliance related infrastructure to enable that use of the data in the cloud. • Identify data-related capabilities and infrastructure requirements resulting from new and evolving product constructs and how those requirements can be developed cloud natively. • Understand the Data and Services business strategy, information infrastructure and data needs for both new and existing products and services across various product initiatives. • Collaborate with relevant data management, data governance and technical teams to enable long term viability of information assets and enterprise requirements. • Develop a horizontal technology roadmap in conjunction with Data Strategy & Management team input to enable technology solutions for managing data that meet the needs of multiple business stakeholder groups. • Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation. Skills Must have • Hands-on experience with technologies such as Python, Databricks, AWS, Java, Pyspark, Spark, Kafka, and SQL. • You are curious about and motivated by the future trends in data, AI/ML, analytics, and digital experience • Experience in data product development, analytical models, and model governance • Experience in anonymizing data and managing the use of data • Experience in data hygiene procedures, identity resolution capabilities or data management a plus • Exceptional interpersonal skills with proven experience in relationship building and partnering. Must work well in both team and individual settings and must be able to work with a geographically dispersed team. • Strong analytic capabilities and written and oral communication skills. Attention to detail is a must. • Strong project management skills and a demonstrated ability to understand complex information product constructs • Familiarity with industry best practices for collection and use of data • Motivated self-starter with ability to excel at multi-tasking in a fast-paced environment, outstanding English written and verbal communication skills Nice to have • Experience with performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts • Experience in working with Cloud APIs (e.g., Azure, AWS) • Experience participating in complex engineering projects in an Agile setting e.g.
Scrum
