Responsibilities
- Design and build resilient and efficient data pipelines for both batch and real-time streaming data
- Architect and design data infrastructure on cloud using industry standard tools
- Execute projects with an Agile mindset
- Build software frameworks to solve data problems at scale
- Collaborate with product managers, software engineers, data analysts and data scientists to build scalable and data-driven platforms and tools
- Ensure data integrity and scalability through enforcement of data standards. Improve data validation and monitoring processes to proactively prevent issues and quickly identify issues. Drive resolution on the issues.
- Define, understand, and test external / internal opportunities to improve our products and services.
Requirements :
Bachelor’s Degree inputer Science or have equivalent professional experienceSolid Experience with data processing tools such as Spark, FlinkSolid Experience implementing batch and streaming data pipelinesSolid experiences in Python / Go / Scala / Java.In-depth knowledge of both SQL and NoSQL databases, including performance tuning and troubleshootingFamiliar with DevOps tools such as Git, Docker, k8sExperience with the cloud ( AWS, Ali Cloud, GCP, Azure)Be proficient in SQL, familiar with advanced SQL features such as window functions, aggregate functions and creating scalar functions / user-defined functions.Proven successful and trackable experience in full end-to-end data solutions involving data ingestion, data persistence, data extraction and data analysis.Self-driven, innovative, collaborative, with goodmunication and presentation skillsFluent in English, both written and spoken.Preferred Qualifications :
Experience in FinTech, merce, SaaS, AdTech, or Digital Wallet business industries.Experience in working with teams across offices and timezones is a plus.Experience in big data tools such as Amplitude / Tableau / QlikView, Ali Cloud DataWorks, Mapute, Hadoop, Hive, Spark and HBase is a big plus.More that we love to tell you along the process!