Senior Bigdata and Machine Learning Engineer
Unison Consulting Pte Ltd, India

• Hands on feature engineering (feature validation, feature transformation, feature pipeline, serving and training database, feature metadata and artefacts collection) and ML model lifecycle.
• Hands on experience on JAVA full stack development, Python, tensor flow expertise, reactJS and ADO.
• Experience with Data as a service implementation.
• Sound statistical knowledge, analytical and problem-solving skills are desirable.
• Knowledge of cache DB , vector DB
• A good understanding of Responsible AI Workflows and Model Management would be highly beneficial
• Relevant experience on Big data technologies (Hortonworks HDP, Apache Hadoop, HDFS, Hive, Sqoop, Flume, Zookeeper and HBase, Oozie, Spark, Ni-Fi, Kafka, Snap logic, AWS, Red shift).
• Have experience with monitoring tools.
• Development capabilities using python, spark, R languages.
• Good management and analytical skill
• Good writing and oral communication skills
• Good understanding of and experience in projects (e.g. SDLC, Agile methodology)
• Designed and implementation ETL pipelines using Apache Spark, Hive, Snowflake Structured Streaming and Python for processing event stream data.
• Performance Tuning of Apache Spark and Hadoop YARN.
• Experience with Java programming
• Provide oversight and guidance to Hadoop team and Development Team
• Camunda, Angular
• Ability to debug amp; write / modify Shell script/Python
• Very good understanding of Big Data eco-system
• Candidate should also have good knowledge of Big Data architecture patterns, design patterns, estimation techniques, performance tuning and trouble shooting
• Willing to work on-call support over weekends
• Liaise with multiple application teams amp; co-ordinate for issue resolution
• Good analytical amp; interaction skills
• Continuous monitoring and managing the Hadoop cluster.

Job Rewards and Benefits