Big Data Engineer
Dropthought, India
Job Description
We are Solutions Business Group in Bahwan CyberTek. We operate like a start up with quite a lot of autonomy and we are responsible for building new integrations and data products. We are a dynamic team that looks out for better ways to solve problems, define solutions and execute them to completion to produce value to consumers.
We’re hiring a BigData Engineer to work on Data As A Service/Analytics Platform that provides critical data transformation and provides insights to business stakeholders. This is a very high impact and visibility position that requires great sense for ownership and technical excellence. This is a great opportunity for a hands-on contributor who strives and outperforms under minimal supervision, communicates constructively and clearly across teams and cross-functional peers.
Requirements
- Work in a small agile team to deliver highly optimized batch and real-time data processing
- You would likely work with databases like Mysql, Postgres, BigQuery, MongoDB, Cassandra.
- Develop the robust and monitorable datapipeline and related services.
- Optimize performance and configuration of run-time environments.
- Recent 3+ years in BigData (incl. Apache Beam, Google Cloud or/and AWS)
- 4+ Advanced SQL (preferred to include MySQL, BigQuery, MongoDB)
- Working knowledge in Python and Shell scripting a must
- Comfortable working in a small, self-driven team environment.
- Able to execute on tasks with a minimum amount of direction.
- Collaborative work style no fear of pair-programming like feedback on your designs/code.
- Develop parallel algorithms and data processing using Apache big-data stack (like Hadoop, Kafka, Pig, Hive, HDFS, Spark, Splunk, Flink) amp; hybrid (like Google Cloud, AWS, etc) cloud solutions.
- 4+ years in Java or Python Programming
Benefits
Group Outings
Fun amp; Collaborative Work Environment
Health Insurance
Paid Time Off
Training amp; Development
Potential to travel to our Silicon Valley office
Much More!