Job Description
About the company
Upstox is one of India's leading Fin-Tech companies with a mission to simplify trading amp; investing to make it easily accessible to the masses. From new investors to seasoned traders, we aim to enable everyone to invest across multiple categories with our state-of-the-art trade amp; investment platform and commission-free pricing. We offer numerous asset categories to invest in, like Stocks, Digital Gold, IPOs, Mutual Funds, and more.By focusing on our customers’ needs and equipping them with personalized yet powerful tools, we witnessed a steep growth of 800% in our customer base from 25 Thousand in 2017 to 2 Lakh in 2019. With 1500% growth in 2020, currently, over 4 million customers trust us with their investment decisions, thus setting us on the course to become an industry leader in the country.
The company was founded in 2009 by Ravi Kumar and Shrinivas Viswanath, and in 2016 Kavitha Subramanian joined as the third co-founder. Backed by Ratan Tata, we raised $4 million in Series A funding (2016) led by Kalaari Capital. In 2019, US-based investment firm Tiger Global Management invested $25 million in a Series B funding round. Visit our Linkedin page to learn more about us.
Role: Data Engineer/Senior Data Engineer
Who you will work with:
The Data Engineering team at Upstox is responsible for architecting, developing and maintaining a Lake House (Data Lake + Data Warehouse) which serves as a single source of truth for organization-wide data. The team is also responsible for governing the data assets, generating business amp;customer insights and securely amp; optimally exposing it to downstream systems, services and end Users.
What you will do:
1. Create and maintain scalable Big-data ETL pipelines that feed organization-wide data into Upstox Data Platform(UDP).2. Create and maintain modular and scalable Big-data processors that can be leveraged to get business amp; customer insights, operational efficiency and other key business performance metrics.3. Create and maintain scalable connectors that expose the data securely for consumption by down stream systems and services in near real-time.4. Collaborate with Devops amp; Infra team to build the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources.5. Collaborate with Devops team to monitor and maintain the data platform components and ensure internal uptime SLAs are met.6. Collaborate with the DBA amp; BI team to setup data quality control processes.
You should apply if you have:
1. Must have: Hands-on working experience with Python / Scala, Spark(or similar frameworks), Big-data ETL pipelines, Hadoop (or similar distributed systems), advanced SQL,SQL query tuning.2. Good to have: Working knowledge of streaming frameworks (Spark Streaming / Apache Flink or similar frameworks), workflow management tools / platforms (Apache Airflow / NiFior similar solutions), dimensional data modelling, cloud native solutions (preferably on AWS).3. Brownie Points: Understanding of AWS Services -Redshift, DynamoDB, Lambda, Glue, Athena, Lake Formation, IAM, SQS amp; SNS, creating Cloud Formation / Terraform templates, understanding of Devops amp; SRE.4. At least 3 years of experience with minimum 1.5 years of experience in a Data Engineering role with exposure to dealing with large volumes of data.5. Bachelor's / Master's degree in the field of Computer Science or equivalent.6. Resilience and determination to deliver with high standards.7. A Well-organized approach to problem solving and exhibit attention to detail.8. A strong desire to work in a fast-paced dynamic environment.9. Technical expertise to deliver scalable enterprise-grade solutions and own it end to end.10. Strong communication skills and demonstrate effective collaboration with multiple stakeholders.
Location: Bengaluru / Mumbai
Upstox is an Equal Opportunity Employer; all qualified applicants will receive consideration for employment wit
Job Specification