Mactores is a team of emerging technologists, data engineers, and data scientists driven by excellence in technology to solve critical business problems. We help bridging complex business challenges with technical expertise. Specializing in AI, Fast Data, Industrial IoT and Cloud helps us collaborate with organizations that view technology as a strategic driver to success.
As a pySpark Data Engineer, you have 4 years of hands on experience in Data Engineering. You work with business leads, analysts, and data scientists to understand the business domain and engage with fellow engineers to build data products that empower better decision-making. You are passionate about the data quality of our business metrics and the flexibility of your solution that scales to respond to broader business questions.
If you love to solve problems using your skills, then come join the Team Mactores. We have a casual and fun office environment that actively steers clear of rigid "corporate" culture, focuses on productivity and creativity, and allows you to be part of a world-class team while still being yourself.What you will do?
- Write efficient code in the chosen technology for the project - For example - Spark, Apache Beam.
- Explore new technologies and learn new techniques to solve business problems creatively.
- Collaborate with many teams - engineering and business, to build better data products and services.
- Deliver the projects along with the team collaboratively and manage updates to customers on time.
What are we looking for?
- 4 to 7 years of experience in Apache Spark.
- 2+ years of experience in writing ETL jobs using pySpark, and SparkSQL
- 2+ years of experience in SQL queries and stored procedures
- Have a deep understanding of all the Dataframe API with all the transformation functions supported by Spark 2.7+
You are preferred if you have
- Prior experience in working on AWS EMR, Apache Airflow
- Certifications- AWS Certified Big Data SpecialtyCloudera or Hortonworks Certified Big Data Engineer
- Understanding of DataOps Engineering
Mactores provides equal opportunity in all of our employment practices to all qualified employees and applicants without regard to race, color, religion, gender, national origin, age, disability, marital status, military status, genetic information or any other category protected by federal, state and local laws. This policy applies to all aspects of the employment relationship, including recruitment, hiring, compensation, promotion, transfer, disciplinary action, layoff, return from layoff, training and social, and recreational programs. All such employment decisions will be made without unlawfully discriminating on any prohibited basis.
Note: Please answer as many questions as possible with this application, to accelerate the hiring process.