We are seeking a skilled Data Engineer to join our team. The Data Engineer will be responsible for designing, developing, and maintaining our data infrastructure to enable efficient data processing, analysis, and reporting. The ideal candidate must have strong experience with Databricks, AWS, Python, PySpark, SQL, and NoSQL databases.
- Design, develop, and maintain data infrastructure on AWS cloud platform;
- Develop ETL pipelines to extract, transform, and load data from various sources to data warehouse using PySpark and SQL;
- Develop automated data quality checks and validation processes to ensure data integrity;
- Develop data models and schemas to support data analysis and reporting;
- Collaborate with data analysts and scientists to design and implement data solutions that meet business requirements;
- Monitor and maintain the performance, availability, and scalability of the data infrastructure.
- Minimum of 3 years of experience as a Data Engineer;
- Strong experience with AWS cloud services;
- Strong experience with Spark ( PySpark) for data processing and transformation;
- Strong experience with SQL and NoSQL databases;
- Experience with data modeling and schema design;
- Strong problem-solving and analytical skills;
- Excellent communication in English and collaboration skills;
- Ability to work in a fast-paced environment and handle multiple projects simultaneously.
- Experience with Databricks;
- Experience with software development best practices, such as Agile methodology and unit testing.
What you get
- Flexible working hours;
- Competitive compensation commensurate with your experience and skills;
- Modern technologies, popular on the market;
- Not boring English classes;
- Interesting customers and projects;
- Learning and development opportunities;
- An excellent team with a friendly atmosphere.
Matoffo is a cloud native company who visions cloud computing as the home for tech products. Our primary focus is AWS cloud solutions, we are an official AWS Select Tier Services Partner, that demonstrates we have trained and certified teammates, as well as great customer experience. Our team of top-notch engineers specialize in Cloud solutions, we develop scalable cloud native applications, provide DevOps services which facilitate innovations and allow release products faster, build reliable and secure cloud infrastructure for our clients from the US and Europe