Data Engineer, Boost-IT, PT

Boost IT is a Portuguese technology consultancy company, we are integrated into one of the most entrepreneurial groups in Portugal, with investment in more than 30 companies.

We want to be known for being the most dynamic, energetic and reliable company to operate in the market and, for that, we want to count on you.

If you're passionate about technology and want to work on the most relevant technology projects, then this ad could be for you!

Tasks

- Responsible for implementing and maintaining the data and machine learning pipelines to ensure that data quality and consistency throughout the different stages of the application

- Responsible to ensure monitoring of the data pipelines including optimizing them across metrics such as performance, cost and reliability,

- Working together with the entire team and business stakeholders, the data engineer will ensure that data is available in an appropriate format to use for model training and reporting. This includes designing appropriate data stores, schema, indexation and partitioning.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience with data processing frameworks such as Apache Spark or Hadoop.
• Strong proficiency in SQL and experience with relational databases.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Excellent problem-solving skills and ability to work collaboratively in a team environment.