Data Engineer - Gaia team

We are looking for you, if you:

• Have hands-on experience building complex data pipelines,

• Have knowledge of data manipulation and transformation,

• Include data quality approach in your daily work – uncompromising approach to maintain accuracy and validity of all output data,

• Have knowledge of software engineering best practices,

• Have experience in setting up and optimizing both SQL and noSQL data stores (MS-SQL, Hive), as well as familiarity with object storage services (e.g., S3),

• Have experience with deployment and provisioning automation tools (e.g., Docker, Kubernetes, CI/CD),

• Have experience with Apache Airflow, Spark, Python, Kedro.

You'll get extra points for:

• Experience working in cloud environment (e.g., Azure DevOps, GCP),

• Experience managing and further developing distributed systems and clusters for batch processing,

• Knowledge of MLOps architecture and practices,

• Agile way of working – We have a startup mindset; we iterate on experiment with MVPs, learn from them, and improving them,

• Comfortable working in the international and cross-functional teams.

Your responsibilities:

Your passion is to work with the latest concepts and technologies in the field of Data Engineering. As an engineer, you will be responsible to design and build the data pipelines for one of many use cases catering stakeholder requirements such as which clients have the worst carbon emission footprint – so ING can decide to discontinue doing business with them, collaborate with the data analysts and UX researchers to create the best user experience and insights for our users. Your day-to-day activities can look like this: implementing new features in Kedro/PySpark, testing them in Apache Airflow, deploying it in our in-house platform running on Kubernetes, as well as optimizing the data in the permanent data store.

Information about the squad:

You will work as a data engineer in Gaia –the squad provides the data to steer ING portfolios in line with climate sector targets. They provide insights into the current and future impact of bank clients’ CO2 intensities on ING’s NetZero 2050 climate promises. They combine internal ING data with external providers to automate ING’s Terra approach sector by sector, enabling portfolio management and deal level decision making. Gaia is one of the projects that are of the ESG domain in ING, and it has a lot of impact on the organization, and even society itself.