A Data Engineer’s overall mission is to build solutions (fluid collection, storage, and exploitation of data) that take large amounts of data into account with technologies such as Spark for Big Data, NoSQL for databases, and Hadoop for infrastructures. Data engineers are also expected to: