Description
In this Information Age, enterprises must deal with a massive amount of data, hence creating a need for data engineers who can collect and manage large quantities of data. Data Engineers build systems that collect, manage, and convert raw data into usable information so that organizations can use to evaluate and optimize their performance. This position may be also called Database Engineer.
Where it works
ICT enterprises/ Technical Departments/ Software Development Departments/IT Department/R& D Department
Activities
- Analyse customer requirements;
- Design data warehouses;
- Develop ELT tools and database pipelines;
- Develop algorithms to transform data into useful information;
- Create new data validation methods and data analysis tools;
- Develop Business Intelligence system;
Qualifications
- At least bachelor degree in computer and information technology areas such as Information Technology, Computer Science.
- An experience in data engineering is often preferred.
Technical skills and knowledge
- Proficiency of common programming languages such as C#, Java, Python, R, Ruby, Scala and SQL. A good understanding of ETL (extract, transform, load) tools and APIs for creating and managing data integration jobs. Knowledge of relational and non-relational databases (NoSQL databases, Apache Spark, MySQL and PostgreSQL) and Unix-based operating systems (OS) such as Unix, Solaris and Linux. Being familiar with tools and frameworks for machining learning, deep learning, big data. Knowledge of cloud computing and data security is a plus.
Linguistic knowledge
- Communication in English at basic level
Soft skills and personalities
- Teamwork and cooperation skills
- Communication skills
- Goal management skills
- Problem solving skills
- Personalities: intitiave, dependability, integrity, stress tolerance, persistance, and attentive to details
