Data Engineer

The Data Engineer is responsible for the maintenance, improvement, cleaning and manipulation of data in the business’ operational and analytics data sets stored in the data lake and other external data stores for the One Food Group. This role works with software engineers and data scientists in order to understand and assist in the implementation of data requirements according to data governance to analyze performance and troubleshoot existent issues. Within the SFIA profile, the Data Engineer for the One Food Group must demonstrate Level 4 responsibilities, i.e. Enable on the competencies outlined.

Technical strategy and planning

Solution architectureContributes to the development of solution architectures in specific business, infrastructure or functional areasData managementTakes responsibility for the accessibility, retrievability, security, quality, retention and ethical handling of specific subsets of dataMethods and toolsProvides advice and guidance to support adoption of methods and tools and adherence to policies and standards

Systems development

Systems designDesigns components using appropriate modelling techniques following agreed architectures, design standards, patterns and methodologySoftware design​​​​​​​Designs software components and modules using appropriate modelling techniques following agreed software design standards, patterns and methodologyProgramming/software development​​​​​​​Designs, codes, verifies, tests, documents, amends and refactors complex programs/scripts and integration software servicesData modelling and design​​​​​​​Investigates corporate data requirements, and applies data analysis, design, modelling, and quality assurance techniques, to establish, modify or maintain data structures and their associated components (entity descriptions, relationship descriptions, attribute definitionsDatabase design​​​​​​​Develops appropriate physical database or data warehouse design elements, within set policies, to meet business change or development project data requirementsTesting​​​​​​​Reviews requirements and specifications, and defines test conditions

Installation and integration

Systems integration and buildIdentifies, evaluates and manages the adoption of appropriate tools, techniques and processes (including automation and continuous integration) to create a robust integration frameworkPorting/software configurationConfigures software and equipment and tests platform-specific versions of one or more software products

Service design

Availability managementContributes to the availability management process and its operation and performs defined availability management tasksService level managementPerforms defined tasks to monitor service delivery against service level agreements and maintains records of relevant information

Service transition

Service acceptanceEngages with project management to confirm that products developed meet the service acceptance criteria and are to the required standardConfiguration managementProposes and agrees the configuration items (CIs) to be uniquely identified with naming conventionsRelease and deploymentAssesses and analyses release components. Provides input to scheduling

Service operation

Security administrationInvestigates minor security breaches in accordance with established proceduresDatabase administrationUses database management system software and tools, and knowledge of logical database schemata, to investigate problems and collect performance statistics and create reports

Quality and conformance

Quality assuranceContributes to the collection of evidence and the conduct of formal audits or reviews of activities, processes, data, products or servicesConformance reviewCollects and collates evidence as part of a formally conducted and planned review of activities, processes, products or servicesQualifications

Educational Requirement:

Bachelor degree in Applied Mathematics or Computer Science, or demonstrated capability through past employment experience and/or relevant qualifications.(Desirable) Postgraduate qualifications (PhD or Masters with a researchcomponent) in relevant field

Work Experience Required:

Specialised professional with substantial experience in a similar data science roleDemonstrated commercial acumen with leadership experience in data science solutions in a large corporate organisation  Strong analytical and consulting background  Intellectual curiosity which propels you to dive deep into the data to answer questions that are ground breaking  Proven record of accomplishment in being able to understand the key business problem being explained, source smart data and develop data models needed to add valueCapacity to understand key algorithms and current studies available and apply them as applicable to the Food Manufacturing Industry (from which Pilmico operates on)Capability to leverage data science experience, machine learning, modelling, and advanced analytics skills to build data models  Professional skills in computer operations, business systems and tools including Hadoop, Spark, R, Python, C/C++, SQL, PIG, AWS data lake components