About the job

Job summary

Key focus on building data pipelines that enable data from across government to be ingested and transformed to enable cutting-edge AI initiatives to leverage these data holdings

About the team 

The Incubator for Artificial Intelligence (i.AI) - is an AI for public good programme to harness the opportunities presented by AI to improve the lives of citizens. It will focus on a number of priority projects in home affairs, health, education and government efficiency projects. The i.AI team will use ethical and secure methods at all times to help deliver better public services. 

Building on the work of No10 Data Science Team (10DS) and other leading technology teams across the civil service i.AI will experiment and prove what is possible in improving the use of AI across the government.

You can see more about our work on ai.gov.uk

Job description

Role Responsibilities

• Have a key focus on building Data pipelines for the ingestion and transformation of data from across government to support the wider AI initiatives
• You will be using and developing Data Engineering capability provided within the AWS environment. 
• You will be required to review, document and streamline current datasets and ETL processes to integrate systems and bring multiple data sources together for analysis.
• You will deliver capability using an appropriate structured process. Agile and DevOps experience would be an advantage.
• You will be acquiring data sets from multiple sources at varying levels of maturity. You will curate and catalogue this data in partnership with the Data Scientists and analysts. Solutions will be developed using the Gov PaaS environment as well as AWS. You will be using and developing Data Engineering capability provided within the AWS environment. There is extensive use of infrastructure as code within a structured development.
• There is extensive use of infrastructure as code within a structured development environment. You will deliver capability using an appropriate structured process. Agile and DevOps experience would be an advantage.
• You can produce data models and understand where to use different types of data models. You have experience of a wide range of data engineering tools. You understand industry-recognised data-modelling patterns and standards.

Further information about the role

Do you have a question about the roles or you want to learn more about the team, the team will be holding a meet the team event on Tuesday 28th November 13.00-14.00. You can join on https://meet.google.com/zda-mvke-mvh

Person specification

• Senior of experience in infrastructure engineering, DevOps or large scale data platforms.
• Strong coding background in Python or similar and strong SQL skills
• Experience in building data pipelines (ETL and/or analytical pipelines)
• ETL Pipeline development experience using Lambda, Glue, S3, Athena, SQL, EC2, Cloudwatch, EventBridge, Redshift, Sagemaker, IAM
• Expertise in Data Modelling
• Experience in cleansing, managing and transforming high volume data
• Strong understanding of the importance Data Observability and how to implement the same

We welcome a broad range of applicants and encourage you to apply. Strong candidates come from many different backgrounds. Studies show that talented people, especially those from groups underrepresented in their field, are more likely to doubt themselves and feel like an "imposter". Unique perspectives enrich teams, so we urge you to have confidence in your potential contributions.  If aspects of this role resonate with you, please apply. We look forward to your application highlighting your skills and experiences

Benefits

Alongside your salary of £64,700, Cabinet Office contributes £17,469 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

Things you need to know

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills.

To submit an application, you will need to provide an up to date CV. We would also like you to submit a 500 word personal statement. Please ensure your CV and personal statement demonstrates how you meet the following criteria:

• Senior of experience in infrastructure engineering, DevOps or large scale data platforms.
• Strong coding background in Python or similar and strong SQL skills
• Experience in building data pipelines (ETL and/or analytical pipelines)
• ETL Pipeline development experience using Lambda, Glue, S3, Athena, SQL, EC2, Cloudwatch, EventBridge, Redshift, Sagemaker, IAM
• Expertise in Data Modelling
• Experience in cleansing, managing and transforming high volume data
• Strong understanding of the importance Data Observability and how to implement the same

Should a large number of applications be received, an initial sift may be undertaken using the lead Behaviour, Working Together.

Assessment and interview process

Your application will be reviewed by a panel. If you have been shortlisted, you will be invited to complete a technical assessment.

Technical assessment

Candidates will be sent through a problem and asked to solve it. You will present your solution technical panel for 30 minutes. We are looking to understand your thought process and hands-on experience.

If you have passed the technical assessment, the final stage will be an interview where you will be asked questions on behaviours:

• Working together

• Seeing the Big Picture, 

• Delivering at pace 

• Making Effective Decisions and 

• Communicating & Influencing

Candidates that do not pass the interview but have demonstrated an acceptable standard may be considered for similar roles at a lower grade.

Depending on the amount of application we get there might be an additional technical assessment.

Expected timeline (subject to change)

Expected sift date – 18th December 2023

Technical assessment - 1st-8th January 2024

Expected interview date/s – 15th January 2024

Reasonable Adjustment

If a person with disabilities is put at a substantial disadvantage compared to a non-disabled person, we have a duty to make reasonable changes to our processes. 

If you need a change to be made so that you can make your application, you should: 

• Contact Government Recruitment Service via cabinetofficerecruitment.grs@cabinetoffice.gov.uk as soon as possible before the closing date to discuss your needs. 
• Complete the ‘Assistance required’ section in the ‘Additional requirements’ page of your application form to tell us what changes or help you might need further on in the recruitment process. For instance, you may need wheelchair access at interview, or if you’re deaf, a Language Service Professional.

Further information

If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'contact point for applicants' section.

Please note that this role requires SC clearance, which would normally need 5 years’ UK residency in the past 5 years. This is not an absolute requirement, but supplementary checks may be needed where individuals have not lived in the UK for that period. This may mean your security clearance (and therefore your appointment) will take longer or, in some cases, not be possible.

Please note terms and conditions are attached. Please take time to read the document to determine how these may affect you.

Any move to Cabinet Office from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare. Determine your eligibility at: https://www.childcarechoices.gov.uk.

A reserve list will be held for a period of 12 months, from which further appointments can be made.

If successful and transferring from another Government Department a criminal record check may be carried out.

In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service/Disclosure Scotland on your behalf.

However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing Pre-EmploymentChecks.grs@cabinetoffice.gov.uk stating the job reference number in the subject heading. 

For further information on the Disclosure Scotland confidential checking service telephone: the Disclosure Scotland Helpline on 0870 609 6006 and ask to speak to the operations manager in confidence, or email Info@disclosurescotland.co.uk

New entrants are expected to join on the minimum of the pay band.

Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant’s details held on the IFD will be refused employment. 

A candidate is not eligible to apply for a role within the Civil Service if the application is made within a 5 year period following a dismissal for carrying out internal fraud against government.

Existing Civil Servants and applicants from accredited NDPBs are eligible to apply, but will only be considered on loan basis (Civil Servants) or secondment (accredited NDPBs). Prior agreement to be released on a loan basis must be obtained before commencing the application process. In the case of Civil Servants, the terms of the loan will be agreed between the home and host department and the Civil Servant. This includes grade on return.

Please note, these roles are for Cabinet Office. The GDS Recruitment team is supporting with the recruitment process.

Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).

See our vetting charter (opens in a new window). People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements (opens in a new window)

Working for the Civil Service

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window). The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria. The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.