GOVTALENT.UK

Lead Data Engineer

This opening expired 6 months ago.
Location(s):
Glasgow, Leeds, York
Salary:
£40,850 to £44,549
Job grade:
Senior Executive Officer
Business area:
Information Technology (IT)
Contract type:
Permanent
Working pattern:
Full-time, Part-time

About the job

Job summary

The Government People Group exists to work with departments, professions, and functions to build a modern, effective Civil Service.

We support the government workforce with the right skills and capability. We are working with leaders to get the right people in the right jobs, with the right skills and continuous learning to excel in their roles.

We provide leadership, and in turn, create leaders with exceptional line management capability across departments, influencing partners in the wider public sector and beyond. This involves getting our retention and reward strategy right, to nurture specific skills, and create pride and resilience in our workforce.

Our role is also to provide system leadership across central government in pulling together back office services. Collectively, we help support the Cabinet Office’s priority to drive efficiencies, and reforms that will make government work better, to ultimately provide a better service to the public.

The role available sits within GPG Platforms and Services Directorate, responsible for the operation and modernisation of Civil Service digital and data platforms.

Our priorities include:

  • Designing, building and operating the systems that underpin services that are essential to government, such as Civil Service Jobs (used by over 200 organisations) and Civil Service Learning (approx 560k users).
  • Driving forward Civil Service interoperability, which will enable Civil Servants to work effectively across organisational boundaries, in a more efficient and seamless manner.
  • Providing expert technology advice and guidance to support the creation of five shared services platforms as part of the Shared Services Strategy.
  • Providing services which meet user needs and drive improved user experience so that the Civil Service operates more efficiently and effectively.

As and when our priorities change, we may need to rely on colleagues' expertise to support the delivery of alternative projects and programmes.

Job description

This is an exciting role with opportunities for contact with people at the highest levels of the Civil Service to help deliver Government People Group (GPG) priorities, to improve our business, to deliver value for our customers and for the citizen.

Responsibilities

You will utilise programming tools to undertake analysis and create scalable data products, identifying and reusing common approaches and code. You will oversee the writing of documentation and testing of code to ensure its quality.  Working collaboratively with other DDAT professionals using knowledge of product management for data pipelines. Continuously developing the team’s data capability.

You will work closely with the Government Recruitment Service and with an outsourced consultancy who are implementing an instance of UiPath. You will help with UiPath configuration and automation design, providing support, ensuring the UI path deployment is implemented as infrastructure as code and has a full disaster recovery provision.

In addition, you will aid in identifying current processes or areas of opportunity on the Government People Group landscape that could be replaced using automation such as AWS Hosted Python scripts and aiding in other Government People Group projects by providing a data cleaning, modelling and transformation service. Understanding industry-recognised data-modelling patterns and standards.

The role holder fully understands and complies with frameworks, standards and laws, including General Data Protection Regulation (GDPR), the Data Protection Act (DPA) and the Equalities Act.

You will be working with a diverse team made up of; Data Scientists, Service Delivery Manager, Business Analyst, Full Stack Developer, Technical Architect and DevOps Engineer and Subject Matter Experts which spans various teams across Government People Group.

Person specification

Essential Criteria

  • Using AWS infrastructure, develop ETL pipelines using Infrastructure as Code (YAML/CloudFormation) using Python, JSON and SQL.
  • Code to be stored as deployed via GitHub (existing GitHub actions flow).
  • Build ETL using Python to collect data and transform using AWS Glue (PySpark).
  • Transformations to be performed using PySpark or similar.
  • Store data in S3 using Parquet format to be read by AWS Athena, this will require knowledge of working with S3-based storage for use by an overlying analytics service (Athena) and will require effective partitioning of data to minimise data read costs.
  • Data to be structured to facilitate effective user access, to be controlled via AWS lake formation tags (attribute-based access)
  • Ensure reusable code is packaged into boilerplate functions.
  • Refactoring of GitHub actions, deploy pipelines.
  • Development of new features in code.
  • The minimum requirement to deal with non-technical stakeholders, mainly working with other technical staff.
  • Knowledge of UiPath, is desirable.

Desirable Criteria

Experience with using the following:  AWS config e.g. use of Lambda, S3, Glue, Step Functions, EventBridge, and Athena Python and libraries associated with data engineering and analysis.  SQL code for writing queries, stored procedures and functions Documentation and/or code storage applications e.g GitHub or similar

 Further information:

This role is aligned to the Digital, Data and Technology (DDaT) Capability Framework for the Civil Service. You can view the Performance Analyst role at https://www.gov.uk/guidance/performance-analyst  for more details

Additional information:

A minimum 60% of your working time should be spent at your principal workplace. Although requirements to attend other locations for official business will also count towards this level of attendance.

Benefits

Alongside your salary of £40,850, Cabinet Office contributes £11,930 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

Things you need to know

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills.

Application process

To apply for this post, you will need to complete the online application process which is assessed against the essential criteria (Experience and Technical success profiles)  and includes providing the following:

  1. A CV setting out your career history, with key responsibilities and achievements. You will add your information into a structured form rather than attaching a document.
  2. A Statement of Suitability explaining how your skills and experience are relevant to the role. This should include examples showing how you have completed similar responsibilities and activities. You should focus on the essential criteria listed in the responsibilities section of the advert. The statement is limited to no longer than 750 words.

    A Sift of your CV and Personal Statement will be conducted against the Essential Criteria outlined in the job description. Should a large number of applications be received, an initial sift may be undertaken using your CV. Candidates who pass the initial sift may be progressed to a full sift, or progressed straight to assessment/interview

    Selection process

    The final stage of the process will be a video interview via Google Meet where you will be assessed against the Behaviours and Technical Skills. There may be a short exercise or presentation allowing you to demonstrate your skills and experience. More details will be provided for applicants invited to interview.

    Expected timeline (subject to change)

    Expected sift date – TBC
    Expected interview date/s – TBC
    Interview location - Online

    Further information

    Please note terms and conditions are attached. Please take time to read the document to determine how these may affect you.

    A reserve list may be held for a period of 12 months from which further appointments can be made.

    Any move to Cabinet Office from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare. Determine your eligibility at https://www.childcarechoices.gov.uk

    Please note that this role requires SC clearance, which would normally need 5 years’ UK residency in the past 5 years. This is not an absolute requirement, but supplementary checks may be needed where individuals have not lived in the UK for that period. This may mean your security clearance (and therefore your appointment) will take longer or, in some cases, not be possible.

    For further information on National Security Vetting please visit the following page https://www.gov.uk/government/publications/demystifying-vetting 

    If successful and transferring from another Government Department a criminal record check may be carried out.

    In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service or Disclosure Scotland on your behalf.

    However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing Pre-EmploymentChecks.grs@cabinetoffice.gov.uk stating the job reference number in the subject heading. 

    For further information on the Disclosure Scotland confidential checking service telephone: the Disclosure Scotland Helpline on 0870 609 6006 and ask to speak to the operations manager in confidence, or email Info@disclosurescotland.co.uk

    Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant’s details held on the IFD will be refused employment. 

    A candidate is not eligible to apply for a role within the Civil Service if the application is made within a 5 year period following a dismissal for carrying out internal fraud against government.

    New entrants are expected to join on the minimum of the pay band.

    Reasonable adjustments

    If a person with disabilities is put at a substantial disadvantage compared to a non-disabled person, we have a duty to make reasonable changes to our processes. 

    If you need a change to be made so that you can make your application, you should: 

    • Contact Government Recruitment Service via cabinetofficerecruitment.grs@cabinetoffice.gov.uk as soon as possible before the closing date to discuss your needs. 
    • Complete the ‘Assistance required’ section in the ‘Additional requirements’ page of your application form to tell us what changes or help you might need further on in the recruitment process. For instance, you may need wheelchair access at interview, or if you’re deaf, a Language Service Professional.

    If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'contact point for applicants' section.



        Feedback will only be provided if you attend an interview or assessment.

        Security

        Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).

        See our vetting charter (opens in a new window). People working with government assets must complete baseline personnel security standard (opens in new window) checks.

        Nationality requirements

        This job is broadly open to the following groups:

        • UK nationals
        • nationals of the Republic of Ireland
        • nationals of Commonwealth countries who have the right to work in the UK
        • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
        • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
        • individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
        • Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service
        Further information on nationality requirements (opens in a new window)

        Working for the Civil Service

        The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

        We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window). The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria. The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

        Added: 6 months ago