About the job

Job summary

The Data Division, within the Digital Directorate, is the centre of excellence for data. We work towards unlocking the power of data in Scotland for public good, focusing on security, transparency, inclusion, innovation, and sustainability.

Hear more about our vision from Tom Wilkinson, Chief Data Officer

The role

As a DataOps Engineer, you will play a key role in leveraging state-of-the-art data technologies to drive positive impacts for the people of Scotland.

This is a key role in the Data Architecture Unit which has been established to coordinate and support Data Architecture activities across the Scottish Government and Public Sector.

Focused on developing and constructing data products and services and integrating them into systems and business processes you will collaborate closely with a diverse range of professionals, each bringing unique skills to the table, fostering innovation and problem-solving in the realm of data.

Job description

Typically, you will spend your time: -

• Designing and implementing complex data flows to connect operational systems and build data catalog, APIs, and data search repositories.
• Identifying and promoting opportunities for leveraging existing data flows across different teams
• Leading the development of data-streaming systems.
• Coordinating teams and establishing best practices and standards.
• Applying your expertise in systems integration to optimise data operations.
• Advocating for data engineering excellence within the government sector.

After a successful first year you we anticipate you can look back with pride on the significant strides made in building a metadata search repository, implementing federated and self-service data architecture, and incorporating AI (Artificial Intelligence) into data architecture and governance. This will be instrumental in enhancing the Scottish Government’s cloud platform's capabilities and utility.

Strategic

• Drive automation initiatives and incorporate DevOps best practices to optimise data pipelines, deployment processes, and overall system reliability.
• Provide strategic direction in designing, implementing, and optimizing REST and GraphQL APIs to facilitate seamless data exchange between systems and applications, while also mentoring junior developers in API design principles.

Technical

• Lead the development and maintenance of Python-based scripts and applications for data processing, analysis, and automation, guiding the team to ensure high-quality code and timely delivery.
• Manipulate large datasets efficiently to extract valuable insights and support business objectives.
• Take charge in deploying and managing production-grade data tooling solutions such as Informatica, DataHub, etc., overseeing the implementation process and ensuring alignment with organizational objectives.
• Support front-end development with experience of independently creating user interfaces to interact with data and APIs.
• Lead the implementation of robust security measures to safeguard sensitive data throughout its lifecycle, while also ensuring compliance with relevant regulations and standards, and educating team members on security best practices.

Empowering

• Provide guidance and mentorship to ensure a comprehensive understanding of data structures among team members, emphasizing efficient storage, retrieval, and manipulation of data.

Person specification

No specific qualifications are required for this post.   

How To Apply

To apply for this post, you will need to provide the information requested below via the online application process.

Panels sift applications purely based on evidence provided against the essential criteria. We recommend considering how your skills, qualities, and experience to these and tailoring your both your CV and Personal statement to provide this evidence.

• A CV (no longer than two A4 pages) setting out your career history, with key responsibilities and achievements.
• Personal Statement (no longer than 750 words).

Essential Criteria

1. Proficient in Python, adept at developing robust tools and scripts tailored for data quality assurance (QA) and implementing novel features within our expansive open-source catalog.
2. Skilled in developing REST APIs using Python frameworks like Flask or Django.
3. Familiar with front-end tech (HTML, JavaScript) for basic UI creation.
4. Experienced in data manipulation using Pandas, NumPy, and SQL.
5. Strong understanding of data structures, data quality management, and data tooling concepts.
6. Previous exposure to deploying data tools like Informatica or other similar data catalogs, with expertise in data security, compliance, automation tools (e.g., Jenkins, GitHub Actions), and open-source contributions on GitHub.

The closing date for applications is 27th of May at 23:55

Interview/Assessment Information 

if you are invited to attend an interview this will include a DDaT Technical Skill Assessment and the following competencies: -

• Analysis and Use of Evidence
• Improving Performance
• Communications and Engagement
• Leading Others

More detail on these competencies can be found in the https://scottishgovernment.icims.com/icims2/servlet/icims2?module=AppInert&action=download&id=30841&hashed=1763215659

For additional information please visit

How to apply for Digital roles with Scottish Government  

Additional Information for applicants

If you have any additional questions, please email digitalcareers@gov.scot   

Benefits

Alongside your salary of £57,141, Scottish Government contributes £15,428 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

Things you need to know

Selection process details

Digital (DDaT) Pay Supplement

 

This post attracts a £5000 DDaT (Digital, Data & Technology) pay supplement after a 3 months DDaT competency qualifying period. The payment will be backdated to your start date in the role. Pay supplements are temporary payments and are subject to regular review.

 

Hybrid Working

 

We operate a flexible location policy, with a contractual named base in Scotland of either Atlantic Quay (Glasgow) or Victoria Quay (Edinburgh).

Reserve List

Candidates meeting all criteria but scoring lower than appointed candidate(s) are placed on a reserve list for 12 months. If a new matching post is identified, we can offer this position without the need for further assessment.

Reserve list offers are made in merit order in line with Civil Service Commission principles.

Diversity and Inclusion  

 Delivering a successful national service for Scotland is impossible without ensuring we consider the diverse needs, perspectives, and backgrounds of everyone in Scotland in our work.

 We welcome applications from candidates of all backgrounds, and work to ensure a positive recruitment experience where everyone is treated fairly, and with respect regardless of the outcome.

 It’s not essential to be in a similar role right now. You may be working in another field or returning from a career break - the experiences you have gained through this can bring fresh perspectives to our teams and work. 

 The Scottish Government is a diverse and inclusive workplace, and we want to help you demonstrate your full potential whatever type of assessment is used. If you require any adjustments to our recruitment process, please let us know via  ScottishGovernmentrecruitment@gov.scot  

As part of any recruitment process, Scottish Government and associated public bodies collects and processes personal data relating to job applicants and applicants for public appointments. 

Personal information you provide in the recruitment process will be made available to Scottish Government and our additional data processors. 

#LI-DNI

Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).

See our vetting charter (opens in a new window). People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements (opens in a new window)

Working for the Civil Service

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window). The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.