About the job

Job summary

The AI Safety Institute is the first state-backed organisation focused on advanced AI safety for the public interest.  We launched at the AI Safety Summit because we believe taking responsible action on this extraordinary technology requires a capable and empowered group of technical experts within government.

Our staff includes senior alumni from OpenAI, Google DeepMind, start-ups and the UK government, and ML professors from Oxford and Cambridge.  We are now calling on the world’s top technical talent to build the institute from the ground up.  This is a truly unique opportunity to help shape AI safety at an international level.

We have ambitious goals and need to move fast.

Develop and conduct evaluations on advanced AI systems
We will characterise safety-relevant capabilities, understand the safety and security of systems, and assess their societal impacts.

Drive foundational AI safety research
We will launch moonshot research projects and convene world-class external researchers.

Facilitate information exchange
We will establish clear information-sharing channels between the Institute and other national and international actors. These include stakeholders such as policymakers and international partners.

Job description

About the Role

You will lead our Platform Team of software engineers and research engineers.

Through a blend of ML tooling and infrastructure, data and pipeline management, web development, and data visualisation, the Platform Team enables AISI’s core work of evaluating cutting edge advanced AI Systems. It does this by:

• Supporting the evaluations workstreams and understand and anticipate their infrastructure and research tooling needs
• Creating expert evals interfaces and highly accessible red-teaming frontends
• Providing fast and secure inference channels for internal and external models
• Developing and streamlining capabilities to host and fine-tune our own models

Your team will be cross-functional, collaborating closely with scientists, domain experts, and research engineers to develop brand new evaluation tools that leverage emerging research, while maintaining the highest levels of privacy and security integrity due to the sensitive nature of our work.

We work with a mixture of our own custom and open-source libraries for evaluations, analysis and visualisation. While much of our work will require prototyping and proving completely new approaches, our expectation is that you, as Head of Engineering, will ultimately own the delivery of a rock-solid core product that the rest of AISI can depend on.

Workstreams:

• Chem/bio:- studying how LLMs and more specialised AI systems are advancing biological and chemical capabilities relating to harmful outcomes.  This includes potential uplift to novice actors and future scenarios like design of biological agents
• Cyber misuse:- studying how LLMs and more specialised AI systems may aid in cyber-criminality and the adequacy of cybersecurity measures against AI systems
• Safeguards:- evaluating the strength and efficacy of safety and security components of advanced AI systems against diverse threats which could circumvent safeguards
• Societal impacts:- evaluating a range of impacts of advanced models that could have widespread implications for our societal fabric (e.g. undermining trust in information, psychological wellbeing, cognitive wellbeing, unequal outcomes)
• Loss of control:- testing for precursors to loss of control by measuring relevant capabilities in long-horizon computer-based tasks, for example sub-tasks of autonomous replication, AI development and self-improvement, as well as adaptation to human attempts to intervene and the ability to profitably interact with and manipulate humans

Responsibilities

You’ll be responsible for:

• Ensuring the platform runs smoothly, reliably and efficiently, including ensuring an appropriate level of test coverage to maintain a stable platform that can withstand ever-increasing evaluation traffic
• Ensuring your team has a clear roadmap that aligns with the needs of engineers and scientists at the institute, and has clarity on how to turn requirements into designs, prototypes or production code
• Establishing engineering principles behind the platform, and ensuring they’re followed

This role is best-suited to an experienced engineering or product leader.  Former founders could be a good fit or technical managers who are excited about taking on more leadership of people. 

You will need substantial experience managing high performing and diverse software engineering teams.

Day to day, you’ll lead your team through a mix of technical strategy, technical design, and providing support through code review, hiring, and people leadership.  You will also liaise with other senior team leads to stay on top of platform users’ needs, and communicate these priorities to your team.

Person specification

You will have the following qualities:

• A track record of shipping software or ML-based products
• Excellence in managing scrappy, fast-moving teams, showing the ability to work iteratively and responding to ambiguous and changing requirements
• Can own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done and push through obstacles
• Able to negotiate the right level of flexibility in developing research prototypes, trading off against delivering a solid engineering platform
• Prowess in finding creative solutions that accelerate engineers’ work and achieve higher velocity without increasing pressure on your team.
• Are strategic in balancing technical debt with pace of development and upholding reliability and good test coverage.
• Enjoy supporting your colleagues, and mentoring your team, being ready to do whatever is necessary for the organisation’s success.
• Work autonomously and in a self-directed way with high agency, thriving in a constantly changing environment and a steadily growing team, while figuring out the best and most efficient ways to solve a particular problem
• Bring your own voice and experience but also an eagerness to support your colleagues together with a willingness to do whatever is necessary for the team’s success and find new ways of getting things done within government
• Have a sense of mission, urgency, and responsibility for success, demonstrating problem-solving abilities and preparedness to acquire any missing knowledge necessary to get the job done

Core requirements

• You should be able to spend at least 4 days per week on working with us
• You should be able to join us for at least 12 months
• You should be able work from our office in London (Whitehall) for parts of the week, but we provide flexibility for remote work

Benefits

Alongside your salary of £125,000, Department for Science, Innovation & Technology contributes £18,567 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

Things you need to know

Selection process details

Candidates should note that they may only apply once for one wave within a phase campaign between Sunday 28th January 2024 to Sunday 7th April 2024, repeat applications are not permitted from the very beginning of wave 1 to the end of wave 5.  If duplicate applications are submitted then they will be rejected and no feedback will be provided for the duplicate applications.

We welcome applications on a continuous basis for this phase between January 28th and April 7th. Applications will be assessed in 5 waves throughout the phase. The cut-offs for each wave are as follows:

Waves in Phase One	Start time 23:55	End time 23:55
Wave 1	28th January	11th February
Wave 2	11th February	25th February
Wave 3	25th February	10th March
Wave 4	10th March	24th March
Wave 5	24th March	7th April

Candidates should note that if all vacancies are filled at the close of a particular stage, then AISI may close subsequent waves and/or phases.

Application Process

To apply for this post, you will need to complete the online application process, this should be completed no later than Sunday 11th February 2024 at 23:55 and will involve completing the sections in the online application outlined in this pack.

To apply for this post, you will be required to provide your CV and a personal statement
(500 word limit) setting out your answers to the questions below:-

• Why are you interested in joining the AISI right now?
• What are the most important technical projects UK government needs to undertake within the next few months to advance AI Safety?
• What do you want to be doing to drive those projects forward?
• Is there anything else about your skills, experience or background you’d like us to be aware of?

Sift and interview process

In the event of a large number of applicants, applications will be sifted on the personal statement.

Candidates should expect to go through some or all of the following stages once an application has been submitted:-

Stage 1:- Coding Test - To be completed within 72 hours *1

Stage 2:- Sifting if successful at coding test

Stage 3:- Initial Interview*2

Stage 4:- Second stage interview

Stage 5:- Third stage interview

Stage 6:- Senior Civil Servant interview

Note:
*1,  If you apply for multiple different roles within AISI that require a Coding test (Stage 1) then please be advised that you will only receive a single test link once for applications that require a coding test.  Test links will be issued within 7 days of submitting your application but no later and 1 day after the wave closes for new applications.

*2,  If you pass stage 3 and have applied for multiple different roles within AISI then please be advised that this outcome counts towards you passing for all roles that you have applied for, so you would proceed to stage 4 directly for some roles.

Sift and interview dates

Expected Timeline subject to change

Sift dates: w/c 12/02/2024

Interview dates: w/c 19/02/2024

Interview Location: MS Teams.

Candidates are asked to note the above timetable, exercising flexibility through the recruitment and selection process.

If you have any questions about the role or your application, then please send an email to active.campaigns@dsit.gov.uk

Reasonable Adjustment

We are proud to be a disability confident leader and we welcome applications from disabled candidates and candidates with long-term conditions.

We fully support adjustments throughout our recruitment process and we encourage candidates to discuss their adjustment needs by emailing the job contact which can be found under the contact point for applicants section.

We do not have an exhaustive list of adjustments that we support but just some examples include additional time to complete your application form, behaviour questions up to 72 hours prior to interview and having extra time at interview.

If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section.

If successful and transferring from another Government Department a criminal record check may be carried out.

New entrants are expected to join on the minimum of the pay band.

A location based reserve list of successful candidates will be kept for 12 months. Should another role become available within that period you may be offered this position.

Please note terms and conditions are attached. Please take time to read the document to determine how these may affect you.

Any move to the Department for Science, Innovation and Technology from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare. Determine your eligibility https://www.childcarechoices.gov.uk

DSIT does not normally offer full home working (i.e. working at home); but we do offer a variety of flexible working options (including occasionally working from home). 

In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service on your behalf.

However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing Pre-EmploymentChecks.grs@cabinetoffice.gov.uk stating the job reference number in the subject heading. 

Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant’s details held on the IFD will be refused employment. 

A candidate is not eligible to apply for a role within the Civil Service if the application is made within a 5 year period following a dismissal for carrying out internal fraud against government.

Nationality Requirements

If you do not meet the standard nationality requirements as detailed below, then we would still encourage you to submit an application.  We may be able to explore other options such as seconding you in from either your current employer or a third party organisation.

Not meeting the nationality rules set out below should not be seen as an automatic barrier to applying for this role.

Feedback

Candidates should note that they may only apply once for one wave within a phase campaign between Sunday 29th January 2024 to Sunday 7th April 2024, repeat applications are not permitted from the very beginning of wave 1 to the end of wave 5.  If duplicate applications are submitted then they will be rejected and no feedback will be provided for the duplicate applications.

Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a criminal record check. People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements (opens in a new window)

Working for the Civil Service

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window). The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.