Technical Manager - LLMs, RAG and ML

Location:
Toronto, ON, Canada
Business:
Energy Systems
Position type:
Full Time
Contract type:
Permanent Employee
Job ID:
6995
Apply

Overview

About us

We are the independent expert in assurance and risk management. Driven by our purpose, to safeguard life, property, and the environment, we empower our customers and their stakeholders with facts and reliable insights so that critical decisions can be made with confidence.

As a trusted voice for many of the world’s most successful organizations, we use our knowledge to advance safety and performance, set industry benchmarks, and inspire and invent solutions to tackle global transformations.

About Energy Systems

We help customers navigate the complex transition to a decarbonized and more sustainable energy future. We do this by assuring that energy systems work safely and effectively, using solutions that are increasingly digital. We also help industries and governments to navigate the many complex, interrelated transitions taking place globally and regionally, in the energy industry.

About the role

Technical Manager – LLMs, RAG and ML is a strategic role within the Product organization, reporting to the Head of Section - AI Solutions. This role is responsible for translating applied AI strategy into customer-ready capabilities, prototypes, reusable technical patterns, evaluation methods, and production-oriented solution designs that support the Transformational Trust Initiative and broader digital platform enablement across Energy Systems.

This role is responsible for translating applied AI strategy into customer-ready capabilities, prototypes, reusable technical patterns, evaluation methods, and production-oriented solution designs that support the Transformational Trust Initiative and broader digital platform enablement across Energy Systems.

This role sits within Digital & Transformation and operates as a core product partner to the AI Solutions function, working across advisory regions, Renewable Certification, Digital & Data Solutions, Global Service Area Leads, engineering, data science, UX, and domain experts.

This position collaborates directly with the Head of Section - AI Solutions to identify high-impact AI opportunities, define product requirements, validate prototypes and proofs-of-concept, and support the delivery of scalable AI-driven workflows across Energy Systems.

This role is based at Toronto, ON office.

What You'll Do

AI Product Strategy & Roadmap Contribution

  • Partner with the Head of Section – AI Solutions to translate the applied AI strategy into an executable technical roadmap, delivery plan, and prioritized set of AI product capabilities
  • Contribute to roadmap definition, product vision, and technical strategy for LLM-enabled workflows across the Transformational Trust platform.
  • Identify high-impact opportunities where AI, language models, retrieval systems, and automation can improve customer value, workflow efficiency, decision quality, and platform adoption.
  • Help define technical standards, delivery patterns, and reusable components for AI-powered product development across advisory and digital platform workflows.
  • Provide informed recommendations on model selection, retrieval architecture, evaluation approach, prompt strategy, orchestration patterns, and technical feasibility.

LLM, RAG and AI Solution Development

  • Design, prototype, and guide delivery of AI-enabled capabilities using Large Language Models, generative AI foundations, Retrieval-Augmented Generation, vector search, and structured output techniques.
  • Develop proof-of-concepts, reference implementations, and solution designs that engineering partners can implement, scale, and maintain.
  • Design retrieval and indexing approaches for complex document, language, and workflow data, including semantic search, and context construction.
  • Apply prompt engineering, tool/function calling, structured reasoning, and multi-step workflow patterns to support reliable AI-enabled product experiences.
  • Support fine-tuning, LoRA, model adaptation, and evaluation approaches where needed to improve domain performance, task reliability, and user outcomes.

AI Evaluation, Quality and Responsible Use

  • Establish practical evaluation methods for LLM-enabled workflows, including accuracy, relevance, reliability, retrieval quality, user experience, and task completion metrics.
  • Develop benchmark approaches, test datasets, evaluation rubrics, and monitoring methods to support reliable AI performance over time.
  • Partner with the Head of Section, data science, engineering, and governance stakeholders to support responsible AI practices, including transparency, risk identification, data considerations, and appropriate human oversight.
  • Define quality standards for prototypes, AI components, prompt patterns, retrieval workflows, and production handoffs.
  • Track and communicate AI product performance against KPIs tied to customer value, workflow efficiency, model quality, and responsible AI outcomes.

Cross Functional Technical Leadership

  • Lead cross-functional AI delivery efforts across product, engineering, data science, UX, domain experts, and customer-facing teams.
  • Serve as a technical translator between business needs, user workflows, AI methods, and engineering implementation.
  • Provide technical guidance to teams working on LLM applications, retrieval systems, chatbot or agentic workflows, data pipelines, and AI-enabled decision support.
  • Support rapid prototyping and iteration while maintaining a disciplined approach to quality, scalability, and responsible deployment.
  • Coach emerging AI and product talent as the AI Solutions function grows, helping build a culture of experimentation, rigor, inclusion, and continuous improvement.

What we offer

• Generous paid time off (vacation, sick days, company holidays, personal days)

• Medical, Dental and Vision benefit plans available to all employees

• Special programs – Employee Assistance Program and accident and critical illness options for you and your family

• Workplace strategies for mental help resources available to all employees

• Registered Retirement Savings Plan (RRSP) with company match

• Company provided life insurance, short-term, and long-term disability benefits

• Education Assistance Program

• Flexible work schedule with hybrid opportunities

• Consumer discounts and rewards through our BenefitsHub

• Advancement opportunities

**Benefits vary based on position, tenure, location, and employee election

DNV is a proud equal-opportunity employer committed to building an inclusive and diverse workforce. All employment is decided on the basis of qualifications, merit, or business need, without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.

About you

What is Required

  • Bachelor’s degree required
  • 5+ years of relevant experience
  • Significant hands-on experience designing, developing, evaluating, or delivering LLM-enabled capabilities in digital products, applied AI solutions, or customer-facing platforms
  • Demonstrated experience with Retrieval-Augmented Generation, vector search, semantic retrieval, indexing strategies, or related methods for working with large text or document datasets
  • Experience developing or applying LLM evaluation methods, model quality metrics, benchmark approaches, prompt evaluation, chatbot evaluation, or human-centered AI assessment methods
  • Strong understanding of prompt engineering, structured outputs, tool/function calling, model orchestration, and practical techniques for improving reliability in LLM-enabled workflows
  • Experience contributing to product strategy, technical roadmaps, product discovery, solution design, or prioritization of AI-enabled capabilities
  • Demonstrated track record delivering AI, machine learning, NLP, chatbot, language modeling, or data science products from concept through implementation or production handoff
  • Ability to work directly with engineering, data science, UX, product, business stakeholders, and customer-facing teams to translate complex needs into scalable technical solutions
  • Strong communication skills, including the ability to explain AI concepts, tradeoffs, risks, and product implications to both technical and non-technical audiences
  • Experience leading cross-functional initiatives, technical workstreams, or small teams in a product, AI, data science, or technology environment
  • Strong written and verbal English communication skills
  • We conduct pre-employment background screening

What is Preferred

  • Master’s degree or equivalent advanced experience in data science, machine learning, artificial intelligence, computer science, or a related field
  • Experience with FAISS or similar vector indexing, embedding, semantic search, or retrieval technologies
  • Experience with fine-tuning, LoRA, model adaptation, synthetic data generation, or custom objective functions for language models
  • Experience developing AI-enabled workflows for advisory, evaluation, due-diligence, risk, compliance, technical review, customer support, or knowledge-intensive professional services
  • Familiarity with responsible AI frameworks, data governance, privacy considerations, or model risk management
  • Experience delivering customer-facing products or internal platforms using AWS or comparable cloud environments
  • Background in complex, technical, regulated, or high-trust sectors

*Immigration-related employment benefits, for example visa sponsorship, are not available for this position*

#LI-DNI

#LI-DNP

Benefits

Please note, benefits may depend on your contract type, please confirm with your recruiter.

Profit Share

You’ll be part of our global profit share scheme that means we all share in our success as a business. If we profit, so do you. This will be part of our Total Compensation approach each year and depends on our year-end results.

Insurance

Taking care of you with travel, life, and accident insurance.

Pension Schemes

We care about your long-term financial security and prioritize pension and retirement benefits to reflect our caring values.

Professional Development

We believe in the 70/20/10 learning model, where 70% of your learning comes from performing your everyday tasks and working on different projects, new areas and initiatives to gain new skills. 20% from working with others and mentoring and the rest from formal education.

Hybrid Working

Adapting to the changing world of work around the world.

Purpose-led organization

You become part of a world-leading company where we know and live our purpose; to safeguard life, property, and the environment, with the opportunity to tackle global change through your work.

Supportive and caring culture

We offer opportunities to connect through social and professional networks. Our largest community CONNECT, organizes after-work events and informal meetings throughout the year.

Attractive rewards

We focus on work/life balance and offer employees flexible working hours and workplace, annual vacation allowance, competitive pension, insurance, and a global profit share scheme.

Diversity, Equity and Inclusion

At DNV, our commitment to Diversity, Equity, and Inclusion is not only an ethical choice, but also a business decision.

Diversity, fairness, and a sense of belonging are a source of strength for our people, our business, and our customers, and help us to deliver on our purpose, vision, and values.

Learn more

Working here

Since 1864 we’ve been dedicated to safeguarding life, property and the environment. Today we remain at the forefront of new technologies and techniques to help our customers transform for a more sustainable future.

At DNV you can expect to deliver career and industry defining work. You’ll be given the time to build your network, the resources to support your development, and the freedom to satisfy your curiosity and desire to learn.

Learn more

Application Process

FAQs

Welcome to our Frequently Asked Questions page. We’ve put together answers to the questions we’re asked most often to help you find the information you need quickly and easily. Whether you're curious about our recruitment process, benefits or career growth and development, you should find the information below.

How can I find job openings that fit my skills and interests?

Explore our official job search page where you can use filters such as job type, location, and department to find roles that best match your qualifications and career aspirations.

What’s your application process like?

You can apply directly through our careers page by submitting your CV and any other documents we require (i.e. university diplomas/transcripts; visas; previous employment reference letters). Make sure your application is fully completed, and you tailor it to the specific job listing. 

Is your recruitment process designed to be inclusive and accessible?

Yes, it is. We're an equal opportunities employer and welcome applications from all candidates. We’re happy to support your need for any adjustments during the application and hiring process. Share the details of what you need within your application.

What types of interviews might I undergo?

Depending on your role, our interview process may include initial phone screenings, video conferences, and in-person interviews, focusing on both your technical abilities and our shared values. You can ask your recruiter specifically about the interview process for your role. 

How long does the hiring process typically take from application to decision?

The timeline can vary but we make every effort to reply to each candidate as soon as possible and keep everyone up-to-date with where they are in the recruitment process.

How do I know if a recruitment contact is legitimately from your company?

Official communication will come from our verified company email addresses. Carefully check any suspicious looking emails and if you have any doubts, don’t engage.

Are there any fees involved in your recruitment process?

No, we do not charge any fees at any stage of our recruitment process. All applications and interviews are free of charge, we will never ask you to pay any fees or make any payments – please be wary of any requests for payment as these are likely scams.

What should I do if I suspect a job scam?

If you encounter suspicious job postings or recruitment practices, do not provide personal information and contact your recruiter as soon as possible. We take these matters seriously. We will never ask you to pay any fees or make any payments part of our recruitment process.

Join Our Talent Community

Can't find the right fit?

Be the first one to learn about new job opportunities that might be a perfect fit for you.

Join

Disclaimer

Please beware of recruitment scams that pretend to be from DNV or its employees. We will never ask you to pay any fees or make any payments as part of our recruitment process.